Abstract: When repairing a road, it is possible to easily conduct a survey on the road condition at the time of starting repair. The ortho-image creation method of the present invention includes a coordinate acquisition step to acquire three-dimensional coordinates of a plurality of survey markers 6, a photography step to photograph a plurality of photographed images of the plurality of survey markers 6 by a UAV 3 flying at an altitude of 20 meters or less above the ground in such a manner that each survey marker 6 is included in at least two of the photographed images, and an ortho-image creation step to create an ortho-image on the basis of the three-dimensional coordinates of each feature point acquired by the coordinate acquisition step and the plurality of photographed images photographed by the photography step.

Abstract: The present disclosure relates to methods and devices for performing depth estimation on image data. In one example, a device performs depth estimation on first and second images captured using one or more cameras having a color filter array. Each image of the first and second images comprises multiple color channels. Each color channel of the multiple color channels corresponds to a respective color channel of the color filter array. The device performs the depth estimation by estimating disparity from the color channels of the first and second images.

Abstract: Systems and methods are disclosed for video encoding and video decoding using decoder-side intra mode derivation (DIMD). Techniques are provided to code and to decode a video block of a video frame into a bitstream, including determining costs of using respective candidate intra prediction modes to predict samples in a template region adjacent to the video block, deriving an intra prediction mode based on candidates of the candidate intra prediction modes and their respective costs, and predicting samples in the current video block using the derived intra prediction mode. The provided techniques further include determining the costs in multiple stages. In an initial stage, the costs of using respective intra prediction modes from an initial set of candidate modes are determined.

Abstract: An imaging apparatus capable of attaching and detaching a lens unit, includes: a processor; and a computer-readable medium storing instructions which, when executed by the processor, cause the imaging apparatus to detect a tilt of the imaging apparatus, acquire information on a type of the lens unit attached on the imaging apparatus, perform control to display an image captured using an optical system of the lens unit on the screen, and perform control to superimpose and display an item indicating the detected tilt on the image based on the acquired information, wherein the item is displayed at different positions depending on whether the lens unit includes a plurality of optical systems.

Abstract: A dynamic image virtualization system and method configured to utilize an AI model in order to conduct a reduced latency real-time prediction process upon at least one input image, wherein said prediction process is designated to create free-viewpoint 3D extrapolated output dynamic images tailored in advance to the preferences or needs of a user and comprising more visual data than the at least one input image.

Abstract: An example method in accordance with some embodiments may include: receiving a media manifest file identifying a plurality of representations of a multi-view video, at least a first representation of the plurality of representations comprising a first sub-sampling of views and at least a second representation of the plurality of representations comprising a second sub-sampling of views different from the first sub-sampling of views; selecting a selected representation from the plurality of representations; retrieving the selected representation; and rendering the selected representation.

Abstract: An electronic device and a method of controlling the same are provided. The electronic device includes a housing foldable about a first axis; a foldable display foldable about a second axis parallel to the first axis; a folding sensor circuit configured to detect a display state of at least one of the housing or the foldable display; a memory storing instructions; and a processor configured to execute the instructions stored in the memory to: determine a position of a virtual light source with respect to the foldable display based on context information associated with the electronic device; render an image based on the display state detected by the folding sensor circuit and the position of the virtual light source; and control the foldable display to display the rendered image.

Abstract: Described are various embodiments of a light field device, pixel rendering method therefor, and vision perception system and method using same. One embodiment describes a method to adjust user perception of an image portion to be rendered via a set of pixels and a corresponding array of light field shaping elements (LFSE), the method comprising: projecting an adjusted image ray trace between a given pixel and a user pupil location to intersect an adjusted image location for a given perceived image depth given a direction of a light field emanated by the given pixel based on a given LFSE intersected thereby; upon the adjusted image ray trace intersecting a given image portion associated with the given perceived image depth, associating with the given pixel an adjusted image portion value designated for the adjusted image location based on the intersection; and rendering for each given pixel the adjusted image portion value associated therewith.

Abstract: An object is to simply and easily evaluate differences in behavior of the eyes of subjects. A binocular measurement system 1 includes a photodetector 7 that detects reflected light from the right eye ER and the left eye EL of a subject, and outputs image signal of the reflected light, a feature amount calculating unit 11 that calculates a feature amount corresponding to the right eye ER and a feature amount corresponding to the left eye EL based on the image signal, and a comparison value calculating unit 13 that calculates, based on the two feature amounts, a comparison value obtained by comparing the two feature amounts.

Abstract: Provided are a vision sensor, an image processing device including the same, and an operating method of the vision sensor. The vision sensor includes a pixel array including a plurality of pixels, a synchronization control module configured to receive a synchronization signal from an external image sensor and generate an internal trigger signal based on the synchronization signal, an event detection circuit configured to receive the internal trigger signal and detect whether an event has occurred in the plurality of pixels and generate event signals corresponding to pixels in which the event has occurred, and an interface circuit configured to receive the event signals and transmit to an external processor vision sensor data based on the trigger signal and at least one of the event signals, where the vision sensor data includes matching information for timing image frame information generated by the image sensor and the event signals generated by the vision sensor.

Abstract: An image processing system and an image processing device are provided. The image processing system includes an electronic device and the image processing device. The image processing device is connected to the electronic device. The image processing device displays a floating three-dimensional input device image information. The image processing device interacts with an object through the three-dimensional input device image information to generate a plurality of control signals, and transmits the plurality of control signals to the electronic device.

Abstract: A system for visual cognition processing for sighting, effectively a rifle scope apparatus, is a system that transforms one or more captured image streams through image processing and complex scene analysis including detection, segmentation, keypoints, identification and visual cognition processing that generates a display image visible to a viewer on a display where the complete analysis of the scene can be computed on the sighting device or on a separate computation platform.

Abstract: A wearable device is disclosed. The wearable device comprises: a camera; a sensor; a display; a laser projector; and a processor for identifying a user's sight line on the basis of sensing data obtained by the sensor, identifying location information of at least one object included in an image obtained by the camera, and controlling the laser projector to provide, on the display, augmented reality (AR) information related to the object on the basis of the identified user's sight line and location information of the object, wherein the laser projector comprises: a light emitting element for emitting a laser light; a focus adjusting element for adjusting a focus of the emitted laser light; and a scanning mirror for controlling a scan direction of the light having the adjusted focus, and the processor controls a driving state of the focus adjusting element on the basis of the identified user's sight line and location information of the object.

Abstract: Several unique hardware configurations and methods for freeform optical display systems are disclosed. A freeform display system includes primary freeform optical element(s) and secondary freeform optical element(s) in tiled arrangements to expand the horizontal field of view (FOV) or the vertical field of view. The system may include a variable focusing system that produces intermediate pupil and changes the focal distance of a single focal plane or switches among multiple focal planes for rendering objects in focus while resolving accommodation-convergence conflict. The system may map light samples to appropriate light rays in physical space and use a cluster of projectors to project the mapped light rays to produce the light field of the virtual display content. Methods for making tiled freeform optical display systems and methods for producing virtual content with variable focus freeform optics and rendering light fields are also disclosed.

Abstract: Provided is a method of reducing fatigue resulting from viewing a three-dimensional (3D) image display. The method includes: obtaining low visual fatigue parameter information on a frame section including at least one frame of a received 3D image; obtaining disparity vector information on each frame of the 3D image; and determining a disparity minimum limit value and a disparity maximum limit value with respect to the 3D image.

Abstract: An image processing method includes: receiving a disparity range setting which defines a target disparity range; receiving 3D image data with original disparity not fully within the target disparity range; receiving auxiliary graphical data with original disparity fully beyond the target disparity range; and generating modified 3D image data, including at least a modified portion with modified disparity fully within the target disparity range, by modifying at least a portion of the received 3D image data according to the obtained disparity range setting. At least the modified portion of the modified 3D image data is derived from at least the portion of the received 3D image data that has disparity overlapped with disparity of the received auxiliary graphical data. With the help of the disparity modification, the playback of the 3D image data may be protected from being obstructed by the display of the auxiliary graphical data.

Abstract: A 3D video reproduction device configured to reproduce 3D streaming data that includes 3D video data and audio data. The 3D video reproduction device comprises an audio analyzing unit, a parallax setting unit, a video correction unit, and an output unit. The audio analyzing unit is configured to analyze the audio data to determine the scene indicated by the 3D video data. The parallax setting unit is configured to set the amount of parallax that corresponds to the scene based on the audio data analyzed by the audio analyzing unit. The video correction unit is configured to correct the 3D video data based on the amount of parallax set by the parallax setting unit. The output unit is configured to reproduce the corrected 3D video data and output the audio data.

Abstract: An exemplary depth control method includes following steps: receiving input images corresponding to different views; generating at least one depth-related information map according to the input images; estimating a confidence level by measuring quality of the depth-related information map; and adjusting the depth-related information map according to the confidence level. In addition, an exemplary depth control apparatus includes a depth-related information map generation circuit, a quality measurement circuit and an adjustment circuit. The depth-related information map generation circuit receives input images corresponding to different views, and generates at least one depth-related information map according to the input images. The quality measurement circuit estimates a confidence level by measuring quality of the depth-related information map. The adjustment circuit adjusts the depth-related information map according to the confidence level.

Abstract: A stereoscopic video temporal frame offset measurement system uses an improved signature curve generator to generate a robust signature curve for each of the left and right image sequences of a stereo video signal. The resulting signature curves are cross-correlated over a specified correlation range to generate cross-correlation coefficients. The cross-correlation coefficients are compared to a high threshold, and a temporal frame offset is generated and displayed for each cross-correlation coefficient that exceeds the high threshold. Each new temporal frame offset result is highlighted when displayed, otherwise the last result is displayed in a background fashion.

Abstract: A particular implementation receives a stereo video and a disparity map corresponding to the stereo video, the disparity map including a sample that does not indicate an actual disparity value. The particular implementation determines disparity information corresponding to the sample and processes the stereo video based on the disparity information. Another implementation receives a stereo video and processes disparity information corresponding to the stereo video. A further implementation generates a disparity map, the disparity map including a sample that does not indicate an actual disparity value.

Abstract: A particular implementation accesses a disparity value for a particular location in a picture, the disparity value indicating disparity with respect to a particular resolution. The particular implementation modifies the accessed disparity value based on multiple resolutions to produce a modified disparity value. Another implementation accesses a disparity value for a particular location in a picture, the picture having a particular resolution, and the disparity value indicating disparity with respect to another resolution that is different from the particular resolution and that is based on multiple resolutions. A further implementation modifies the accessed disparity value to produce a modified disparity value indicating disparity with respect to the particular resolution.

Abstract: A method and apparatus are described including determining an inter-frame object displacement for each object in a left eye image frame pair, determining an inter-frame object displacement for each object in a right eye image frame pair, determining a convergence shifting field between each object in the left eye image and the right eye image pair, determining an amount of motion blur responsive to the inter-frame object displacement for each object in the left eye image frame pair, the inter-frame object displacement for each object in the right eye image frame pair, and the convergence shifting field between each object in the left eye image and the right eye image pair and adjusting the motion blur by the amount of motion blur.

Abstract: Methods and systems are described for enabling the viewing of positionally and orientationally modified stereoscopic video material using one or more participants with near-to-eye displays with video content appearance altered to accommodate changes in orientation and position of the display.

Abstract: A stereoscopic image display apparatus which can accurately visually recognize all the regions of a stereoscopic image without using a varifocal lens, and can form a natural three-dimensional image on a retina with a processing load on a computer eased even if an image is viewed by a plurality of viewers from any positions.