Abstract: There is provided a stereo camera module, including: a camera unit including a first camera and a second camera disposed to be separated from each other by a predetermined interval to receive a left image and a right image, respectively; and a correction coefficient storing unit storing a correction coefficient indicating a degree to which the first camera and the second camera deviate from a predetermined alignment state.

Abstract: A 3D image rectifying method includes: controlling at least two cameras to capture depth images in front of an electronic device periodically and forms 3D images according to the captured depth images; recognizing the face of the user from the formed 3D image; determining at least one deflection angle which the detected face deflected from a front view of the face in the 3D image; separating the recognized face from the background of the 3D image; and rotating the recognize face according to the at least one deflection angle to rectify the recognize face to the front view of the face and display the rectified image.

Abstract: A 3-dimensional (3D) image acquisition apparatus and a method of calculating depth information in the 3D image acquisition apparatus, the 3D image acquisition apparatus including: an optical modulator for modulating light reflected from a subject by sequentially projected N (N is 3 or a larger natural number) light beams; an image sensor for generating N sub-images by capturing the light modulated by the optical modulator; and a signal processor for calculating depth information regarding a distance to the subject by using the N sub-images.

Abstract: Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.

Abstract: An apparatus and method for encoding and decoding using view synthesis prediction are provided. The apparatus synthesizes imagers corresponding to peripheral views of a current view, and encodes current blocks included in an image of the current view by a currently defined encoding mode or an encoding mode related to virtual view synthesis prediction, according to a coding unit.

Abstract: Provided are an apparatus for synchronizing a stereocamera, a stereocamera, and a method of synchronizing a stereocamera. The apparatus for synchronizing a stereocamera includes a synchronization error calculating unit configured to calculate a synchronization error from output signals of first and second image sensors, and a pulse adjusting unit configured to adjust a pulse of a synchronization signal of at least one of the first and second image sensors using the calculated error. In addition, the stereocamera and the method of synchronizing the same are provided.

Abstract: Methods and systems for generating free viewpoint video using an active infrared (IR) stereo module are provided. The method includes computing a depth map for a scene using an active IR stereo module. The depth map may be computed by projecting an IR dot pattern onto the scene, capturing stereo images from each of two or more synchronized IR cameras, detecting dots within the stereo images, computing feature descriptors corresponding to the dots in the stereo images, computing a disparity map between the stereo images, and generating the depth map using the disparity map. The method also includes generating a point cloud for the scene using the depth map, generating a mesh of the point cloud, and generating a projective texture map for the scene from the mesh of the point cloud. The method further includes generating the video for the scene using the projective texture map.

Abstract: An apparatus and method of generating a three-dimensional (3D) panoramic image, using a single camera. The apparatus may include a frame slit capturing unit to capture a first frame slit in an Nth video frame, and to capture a second frame slit from an (N+2)th video frame, and a 3D image generating unit to generate a left image using the captured first frame slit and the captured second frame slit. Here, the frame slit capturing unit may capture a third frame slit in an (N+1)th video frame, and captures a fourth frame slit in an (N+3)th video frame, and the 3D image generating unit may generate a right image using the captured third frame slit and the captured fourth frame slit.

Abstract: A portable robotic device (PRD) as well as related devices and methods are described herein. The PRD includes a 3-D imaging sensor configured to acquire corresponding intensity data frames and range data frames of the environment. An imaging processing module configured to identify a matched feature in the intensity data frames, obtain sets of 3-D coordinates representing the matched feature in the range data frames, and determine a pose change of the PRD based on the 3-D coordinates; and perform 3-D data segmentation of the range data frames to extract planar surfaces.

Abstract: An image processing method is disclosed. A 2D image is virtually divided into a plurality of blocks. With respect to each block, an optimum contrast value and a corresponding focus step are obtained. An object distance for an image in each block is obtained according to the respective focus step of each block. A depth map is obtained from the object distances of the blocks. The 2D image is synthesized to form a 3D image according to the depth map.

Abstract: An image generator is provided which generates a monitor display image that facilitates easy recognition of a three-dimensional object in an overhead view image.

Abstract: A three dimensional shape measurement apparatus comprising: a projection unit configured to perform a projection operation to a measurement area; a photographing unit configured to photograph a target object in the measurement area undergoing the projection operation; and a measurement unit configured to measure a three dimensional shape of the target object based on the photographed image, wherein the measurement area includes a measurement reference surface serving as a reference for a focus position of a photographing optical system of the photographing unit, and is defined based on a projection range of the projection unit and a photographing range of the photographing unit, and the focus position is set deeper than a position of the measurement reference surface when observed from the photographing unit.

Abstract: Provided is an apparatus and method for obtaining depth information using an optical pattern. The apparatus for obtaining depth information using the optical pattern may include: a pattern projector to generate the optical pattern using a light source and an optical pattern projection element (OPPE), and to project the optical pattern towards an object area, the OPPE comprising a pattern that includes a plurality of pattern descriptors; an image obtaining unit to obtain an input image by photographing the object area; and a depth information obtaining unit to measure a change in a position of at least one of the plurality of pattern descriptors in the input image, and to obtain depth information of the input image based on the change in the position.

Abstract: An image system comprises a light source, an image sensing device, and a computing apparatus. The light source is configured to illuminate an object comprising at least one portion. The image sensing device is configured to generate a picture comprising an image. The image is produced by the object and comprises at least one part corresponding to the at least one portion of the object. The computing apparatus is configured to determine an intensity value representing the at least one part and to determine at least one distance between the at least one portion and the image sensing device using the intensity value and a dimension of the at least one part of the image.

Abstract: A detective adjusting apparatus for a stereoscopic image and a related method is disclosed in the present invention. The apparatus includes an image capturing device, an image processing device, a stereoscopic display and an image analyzing/displaying device. The present invention utilizes the method to calculate an angle between eyes' position and a central position according to the face position, to determine the stereoscopic image by analyzing parameters of the stereoscopic image and the stereoscopic display, and to display the continuous stereoscopic image having at least two viewpoints, so the a viewer can watch the stereoscopic image clearly. The present invention is applied to an optical grating or an auto-stereoscopic screen made by lens.

Abstract: An image processing apparatus includes stereo cameras and detects a distance to a target around a vehicle. The image processing apparatus includes sensors installed in the vehicle; determines a vehicle situation by combining detection signals of the sensors and switches from image data of a stereo camera for driving assistance to image data of a stereo camera for door opening/closing assistance; carries out distortion corrections that are unique to the plural stereo cameras respectively on the selected image data so that correlation calculation common to the plural stereo cameras can be carried out; carries out the correlation calculation on two sets of image data of the single stereo camera; and detects the distance to the target by using a calculation result of the correlation calculation.

Abstract: Information for a camera unit not used for a stereoscopic view in the case of a display method having parallax only in a horizontal direction is used to thereby generate a multi-viewpoint image subjected to an image processing. Step S801 acquires parallax-related information to be displayed. Step S802 determines, based on the parallax-related information, whether the parallax direction is “only the horizontal direction” or not. When the parallax direction is “only the horizontal direction”, the processing proceeds to Step S803. When the parallax direction is not “only the horizontal direction”, the processing proceeds to Step S807. Step S803 acquires the layout information for the image capturing units. Next, Step S804 selects the image capturing unit in the vertical direction. Next, Step S805 uses the selected image to perform a high dynamic range (HDR) combination.

Abstract: There is provided a calibration apparatus for a camera module capable of calibrating the difference in optical characteristics between left and right images of a binocular camera module in real time by capturing images of a plurality of rotating test boards. The calibration apparatus of a camera module includes: a test unit including two or more mutually connected test boards, the test boards having images captured by a camera module and rotating at a pre-set angle; and a calibration unit receiving the images of the test boards captured by the camera module and calibrating optical characteristics thereof.

Abstract: An image processing apparatus 1 includes: a placement information acquisition section 40 which acquires, for each image sensor, placement information of the image sensors with respect to the imaging section 10; a movement information acquisition section 30 which acquires movement information of the imaging device; and an output area acquisition section which acquires, for every image sensor, position information of a second output area within the second frame image which corresponds to a first output area within the first frame image. The output area acquisition section acquires: a second output area A12 of a base image sensor based on position information of a first output area A11 determined by the placement information and based on the movement information; and a second output area A22 of another image sensor based on the placement information of the base image sensor, the placement information of the other image sensor, and the movement information.

Abstract: There is provided a projector apparatus including a terminal unit supplied with video data output by a source apparatus; a video projection processing unit that generates a projection video based on the video data and projects the generated projection video through a projection lens, a distance detection unit that detects a distance to a display surface on which the projection video projected through the projection lens is displayed, a projection angle detection unit that detects a projection angle of the projection video projected through the projection lens, and a control unit that calculates a display size of the projection video on the display surface based on the distance detected by the distance detection unit and the projection angle detected by the projection angle detection unit and transmits the calculated display size as the data regarding the display capability of the projector apparatus from the terminal unit to the source apparatus.

Abstract: An imaging element includes a plurality of photoelectric conversion units that output an image signal for each pixel through a micro lens. An imaging signal processing circuit separates image signals output from the imaging element into a left-eye image signal and a right-eye image signal. An image combining circuit generates combined image data by performing arithmetic average processing for left-eye image data and right-eye image data. A recording medium control I/F unit controls to record left-eye image data and right-eye image data for use in 3D display and combined image data for use in 2D display in different regions in an image file.

Abstract: Various arrangements for using an active 3D signal to create passive 3D images are presented. An active 3D frame may be received. The active 3D frame may comprise a first perspective image and a second perspective image. The first perspective image may be representative of a different perspective than the second perspective image. The first perspective image may be tinted with a first color. The second perspective image may be tinted with a second color different from the first color. The first perspective image tinted with the first color may be displayed. The second perspective image tinted with the second color may be displayed.

Abstract: Provided is an imaging apparatus that includes an imaging element in which pixel portions each having a plurality of photoelectric conversion units, which generate image signals by photoelectrical conversion, with respect to one micro lens are arranged side by side in a horizontal direction and a vertical direction, an imaging element controller having a first mode which outputs a first left-eye image signal and/or right-eye image signal from the imaging element by composing signals from the plurality of photoelectric conversion units and a second mode which outputs signals without performing the composing and a controller that outputs a second left-eye image signal and/or right-eye image signal by composing signals output in the second mode based on image data stored in a storage unit in response to the type of photographing of which the start has been detected.

Abstract: A liquid crystal display device for carrying out a 3D display by a frame sequential method as well as a 2D display includes: a digital ? correction section (21) for changing an input gray level to a gamma characteristic corresponding to either the 2D display or the 3D display in accordance with a preset analog gamma value; an overdrive circuit (23) for finding, in accordance with a parameter set according to the gamma characteristic thus corrected by the digital ? correction section (21), an overdrive value corresponding to the input gray level; and an analog ? correction section (22) for finding a voltage value to be applied to liquid crystal by correcting the overdrive value found by the overdrive circuit (23). In the digital ? correction section (21), an analog gamma value for the 3D display is set to be larger than an analog gamma value for the 2D display. This makes it possible to display a high-quality display with no crosstalk when carrying out a 3D display by a frame sequential method.

Abstract: An imaging apparatus includes a first imaging unit configured to generate a first image, a second imaging unit configured to generate a second image, a detector configured to detect trigger information for start of shooting based on one of the first image and the second image, and a processor configured to perform a capturing process on both the first imaging unit and the second imaging unit when the detector detects the trigger information.

Abstract: Example embodiments disclosed herein relate to determining relationships between locations based on beacon information. At least three sensors of a device can be used to determine locations of a beacon. The device can determine a three-dimensional relationship between the locations.

Abstract: A method to monitor a vehicle inspection workflow, includes (i) identifying an inspector in a vehicle inspection area, (ii) determining an inspection procedure being performed by the inspector, the inspection procedure being at least a portion of a vehicle inspection, (iii) determining a workflow rule that corresponds to the inspection procedure, the workflow rule including at least one workflow limit, (iv) generating workflow data by monitoring the inspector within the inspection area, the workflow data being determined from recorded video data, (v) determining whether the inspector violated the workflow rule by comparing the workflow data to the at least one workflow limit of the workflow rule, and (vi) indicating that the inspector did not adequately perform the inspection procedure if it is determined that the inspector violated the workflow rule.

Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A model may be adjusted based on a location or position of one or more extremities estimated or determined for a human target in the grid of voxels. The model may also be adjusted based on a default location or position of the model in a default pose such as a T-pose, a DaVinci pose, and/or a natural pose.

Abstract: A method for generating an image is provided. The method includes estimating a high resolution image from a plurality of low resolution images and downsampling the estimated high resolution image to obtain estimates of a plurality of low resolution images. The method also includes generating a desired high resolution image based upon comparison of the downsampled low resolution images and the plurality of low resolution images.

Abstract: A three-dimensional image without luminance irregularity is generated while achieving good contrast.

Abstract: Described herein are methods, systems and apparatus to improve imaging sensor production yields. In one method, a stereoscopic image sensor pair is provided from a manufacturing line. One or more images of a correction pattern are captured by the image sensor pair. Correction angles of the sensor pair are determined based on the images of the correction pattern. The correction angles of the sensor pair are represented graphically in a three dimensional space. Analysis of the graphical representation of the correction angles through statistical processing results in a set of production correction parameters that may be input into a manufacturing line to improve sensor pair yields.

Abstract: Array cameras in accordance with embodiments of the invention perform super resolution processing using images of a scene that contain aliasing. In several embodiments, the depth of pixels is determined by fusing portions of a higher resolution image at a number of hypothesized depths and determining the depth at which the portion of the higher resolution image best matches the scene captured in the lower resolution images used to fuse the higher resolution image.

Abstract: The present disclosure uses at least three cameras to monitor even a large-scale area. Displacement and strain are measured in a fast, convenient and effective way. The present disclosure has advantages on whole field, far distance and convenience.

Abstract: If there is a discrepancy between a capturing system and a display system of a stereoscopic moving image, the phenomena, such as that the contour of a motion area of an image looks double, may occur, thus posing a problem in the quality of a reproduced image. An image capturing device capturing a stereoscopic moving image includes: an image capturing unit configured to capture a right-eye moving image and a left-eye moving image constituting the stereoscopic moving image, respectively; a unit configured to set an image capturing mode corresponding to the display system of a display device displaying the stereoscopic moving image; and a synchronous signal control unit configured to supply to the image capturing unit a synchronous signal used for capturing the right-eye moving image and the left-eye moving image, respectively, and control a phase of the synchronous signal to supply in accordance with the set image capturing mode.

Abstract: This invention relates to capturing an image of a subject as a three-dimensional image using a single image-capturing apparatus. The image-capturing apparatus includes a first polarization means, a lens system, and an image-capturing device array having a second polarization means. The first polarization means includes first and second regions arranged along a first direction, and the second polarization means includes multiple third and fourth regions arranged alternately along a second direction. First region transmission light having passed the first region passes the third region and reaches the image-capturing device, and second region transmission light having passed the second region passes the fourth region and reaches the image-capturing device. Thus, an image is captured to obtain a three-dimensional image in which a distance between a barycenter BC1 of the first region and a barycenter BC2 of the second region is a base line length of parallax between two eyes.

Abstract: An RFID/object recognition system monitors the passage of an object through a portal into a space. An RFID reader adjacent the portal communicates with an RFID tag within a preselected distance from the RFID reader. A data processor processes data from the RFID reader. A 3-dimensional scanner has an RGB camera and a depth sensor with an infrared laser projector and a monochrome CMOS sensor. An infrared laser controller is electronically coupled with the infrared laser projector, and a monochrome CMOS processor is electronically coupled with the monochrome CMOS sensor. The infrared laser controller, monochrome CMOS processor, and RGB camera are electronically coupled with a processor. The RFID reader receives data from an RFID tag when an RFID-tagged object passes within the preselected distance from the RFID reader through the portal. The 3-dimensional object recognition assembly identifies where the RFID-tagged object is located within the defined space.

Abstract: Provided is an information processing apparatus including a correction unit that corrects at least position coordinates used to specify a position of an enlarged-image group generated in accordance with a scanning method of a microscope that scans a sample in vertical, horizontal, and depth directions and generates an image data group corresponding to the enlarged-image group of the sample, and a stereoscopic image generation unit that generates a stereoscopic image of the enlarged-image group by giving parallax to the corrected image data group.

Abstract: One embodiment of the present invention provides a system that facilitates interaction between a stereo image-capturing device and a three-dimensional (3D) display. The system comprises a stereo image-capturing device, a plurality of trackers, an event generator, an event processor, and a 3D display. During operation, the stereo image-capturing device captures images of a user. The plurality of trackers track movements of the user based on the captured images. Next, the event generator generates an event stream associated with the user movements, before the event processor in a virtual-world client maps the event stream to state changes in the virtual world. The 3D display then displays an augmented reality with the virtual world.

Abstract: A method and system for measuring full field deformation characteristics in three dimensions of a body upon which a pattern of visible marks has been applied. The method includes receiving images of the pattern of marks from at least two digital video cameras as the specimen deforms. A computer processor identifies the centroids of each of the two camera images of the body in a first frame, matches the centroids of the marks in the two images, and generates a three-dimensional representation of the centroids based on the two images, and repeats these steps for the images from the two cameras in a subsequent frame. The computer processor calculates the displacement vector between a three dimensional representation of the centroids and the subsequent three dimensional representation of the centroids, and calculates full field displacement and strain fields based on the displacement vector.

Abstract: This invention improves the image quality of areas that the user want sharply focused. Depth values representing positions in a depth direction of scenes including the photographed object are estimated to generate a depth map. The focus map generation unit, based on the virtual focus parameter 305 and the depth map, generates by an area dividing operation a focus map representing an area to be sharply focused (in-focus area) and an area to be blurred (out-of-focus area). The in-focus area image processing unit places greater importance on the in-focus area in the image processing to generate an in-focus area image. The out-of-focus area image processing unit puts greater importance on the out-of-focus area in the image processing to generate an out-of-focus area image. The image blending unit generates a refocused image by blending the in-focus area image and the out-of-focus area image.

Abstract: Disclosed herein is an image processor including: a first emission section for emitting light at a first wavelength to a subject; a second emission section for emitting light at a second wavelength longer than the first wavelength to the subject; an imaging section for capturing an image of the subject; a detection section for detecting a body region representing at least one of the skin and eyes of the subject based on a first captured image acquired by image capture at the time of emission of the light at the first wavelength and a second captured image acquired by image capture at the time of emission of the light at the second wavelength; a calculation section for calculating viewpoint information; and a display control section for controlling a display mechanism adapted to allow the subject to visually recognize an image as a stereoscopic image.

Abstract: Described herein are methods and apparatus to adjust the convergence point of a stereoscopic image pair captured by an imaging device. In one method, a first image and a second image of a stereoscopic image pair are provided, and then shifting or cropping of the first image is performed to align the first and second image. This shifting or cropping is performed while preserving the second image. The method then includes determining a target horizontal image disparity based on a desired convergence point of the stereoscopic image pair and when the target horizontal disparity is greater than a predetermined maximum, the cropping of an outside dimension of the first image is limited. In some implementations it is limited to the predetermined maximum.

Abstract: A method and apparatus for obtaining geometry information, material information, and lighting information in an image modeling system are provided. Geometry information, material information, and lighting information of an object may be extracted from a single-view image captured in a predetermined light condition, by applying pixel values defined by a geometry function, a material function, and a lighting function.

Abstract: A camera system including: a substrate having a coding pattern printed thereon and a handheld digital camera device. The camera device includes: a digital camera unit having a first image sensor for capturing images and a color display for displaying captured images to a user; and an integral processor configured for: controlling operation of the first image sensor and color display; decoding an imaged coding pattern printed on a substrate; and performing an action in the handheld digital camera device based on the decoded coding pattern. The decoding includes the steps of: identifying a data block in the imaged coding pattern; decoding a control block to determine the size of data to be extracted from a data area; and decoding the coding pattern contained in ae data area of the data block.

Abstract: In embodiments, a virtual advertising platform may use a three-dimensional mapping algorithm to insert a virtual image within a digital video stream. The virtual advertising platform may apply a three-dimensional mapping algorithm to the virtual digital image, wherein the three-dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within a received two-dimensional digital data feed in place of a spatial region within the two-dimensional data feed. The mapping algorithm may enable application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed, and may send the recomposited digital data feed for display to a user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.

Abstract: A method for incorporating two dimensional images such as those captured by a video camera, which is moving and whose optics, particularly zoom and focus, are controlled by a human or by automatic means, into a virtual three dimensional coordinate system is provided In one embodiment the method acquires calibration data over the functional range of the studio camera optics, and then in operation dynamically performs the appropriate transformations needed to map the video stream to the virtual coordinate system, even as the acquiring studio camera moves, zooms, and changes focus.

Abstract: Systems and methods for automatically generating three-dimensional panoramic images for use in various virtual reality settings are disclosed. One embodiment of the system includes a stereo camera capture device (SCD), a programmable camera controller (PCC) that rotates, orients, and controls the SCD, a robotic maneuvering platform (RMP), and a path and adaptation controller (PAC). In that embodiment, the PAC determines the movement of the system based on an original desired path and input gathered from the SCD during an image capture process.

Abstract: A system for managing face data includes a global face capturing unit configured to capture a global face image; and a global face data generation unit configured to obtain shape information and texture information of global face data, and generate the global face data. Further, the system includes a local face capturing unit configured to capture a plurality of local face images; and a global face posture extraction unit configured to estimate a position and a direction of the face of a captured user. Furthermore, the system includes a local capturing device posture extraction unit configured to extract posture information of the local face capturing unit; and a local face data generation unit configured to generate texture information and shape information, and generate local face data.

Abstract: A method for detection of a target present on at least two images of the same scene captured by separate cameras comprises a prior step for learning about targets under setup conditions and further comprises, under conditions of use, a simultaneous classification step for objects present on the images, the target being said to be detected as soon as an object is classified as being one of the targets learned during the learning step. The classification step includes a step for adapting at least one of the images to the setup conditions under which the learning step took place. Application: surveillance, assistance and safety based on stereoscopic images.

Abstract: A method for rendering point cloud using a voxel grid, includes generating bounding box including all the point cloud and dividing the generated bounding box into voxels to make the voxel grid; and allocating at least one texture plane to each of the voxels of the voxel grid. Further, the method includes orthogonally projecting points within the voxel to the allocated texture planes to generate texture images; and rendering each voxel of the voxel grid by selecting one of the texture planes within the voxel by using central position of the voxel and the 3D camera position and rendering using the texture images corresponding to the selected texture plane.