Abstract: Techniques and technologies are described herein for motion parallax three-dimensional (3D) imaging. Such techniques and technologies do not require special glasses, virtual reality helmets, or other user-attachable devices. More particularly, some of the described motion parallax 3D imaging techniques and technologies generate sequential images, including motion parallax depictions of various scenes derived from clues in views obtained of or created for the displayed scene.

Abstract: A photographing apparatus is provided that accurately determines focus positions of two photographing sections in the same degree of time as in the past and a focus position determining method. A search range setting section 121 calculates one boundary value Pn? of a second search area and calculates the other boundary value Pf? of the second search area on the basis of a focus position P1 of a first focus lens FLA detected by an AF detecting section 120 and a boundary value N of a search area on a near side and a boundary value F of a search area on a far side. The AF detecting section 120 searches for a focus position P2 while instructing a second F lens driving section 104B to move a second focus lens FLB in a second search area (Pn? to Pf?) narrower than a first search area.

Abstract: From a stereo image having at least 2 perspectives additional virtual perspectives are produced, wherein the processing time for the virtual perspectives is less than a specified value and simultaneously the multi-view image quality is maximized by identifying image areas that have not changed between two stereo images of the image sequence. In these areas the associated disparity map also did not change and the disparity values are reused. In addition, the processing parameters for calculating the virtual perspectives are continuously adjusted through continuous time measurement during processing such that the quality is always at a maximum. An adaptive method is obtained, which is also able to respond to load fluctuations of the underlying hardware device.

Abstract: In accordance with one aspect, the present invention provides a real-time 3D visualization system. The system includes means for conveying electromagnetic energy emanating from one or more 3D surfaces including a scene and means for sensing spatial phase characteristics of the electromagnetic energy as the configuration of the 3D surfaces relative to the system changes. The system includes means for creating a 3D scene model utilizing the spatial phase characteristics sensed in a plurality of configurations and means for displaying the 3D scene model in real-time. The means for displaying includes means for synthesizing depth cues.

Abstract: A combined depth map is generated for a monoscopic image based on a weighted combination of a color depth map, a spatial depth map, and a motion depth map for the image, each describing the depth of pixels in the image relative to the image plane. The color depth map determines the depth of pixels according to their color, the spatial depth map determines the depth of pixels according to their location in the image, and the motion depth map determines the depth of pixels according to their motion in the image. Each of the depth maps is associated with a weight that is used to generate the weighted combination. The weights are adaptive to account for variation between different monoscopic images.

Abstract: An image display apparatus for displaying an image of an object on a screen by using a projector includes a three-dimensional image display unit having a plurality of screens overlaid but spaced apart from one another, each of the screens diffusing and reflecting part of the light incident thereon and transmitting the remainder of the light, and an image projection unit having a plurality of projectors, each of the projectors is assigned to the corresponding one of the screens and projects an image of the object on the screen. The image projection unit displays a three-dimensional image of the object in the three-dimensional image display unit by projecting on the screens the shapes of the object in sectioning positions corresponding to the positions of the screens.

Abstract: An image signal storing unit stores an image signal provided from the outside. An image processing unit appropriately processes the image signal stored in the image signal storing unit in accordance with the instruction from an adjusting unit. A projecting unit projects, onto a display area, light corresponding to an image created by the image processing unit. A display size determination unit computes the display size of the picture plane displayed on a screen based on an image captured by the camera provided adjacent to the projection-type video-image display device. The display size determination unit then determines whether or not the display size of the picture plane is equal to or larger than a predetermined upper-limit size.

Abstract: A distance to an object is measured for each of a series of left images, and the count of a distance range including the calculated distance increases. A distance range with the highest frequency of appearance is specified from the counter information of a distance table counter, and a left image in which the distance included in the specified distance range is measured is selected. The adjustment amount of the parallax amount adjusted for the selected left image and a corresponding right image is determined to be the adjustment amount of the parallax amount of a panorama image. A series of left images is combined to generate a panorama image and a series of right images is combined to generate a panorama image. A panorama image displayed in stereoscopic view is generated based on the determined adjustment amount of the parallax amount.

Abstract: A method and a device enable the creation of three-dimensional images with more than two perspectives (e.g. pseudo-holographic images), especially to be reproduced with the aid of an autostereoscopic display or an autostereoscopic screen, from fed images having, in particular, only two perspectives, e.g., a left and a right image channel. Also, a related device creates and reproduces three-dimensional images having more than two perspectives, especially in the form of an autostereoscopic multi-user visualization system.

Abstract: A display device and its display method are provided. The display method includes: first, inputting image message, then generating laser beams for forming an image according to the input image message to display an image. The image message includes angular message of each image pixels.

Abstract: The present invention relates to a method and an apparatus for 3-D display based on random constructive interference. It produces a number of discrete secondary light sources by using an amplitude-phase-modulator-array, which helps to create 3-D images by means of constructive interference. Next it employs a random-secondary-light-source-generator-array to shift the position of each secondary light source to a random place, eliminating multiple images due to high order diffraction. It could be constructed with low resolution liquid crystal screens to realize large size real-time color 3-D display, which could widely be applied to 3-D computer or TV screens, 3-D human-machine interaction, machine vision, and so on.

Abstract: A method is provided for imaging a workpiece by capturing successive frames of an elongate stationary field of view transverse to a workpiece transit path of a robot, while the workpiece is transported by the robot. The robot transit path is illuminated with an elongate illumination pattern transverse to the transit path to obtain a workpiece image of successive frames. Motion-induced image distortion is prevented or reduced adjusting the camera frame rate in real time in proportion to changes in robot velocity profile of the workpiece along the transit path.

Abstract: A video data processing system comprises a control module coupled with a source module for receiving video data from the source module, the video data being associated with at least one source viewpoint; and a view adjustment module coupled with the control module for generating at least one adjusted viewpoint of the video data based on at least one of a set viewpoint number and a number of the at least one source viewpoint. The set viewpoint number is associated with at least one of a viewpoint number of at least one previously received video data and a viewpoint number of at least one previously coupled player module.

Abstract: Provided is a stereoscopic image system. The stereoscopic image system includes a display device radiating linearly polarized light, glasses including left and right oculars each including a first polarizer disposed between the display device and the eyes of a user, a second polarizer disposed between the first polarizer and the eyes of the user, and a polarization plane rotator disposed between the first polarizer and the second polarizer, and a quarter wave plate disposed between the display device and the first polarizer. Accordingly, even when the glasses are rotated around a normal line to surfaces of the left and right oculars, a change in the brightness of a stereoscopic image can be reduced.

Abstract: Provided is a technique that can reduce the fatigue of the eyes of an observer who observes a stereoscopic image. To attains this object, an image processing apparatus includes: a first acquisition section that obtains a base image; a second acquisition section that obtains pieces of base distance information an identification section that performs an identification process for, classifying an image space into a gaze area and a non-gaze area; a first generation section that performs a generation process for generating a derived image and pieces of derived distance information, the derived image and the pieces of derived distance information being obtained as a result of a blurring process being performed on an image in an area corresponding to the non-gaze area; and a second generation section that generates a pseudo image of the object based on the derived image and the pieces of derived distance information.

Abstract: Systems and methods are provided for viewing and displaying 3D imagery. In one implementation, a method of displaying 3D imagery comprises receiving layout data comprising data representing a first camera, the first camera being non-editable; generating a first pair of a left camera and a right camera from the layout data based on the first camera, wherein the left camera and the right camera are editable; retrieving, from an external memory, streaming geometry data corresponding to the layout data; and generating the 3D imagery using the first pair of the left camera and the right camera and the streaming geometry data.

Abstract: A method of generating a three dimensional image from a two dimensional image having a background and a first foreground object and a second foreground object. The method includes determining whether the first and second foreground objects occlude, and generating an occluded combination of the first and second object to form a third foreground object when occlusion occurs. The method further includes applying a transformation to the third foreground object, and generating a copy of the third foreground object with the transformation applied thereto. Then, the third foreground object is generated stereoscopically for display based on the transformed third foreground object displaced relative to the copy of the third foreground object.

Abstract: An active eyewear method and system for viewing stereoscopic images is provided. The eyewear comprises polarization altering elements, such as twisted nematics or super twisted nematics, configured to receive light energy and rotate the polarization of light energy passing therethrough, and linear polarizers having polarization axes oriented in substantially identical orientations orthogonal to the first axis of polarization. The linear polarizers receive light energy from the polarization altering elements. The method comprises transmitting light energy through a sheet polarizer having an first axis of polarization, receiving the light energy with two polarization altering elements, each polarization altering operating out of phase with the other and in synchrony with a video field rate associated with the transmitting, and passing the light energy through two linear polarizers having substantially identical axes of polarization orthogonal to the first axis of polarization.

Abstract: The invention relates to a method and an apparatus for generating a depth map from a digital monoscopic color image. The method includes the following general steps: a) obtaining a first color component of the MCI, said first color component corresponding to partial color information of the MCI; and, b) assigning depth values to pixels of the MCI based on values of the first color component of respective pixels for forming the depth map for the MCI. In one embodiment, the depth values are generated by adjusting and/or scaling of pixel values of the Cr chroma component of the monoscopic source color image in the Y?CbCr color system.

Abstract: A method is provided for imaging a workpiece by capturing successive frames of an elongate stationary field of view transverse to a workpiece transit path of a robot, while the workpiece is transported by the robot. The robot transit path is illuminated with an elongate illumination pattern transverse to the transit path to obtain a workpiece image of successive frames. Motion-induced image distortion is corrected by computing respective correct locations of respective ones of the frames along the transit path.

Abstract: Disclosed are a 3D image display apparatus and method. The 3D image display apparatus may adjust a number of viewpoints of a 3D image, distance between viewpoints, and other parameters through varying a display pattern of a viewing zone generating unit and a distance between an image display unit and the viewing zone generating unit. Accordingly, the 3D image display apparatus may effectively express the 3D image suitable for various viewing circumstances.

Abstract: A stereoscopic image display apparatus according to an embodiment includes: a display device including a display panel including pixels, and an optical plate controlling light rays emitted from pixels; a camera provided in the display device; a face tracking unit making a decision whether a viewer exists in front of the display device based on an image picked up by the camera, and if the viewer exists, sampling and detecting a distance from the display device to the viewer and a position of the viewer; a memory storing the position of the viewer sampled and detected by the face tracking unit; and an image display control unit estimating the position of the viewer based on the position of the viewer stored in the memory and driving and controlling the display panel on based on the estimated position, when the face tracking unit does not recognize that the viewer exists.

Abstract: The present invention discloses a stereoscopic image display system and a method of controlling the same. An eye tracking module locates current 3D spatial positions of the viewer's eyes, and generates the information of both left and right eyes' current 3D spatial positions. A control module controls a display device that can alter the direction of the light outputted, and outputs images on the display device in time multiplex mode. The light containing the left eye image is outputted to the position of left eye instead of right eye at one time point, and the light containing the right eye image is outputted to the position of right eye instead of left eye at another time point, so that a stereoscopic image is perceived according to the parallax theory. The present invention enlarges the visual range of stereoscopic image and achieves a better stereoscopic image visual experience for viewers.

Abstract: An apparatus is provided for converting two-dimensional video frames to stereoscopic video frames, comprising a comparing unit, a temporal transform operator and a spatial transform operator. The comparing unit receives a sequence of two-dimensional video frames and provides a comparison result indicative of temporal difference data for the sequence of two-dimensional video frames. The temporal transform operator is coupled to the comparing unit for modifying the sequence of two-dimensional video frames according to the comparison result. The spatial transform operator is coupled to the comparing unit and the temporal transform operator for generating a stereoscopic frame pair according to each frame of the modified video frames. The stereoscopic frame pair comprises a left-eye video frame and a right-eye video frame for providing visual differences perceived by human eyes.

Abstract: A method of operation of three dimensional (3D) stereoscopic television consistent with certain implementations involves turning on or installing a set of 3D glasses on a viewer to cause the set of 3D glasses to enter an active operational mode; and at the 3D glasses, emitting a signal to the television that causes the television to switch from a 2D display mode to a 3D display mode. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.

Abstract: A method and scanner system for scanning interior surfaces include providing a probe shaped scanner having an axis, the probe shaped scanner includes at least one light source configured to create and project structured light, and at least one camera configured to record 2D images; entering the probe shaped scanner into a cavity of an object, where the cavity is bounded by an interior surface of the object; creating and projecting structured light from the light source of the probe producing a pattern on the interior surface of the object; recording a series of 2D images of the reflection of the pattern from the interior surface using the camera; combining the series of 2D images to obtain 3D real world coordinates of the interior surface; and providing data and processing the data such that surface information for areas of the surface, where image scanning is not complete, is created.

Abstract: Objects within two-dimensional (2D) video data are modeled by three-dimensional (3D) models as a function of object type and motion through manually calibrating a 2D image to the three spatial dimensions of a 3D modeling cube. Calibrated 3D locations of an object in motion in the 2D image field of view of a video data input are computed and used to determine a heading direction of the object as a function of the camera calibration and determined movement between the computed 3D locations. The 2D object image is replaced in the video data input with an object-type 3D polygonal model having a projected bounding box that best matches a bounding box of an image blob, the model oriented in the determined heading direction. The bounding box of the replacing model is then scaled to fit the object image blob bounding box, and rendered with extracted image features.

Abstract: Provided is a method and apparatus for linear depth mapping. Linear depth mapping includes using algorithms to correct the distorted depth mapping of stereoscopic capture and display systems.

Abstract: An image processing module including a depth acquiring unit, a motion estimation unit and a motion compensation unit is provided. The depth acquiring unit receives a plurality of original images and is configured to detect depth information of each original image. The motion estimation unit receives the original images and is configured to detect motion information of each original image. When the image processing module is in a normal mode, the motion estimation unit adjusts the motion information of each original image according to the detected depth information of each original image. The motion compensation unit performs interpolation and outputs a plurality of display images according to the original images and the adjusted motion information of each original image.

Abstract: A system and method for acquiring geometric information from images includes a modulated light source configured to provide light energy at a rate unperceivable by the human eye. A camera is configured to acquire images at a rate at which a differential pair of images is obtained such that one of the pair of images includes light from the light source and the other image of the pair does not include light from the light source. A comparison module is configured to compare the differential pair of images to create a depth map for three-dimension model creation.

Abstract: A stereoscopic device including a sensor assembly for detecting a sequence of stereoscopic images of an object, a movement detector for detecting the movements of the sensor assembly relative to the object, and a processing unit connected to the sensor assembly and to the movement detector, wherein the processing unit selects portions of the stereoscopic images, according to a signal received from the movement detector, thereby producing a visually stable sequence of display images.

Abstract: The present invention provides a method of generating a virtual viewpoint video image when the virtual viewpoint position is not located on a plane where a camera is disposed. In an environment in which a plurality of cameras having a horizontal optical axis are disposed in a real zone (for example, on the circumference) which surrounds an object, a video image of an arbitrary viewpoint on the circumference is generated. Further, by synthesizing video images photographed by a camera, a free viewpoint video image is generated from a virtual viewpoint (viewpoint from a high or low position) where no camera is placed. According to a method of achieving this, a travel distance of a display position is calculated by the local region synthesizing portion and this travel distance is reflected to the free viewpoint video image of a local region.

Abstract: A stereoscopic display device has a plurality of sub-pixel units respectively arranged along a first axis and a second axis. Each sub-pixel unit and the adjacent sub-pixel unit along the first axis have a predetermined dislocation in the second axis. Each of the sub-pixel unit includes a first sub-pixel row having a first sub-pixel and two second sub-pixels arranged along the first axis, a second sub-pixel row under the first sub-pixel row having a first sub-pixel and two second sub-pixels arranged along the first axis, and a three sub-pixel row under the second sub-pixel row having three third sub-pixels arranged along the first axis. The stereoscopic display device also has a parallax panel having a plurality of transparent regions and shielding regions alternately parallel to each other.

Abstract: Techniques and technologies are described herein for motion parallax three-dimensional (3D) imaging. Such techniques and technologies do not require special glasses, virtual reality helmets, or other user-attachable devices. More particularly, some of the described motion parallax 3D imaging techniques and technologies generate sequential images, including motion parallax depictions of various scenes derived from clues in views obtained of or created for the displayed scene.

Abstract: A video data processing system comprises a control module coupled with a source module for receiving video data from the source module, the video data being associated with at least one source viewpoint; and a view adjustment module coupled with the control module for generating at least one adjusted viewpoint of the video data based on at least one of a set viewpoint number and a number of the at least one source viewpoint. The set viewpoint number is associated with at least one of a viewpoint number of at least one previously received video data and a viewpoint number of at least one previously coupled player module.

Abstract: The video processing device enhances the perceived depth of video image obtained by an image obtaining unit, and is provided with: a depth information obtaining unit that obtains depth information indicating the distance in the depth direction of each of a plurality of image portions included in the video image; an image dividing unit that divides the video image, based on the depth information and the video image, into a plurality of image portions having different distances in the depth direction; and an image combining unit that combines the image portions divided at the image dividing unit and a depth-enhancing image used for enhancing the depth of the video image such that the depth-enhancing image is superposed onto one image portion and further that the other image portion having a shorter distance in the depth direction than the one image portion is superposed onto the depth-enhancing image.

Abstract: According to one embodiment, an information output control apparatus includes a detector and a controller. The detector is configured to detect a connection of a 3D image incompatible first image display apparatus. The controller is configured to execute control to output 3D image incompatibility information indicating that the first image display apparatus is incompatible with a 3D image in response to the detection of the connection of the first image display apparatus.

Abstract: An apparatus for creating two identical images with matching geometry and luminosity from a single two-dimensional image or series of moving images whereby they may be projected simultaneously or sequentially along two axis at substantially equal focal distance from the projection screen by a single film or digital projector as a pseudo-stereoscopic pair of images.

Abstract: Systems and methods for correcting perspective in an image are invented and disclosed. One embodiment comprises capturing image data responsive to light incident upon an image-capture device, wherein the image data includes a first perspective of a subject-of-interest, providing an image-processing algorithm executable by the image-capture device, the image-processing algorithm configured to generate modified data responsive to the image data and a perspective-correction factor, and executing the image-processing algorithm over the image data in accordance with the perspective-correction factor to generate modified data that includes a second perspective of the subject-of-interest.

Abstract: In a video processing apparatus, image information relating to a graphic image corresponding to a first video is converted using difference information calculated from first view-point information relating to a first video and second view-point information relating to a second video. A graphic image corresponding to the second video is generated based on the converted image information, and the generated graphic image and an image of the second video are synthesized.

Abstract: The present invention relates to a device and a method for allowing a user to reproduce new 3-D scene from one or two or more given 2-D video frames that already exist. The present invention provides a device and a method for automating post-image processing requiring a lot of manual work, thereby making it possible to produce and edit new 3-D representation from the existing 2-D video.

Abstract: In accordance with one aspect, the present invention provides a real-time 3D visualization system. The system includes means for conveying electromagnetic energy emanating from one or more 3D surfaces including a scene and means for sensing spatial phase characteristics of the electromagnetic energy as the configuration of the 3D surfaces relative to the system changes. The system includes means for creating a 3D scene model utilizing the spatial phase characteristics sensed in a plurality of configurations and means for displaying the 3D scene model in real-time. The means for displaying includes means for synthesizing depth cues.

Abstract: A method for processing a media signal, comprising: receiving, by an audio processing apparatus, an audio signal including a first channel signal and a second channel signal; estimating center sound by applying a band-pass filter to the first channel signal and the second channel signal; obtaining a first ambient sound by subtracting the center sound from the first channel signal; obtaining a second ambient sound by subtracting the center sound from the second channel signal; applying at least one of delay and reverberation filter to at least one of the first ambient sound and the second ambient sound to generate a processed ambient sound; and, generating pseudo surround signal using the center sound and the processed ambient sound is provided.

Abstract: 3D-enhanced 2D motion picture sequences comprise a single channel of sequential images. Each image in the channel comprises primary image content representing a scene consisting of a plurality of elements. At least some images in the channel further include temporal shadow image content, comprising a degraded and/or partially transparent image of at least one element of said primary image content corresponding to a view of said at least one element as seen in the primary image content of at least one other image from said channel. The temporal shadow content of the images varies within a series of successive images in a cyclical manner. The enhanced motion picture sequences provide a sense of 3D depth when viewed on conventional 2D displays without artificial viewing aids. Similar techniques can also be applied to enhance the 3D perception of stereoscopic motion picture sequences.

Abstract: An image signal processing apparatus that supplies entire circumferential viewpoint images including plural viewpoint images respectively corresponding to plural viewpoints provided on a circumference around a subject to an image display apparatus that displays a stereoscopic image of the subject seen from an entire circumference, includes: arranging means for arranging the input entire circumferential viewpoint images in a time-series sequence by regarding corresponding differences in viewpoints as differences in an imaging sequence; and encoding means for treating the respective viewpoint images arranged in the time-series sequence by regarding the differences in viewpoints as differences in the imaging sequence as single frames and encoding the viewpoint images using an encoding method including at least inter-frame prediction to generate video encoded signals.

Abstract: The invention provides a method, apparatus and computer program product for providing an interactive visual representation (16) on a display (10). The invention comprises showing a two-dimensional visual representation (16) on the display (10), wherein the visual representation (16) comprises a plurality of continuously moving visual elements (18.x) that provide the appearance of a three-dimensional shape, using at least two images (24.x) of a sequence of images (24.x) taken by at least one electronic camera (12) to determine at least one movement value, wherein the movement value is indicative of a movement of a person as depicted by the at least one electronic camera (12), and influencing the visual representation (16) based on the at least one movement value. The invention provides an interactive visual representation (16) that works well even if a rather simple movement tracking technique is used.

Abstract: Methods and Systems are provided for converting a two-dimensional image sequence into a three-dimensional image. In one embodiment, a method for converting a two-dimensional image sequence into a three-dimensional image includes determining camera motion parameters between consecutive images in a monoscopic sequence of reference 2D images, wherein the consecutive images comprise a current reference image and an adjacent image, determining a horizontal disparity map for a target image using the camera motion parameters, determining a disparity probability value for each disparity vector of the disparity map, and determining a target image as a weighted average of pixel values in the current reference image using the disparity probability values, such that the target image and current reference image comprise a stereoscopic image pair.

Abstract: A calibration apparatus which estimates a calibration parameter of an image acquisition apparatus, comprises a calibration jig which includes at least two planes and in which calibration markers having known three-dimensional positions are arranged in each plane based on a predetermined rule. The calibration apparatus further comprises a calibration marker recognition section configured to measure and number in-image positions of the calibration markers in at least one image obtained by photographing the calibration jig by the image acquisition apparatus, and a parameter estimate section configured to estimate the calibration parameters of the image acquisition apparatus by the use of the three-dimensional position and the in-image position of the calibration markers numbered by the calibration marker recognition section.

Abstract: Methods and devices are disclosed, wherein from a stereo image having at least 2 perspectives additional (in general 8 or more) virtual perspectives can be produced, on condition that the time for the entire production process is less than the specified frame rate, and that simultaneously the multi-view image quality is maximized. It is not required that a disparity map exists. In general, the image regions that have not change between two stereo images of the image sequence are identified. In these regions, the associated disparity map also cannot have changed. In addition, the processing parameters are continuously adjusted through continuous time measurement during processing such that the quality is always at the maximum thereof. In this way, an adaptive method is obtained, which can also respond to load fluctuations of the underlying hardware device.

Abstract: System and method for tridimensional cartography of a structural surface. Two wires are extended in front and along the structural surface so as to define a reference surface. A measuring unit comprising a laser arrangement and a camera is moved in front of the structural surface so as to progressively scan the surface. Tow distinct light planes directed toward the structural surface are projected by means of the laser arrangement. Images of the structural surface containing lines resulting from an intersection of the light planes with the structural surface and four reference points resulting from an intersection of the light planes with the wires are captured by means of the camera. The images are processed to determine the 3D coordinates of the lines defining the mapping in a reference system bound to the reference surface considering the position and the orientation of the measuring unit based on the reference points.