Abstract: A disparity vector for a pixel in a right image corresponding to a pixel in a left image in a pair of stereo images is determined. The disparity vector is based on a horizontal disparity and a vertical disparity and the pair of stereo images is unrectified. First, a set of candidate horizontal disparities is determined. For each candidate horizontal disparity, a cost associated with a particular horizontal disparity and corresponding vertical disparities is determined. The vertical disparity associated with a first optimal cost is assigned to each candidate horizontal disparity, so that the candidate horizontal disparity and the vertical disparity yield a candidate disparity vector. Lastly, the candidate disparity vector with a second optimal cost is selected as the disparity vector of the pixel in the right image.

Abstract: A mobile terminal including a first camera configured to receive an input of a first image; a second camera configured to receive an input of a second image; a touchscreen configured to display a photograph command key including a first zone, a second zone and a common zone; and a controller configured to set a photograph mode selected from a 3D photograph mode and a 2D photograph mode, to control the first and second cameras to respectively capture the first and second images upon receiving a photograph command touch action on the common zone, and to perform either a 3D image processing or a 2D image processing on the photographed first and second images according to the set photograph mode.

Abstract: An image such as a depth image of a scene may be received, observed, or captured by a device. A grid of voxels may then be generated based on the depth image such that the depth image may be downsampled. A background included in the grid of voxels may then be discarded to isolate one or more voxels associated with a foreground object such as a human target and the isolated voxels associated with the foreground object may be processed.

Abstract: The subject disclosure is directed towards stereo matching based upon active illumination, including using a patch in a non-actively illuminated image to obtain weights that are used in patch similarity determinations in actively illuminated stereo images. To correlate pixels in actively illuminated stereo images, adaptive support weights computations may be used to determine similarity of patches corresponding to the pixels. In order to obtain meaningful adaptive support weights for the adaptive support weights computations, weights are obtained by processing a non-actively illuminated (“clean”) image.

Abstract: A 2-dimensional (2D)/3-dimensional (3D) image display device generates 2D or 3D image data according to an input image signal and displays them on a display unit. The display unit includes a display panel for displaying an image in response to the 2D or 3D image data and an optical element layer operative during first and second driving modes in accordance with the 3D and 2D image data. A controller converts the optical element layer to be in the first driving mode in a first period before a 3D image signal is displayed when the input image signal changes from a 2D image signal to the 3D image signal, and converts the optical element layer to be in the second driving mode in a second period after the 2D image signal is displayed when the input image signal changes from the 3D image signal to the 2D image signal.

Abstract: In a video decoding system, a method and system for decoding previously encoded frames of video into a compressed and uncompressed format. The uncompressed format frames may be further stored and utilized to decode additional frames of video. The compressed format frames may be further stored and provided to a display processor to be rendered with additional textures.

Abstract: A system for showing scenes that benefit from three-dimensional or quasi-three-dimensional display. In some embodiments, a generally-spherical section of a refracting material is provided in a light diverging layer of finite thickness that can be placed over a substrate display device (such as a LCD or similar flat monitor or display screen) and the refracting element and light diverging layer then spread at least a portion of the scene outwardly from the system in a three-dimensional or quasi-three-dimensional manner. The result is a more accurate, entertaining, interesting, and realistic depiction of scenes having three-dimensional features (e.g., globes, spheres, planets, other objects) shown by the display. The images may be static or animated.

Abstract: An apparatus for correcting a stereoscopic image using matching information, includes: a matching information visualizer receiving input of original stereoscopic images and intuitive matching information and visualizing a pair of stereoscopic images based on the intuitive matching information; a correction information processor obtaining a statistical camera parameter based on the intuitive matching information and correcting the received stereoscopic image using the statistical camera parameter; and an error allowable controller providing allowable error information to the correction information processor in consideration of an error allowable degree according to a selected time from the received intuitive matching information and preset human factor guide information, to extract a correlation between stereoscopic images using a stereoscopic image and provided information, thereby helping such that an erroneously photographed image is correctly photographed or correcting the image such that the erroneously p

Abstract: [Object] To embed disparity information in a subtitle stream so that the disparity information can concurrently exist with subtitle information. [Solution] In order to embed disparity information in a subtitle stream, “disparity data set segment” is newly defined as a DVB subtitle segment. With the use of this new segment, it is possible to embed disparity information in the subtitle stream so that the disparity information can concurrently exist with subtitle information. On the receiving side, the disparity information can be favorably acquired from the subtitle stream on the basis of “segment_type” that is identification information. Also, 1-bit flag information indicated by “disparity_data_association_flag” is newly defined in segment “page composition segment” including the subtitle information. This flag information indicates whether or not there is the presence of disparity information associated with this page.

Abstract: A main-view stream and a sub-view stream are recorded on a recording medium. The main-view stream is used for monoscopic video playback. The sub-view stream is used for stereoscopic video playback in combination with the main-view stream are recorded. The main-view stream includes a plurality of main-view pictures, and the sub-view stream includes a plurality of sub-view pictures. The main-view pictures and the sub-view pictures are in one-to-one correspondence. A B picture is not used as a reference picture for compression of any of the sub-view pictures whose corresponding main-view picture is one of an I picture and a P picture.

Abstract: A CC encoder outputs CC data for displaying a caption with a closed caption. A disparity information creation unit outputs disparity information related with each Window ID included in the CC data. The disparity information has added thereto instruction information instructing which of the left eye and the right eye is to be subjected to shifting on the basis of the disparity information. Also, the disparity information is either configured to be commonly used in individual frames during a display period of closed caption information or configured to be sequentially updated during the individual periods, and has added thereto identification information thereabout.

Abstract: A method for processing a 3D video signal and a digital broadcast receiver for performing the processing method are disclosed. A method for receiving a 3D broadcast signal includes receiving signaling information of at least one stream for a 3 Dimension TeleVision (3DTV) service and a two dimensional (2D) video stream, demultiplexing at least one stream for the 3DTV service and the 2D video stream based on the signaling information, decoding at least one demultiplexed stream for the 3DTV service and the demultiplexed 2D video stream, and outputting a 3D video signal by formatting at least one decoded stream for the 3DTV service and the decoded 2D video stream.

Abstract: The present invention relates to an apparatus for and a method of propagating depth-related information from a first depth-map (810) associated with a first image (820) to a second depth-map (860) associated with a second image (830), the first and second image being temporally proximate images in an image sequence. The method comprises generating an intermediate depth-map (840) associated with the second image (830) by propagating depth values from the first depth-map (810) to the intermediate depth-map (840) using pixels of the first image (820) and the second image (830), and generating a motion vector (850) using information comprising depth values in a spatial region around a first location in the first depth-map (810) and depth values in a spatial region around a second location in the intermediate depth-map (840) and generating a depth value for the second location in the second depth-map (860) using information comprising the motion vector (850) and the first depth-map (810).

Abstract: There is provided a demultiplexer that receives video data for one of a three-dimensional display and a two-dimensional display. There is also provided an HDMI transmission portion that transmits the video data and display information that pertains to one of the three-dimensional display and the two-dimensional display of the video data to a television receiver through TMDS channels #0, #1, and #2 of an HDMI cable. There is also provided a transmission/receiving portion that transmits the display information to the television receiver through a CEC line of the HDMI cable.

Abstract: Video data signals are encoded such that the encoded video data signal includes at least a primary and at least a secondary video data signal. The primary and secondary video data signals are jointly compressed. The primary video data signal is compressed in a self-contained manner, and the secondary video data signal is compressed using data from the primary video data signal. The jointly compressed video data signal is split into separate bitstreams, at least a primary bitstream including data for the primary video data signal and at least a secondary bitstream including data for the secondary video data signal. The primary and secondary bitstreams are multiplexed into a multiplexed signal, and the primary and secondary signals are provided with separate codes.

Abstract: A time-of-flight 3D camera and related method for illuminating a camera field of view and capturing return image light are disclosed herein. In one example, the time-of-flight 3D camera includes a light source that emits source light along an optical axis, and a collimator that receives and collimates the source light to create collimated light. A refractive diffuser is tuned to the camera field of view and receives and diffuses the collimated light to create refracted light having a varying intensity profile. The refractive diffuser guides the refracted light to illuminate the camera field of view to reduce wasted source light.

Abstract: An electronic device coupleable to a display screen includes a camera system that acquires optical data of a user comfortably gesturing in a user-customizable interaction zone having a z0 plane, while controlling operation of the device. Subtle gestures include hand movements commenced in a dynamically resizable and relocatable interaction zone. Preferably (x,y,z) locations in the interaction zone are mapped to two-dimensional display screen locations. Detected user hand movements can signal the device that an interaction is occurring in gesture mode. Device response includes presenting GUI on the display screen, creating user feedback including haptic feedback. User three-dimensional interaction can manipulate displayed virtual objects, including releasing such objects. User hand gesture trajectory clues enable the device to anticipate probable user intent and to appropriately update display screen renderings.

Abstract: The invention relates to a method for processing a stereoscopic image comprising a first image L and a second image R, an object being embedded on the first and second images modifying the initial video content of pixels associated with the embedded object on the first and second images. In order to ensure coherence between the disparity associated with the embedded object and the video information associated with the pixels of first and second images, the method comprises steps for: detecting the position of the embedded object in the first and second images, estimating the disparity between the first image and the second image on at least part of the first and second images comprising said embedded object, determining the smallest depth value in said at least one part of images comprising the embedded object according to estimated disparity information, assigning a depth to the embedded object for which the value is less than said smallest depth value.

Abstract: A display device includes: a display section displaying a stereoscopic video image; and a display control section performing a control to allow the display section to display a plurality of menu screens including a first menu screen and a second menu screen with different stereoscopic effects. The first menu screen is provided for each of one or more video devices connected to the display device, and the second menu screen is provided for the display device.

Abstract: A 3D display system uses a lenticular screen or a parallax barrier, along with a shutter plate, as a light directing device to allow a viewer's right eye to see a right image and the left eye to see a left image on a display panel. The right and left images are alternately displayed. The shutter plate has a plurality of right shutter segments and a plurality of left shutter segments arranged in an interleaving manner. When the right image is displayed, the right shutter segments are open and the left shutter segments are closed. When the left image is displayed, the right shutter segments are closed and the left shutter segments are open. But when the 3D display panel is used as a 2D display panel, both the right and left shutter segments are all open so that both the viewer's eyes see the image simultaneously.

Abstract: Provided are methods and apparatuses for displaying a stereoscopic image. The method includes alternately generating repeated left-eye images and repeated right-eye images; turning off a backlight unit during a period in which a left-eye image and a right-eye image are mixed and turning on the backlight unit during a period in which only one of the left-eye and right-eye images is displayed; and controlling a left-eye shutter and a right-eye shutter of shutter glasses during a period in which the backlight unit is turned on.

Abstract: A device and method for producing a model of the surface of one aspect of a three dimensional object. The model is produced by extracting a three dimensional mesh from a pattern projected on the object. The three dimensional object maybe in motion.

Abstract: The present invention relates to a method and a system for rectifying images. An original stereo image pair is obtained, and the epipolar lines corresponding to the original stereo image pair are parallelized to obtain a first transformed stereo image pair. Epipolar lines corresponding to the first transformed stereo image pair are collinearized to obtain a second transformed stereo image pair. The present invention parallelizes and collinearizes the epipolar lines corresponding to the stereo image pair after the images are rectified.

Abstract: A method is used for compensating a boundary of an image, in which each scan line in the image is shifted by a corresponding line shift amount. The method determines a boundary region for the image and moves each pixel in a scan line from an original position to a new position within the boundary region, in which the new position is determined according to the width of the boundary region, the original position, and a line shift amount, and the scan line is shifted by the line shift amount. Then, the method interpolates at least one pixel into the scan line according to the moved pixels for generating a compensated image.

Abstract: Active Space separates the Left Frame from the Right Frame in a frame packing format. A source device is expected to transmit a constant pixel value. A sink device is expected to ignore all data received during the Active space regardless of the value. Embodiments of the present invention involve the Source device to embed intelligent information in the Active Space in lieu of the recommended fixed pixel value. Then the Sink device may read the embedded information from the Active Space, and infer the transition between the left frame and the right frame which is useful, for example, to synchronize eyewear.

Abstract: A mobile terminal and controlling method thereof are disclosed, by which a 3D or stereoscopic image can be generated to considerably relive an observer from visual fatigue. The present invention includes a first camera and a second camera configured to take a 3D image, a display unit displaying an image taken by at least one of the first and second cameras, and a controller controlling the first camera, the second camera and the display unit, wherein the controller sets a plurality of divisional sections on a left eye image taken by the first camera and a right eye image taken by the second camera and then generates the 3D image based on a depth value of each of a plurality of the divisional sections.

Abstract: A light ray output from a subject is separated into left and right light rays by mirrors in an area in which a diverging light ray output from a point of the subject is converted into a parallel light ray. When a subject is looked at from the right side or the left side, the light rays are reflected by various mirrors. The light rays reflected by the mirrors are made incident on image forming lenses. These light rays form an image on a light receiving surface of an imaging device. In this way, a high-quality 3D image having an appropriate parallax level and a small chromatic aberration is captured.

Abstract: An apparatus includes a storage unit to receive and store an image file, a processor to parse a media data field of the image file including one or more image data samples and to parse a media header field including an image type data field indicating whether each of the one or more image data samples is one of 2 dimensional (2D) image data and 3 dimensional (3D) stereoscopic image data to generate an image corresponding to one of a 2D image and a 3D stereoscopic image based on the image type data field of the image file, and a display unit to display the generated image according to the image type data field of the image file.

Abstract: A camera or camcorder with a multi-view three dimensional (3D) attachment enables acquisition of 3D images and video which are then able to be displayed to a user without the need for specialized glasses. The multi-view 3D attachment captures at least 3 views of the same image from different angles simultaneously on a sensor.

Abstract: One or more techniques and/or systems are provided for generating a synth packet and/or for providing an interactive view experience of a scene utilizing the synth packet. In particular, the synth packet comprises a set of input images depicting a scene from various viewpoints, a local graph comprising navigational relationships between input images, a coarse geometry comprising a multi-dimensional representation of a surface of the scene, and/or a camera pose manifold specifying view perspectives of the scene. An interactive view experience of the scene may be provided using the synth packet, such that a user may seamlessly navigate the scene in multi-dimensional space based upon navigational relationship information specified within the local graph.

Abstract: A stereoscopic image display and a method for driving the same are disclosed. The stereoscopic image display includes a display panel that displays a 2D image data in a 2D mode and displays a 3D image data in a 3D mode, a backlight unit providing light to the display panel, a timing controller that supplies a left eye image data during a data addressing period of a (2N?1)th frame period and supplies a right eye image data during a data addressing period of a 2Nth frame period in the 3D mode, where N is a natural number, and a backlight controller generating a backlight control signal for controlling light sources of the backlight unit so that the light sources of the backlight unit are turned on during a vertical blanking interval of each of the (2N?1)th frame period and the 2Nth frame period in the 3D mode.

Abstract: In a mobile phone, a display section capable of 3D display, which includes a high-definition liquid crystal, has a liquid crystal layer for generating a parallax barrier on the front surface thereof. A central controlling section judges suitability in 3D display of content based on the contents of the content before displaying the content in the display section, and displays the content in 3D when the content is judged to be suitable for 3D display.

Abstract: A 3D image processing apparatus includes: L and R graphic decoders which decode coded stream data to generate left-eye and right-eye image data; an image output control unit which outputs the generated image data; and a control unit which, when a decoding error occurs in generating one of the image data, and a successful decode occurs in generating the other of the image data, (i) shifts, by a preset offset, a pixel position of the other of the image data, to generate pseudo image data as the one of the image data, and (ii) outputs the pseudo image data to an image output control unit, wherein the image output control unit outputs the other of the image data and the pseudo image data, when the decoding error occurs in generating the one of the image data and the successful decode occurs in generating the other of the image data.

Abstract: A 3D-image providing device comprises: an index selection unit for selecting at least one index frame set from 3D-image data including plural frame sets; and a thumbnail generation unit for obtaining left and right images for the selected index frame set and generating a thumbnail frame set based on the obtained left and right images, wherein the frames included in the thumbnail frame set satisfy conditions that the sizes and resolution thereof are respectively small and low compared to the frames included in the index frame set. Accordingly, the 3D-image providing device generates 3D-thumbnails from the left and right images of the 3D-image data to provide 3D images considered when moving to a user-desirable reproduction time point. Also, the 3D-image supply device merges the 3D-thumbnails with 3D-broadcasting images or 3D-contents and displays the merged image. Consequently, the image providing device minimizes viewer confusion when perceiving 3D-images and increases user satisfaction.

Abstract: An image reproducing apparatus for reproducing a stereoscopic image shot by a stereoscopic image capturing apparatus, the image reproducing apparatus comprises: an input unit which inputs image data of the stereoscopic image and additional data recorded in association with the image data; an acquisition unit which acquires depth information indicating a depth of a point of interest in the stereoscopic image set, during shooting, on the basis of the additional data; a generation unit which generates images to be superimposed on right and left images of the stereoscopic image, the images to be superimposed having parallax corresponding to the depth indicated by the depth information, on the basis of the depth information; and a display output unit which combines the right and left images of the stereoscopic image with the images to be superimposed, and outputs the combined right and left images of the stereoscopic image to a display apparatus.

Abstract: A method of filtering a disparity mesh from pixel images according to the invention, where the disparity mesh comprises a plurality of points, where each point is associated with values of two planar coordinates (X, Y) and a disparity value (D) and where the values are quantization pitches, comprises the step: filtering planes by filtering 2D-lines in 2D-spaces (X-D, Y-D) of the planar coordinates (X,Y) and the disparity (D).

Abstract: A course CR is set in a virtual space SP along which a player character CH can move. The player character moves freely on the course, as long as it does not run off the course. In the course, a reference moving path is set indicating a standard moving path of the player character. A camera path of a virtual camera is set along the reference moving path. In the reference moving path, a object corresponding position (CP) is determined corresponding a position (CH(X,Y,Z)) of the player character in the virtual space. A position corresponding to the object corresponding position and a photographing condition are determined for the virtual camera.

Abstract: A 3D image display apparatus is disclosed which includes a ray modulator which emits a directive ray in a time series manner based on parallax image information, a scanner which deflects the ray from the ray modulator and scans a predetermined plane two-dimensionally with the deflected ray, a light emitting point distributor which is arranged on a light emission side of the scanner to form a plurality of light emitting points, and a light emitting point multiplexer which is arranged on the light emission side of the light emitting point distributor to form a plurality of secondary light emitting points with rays from individual ones of the light emitting points, to enable stereopsis with a super multi-view region at a high resolution.

Abstract: A three-dimensional (3D) display device combining two-dimensional (2D) images from two image sources to create a 3D image. The 3D display device utilizes a beam combining film that includes a prismatic front surface and a planar back surface. The film transmits light striking its back surface at particular incidence angles. A first 2D image source provides a foreground image and a second 2D image source to provide a background image. First and second liquid crystal displays may be arranged with display surfaces proximate to top and bottom edges of the beam combining film and at angular offsets to emit light corresponding with a 2D image stream onto the back surface of the beam combining film at one of the film's incidence angles. The 2D image streams striking the back surface of the film are combined by the film and transmitted from the front surface as a single autostereoscopic video image.

Abstract: Disclosed herein are an apparatus and method for acquiring 3D depth information. The apparatus includes a pattern projection unit, an image acquisition unit, and an operation unit. The pattern projection unit projects light, radiated by an infrared light source, into a space in a form of a pattern. The image acquisition unit acquires an image corresponding to the pattern using at least one camera. The operation unit extracts a pattern from the image, analyzes results of the extraction, and calculates information about a 3D distance between objects existing in the space.

Abstract: Described herein is a method for correcting defective depth values in depth map images. Defective values correspond to “noisy pixels” located on continuous flat surfaces and interpolated “flying pixels” located along an edge between a foreground object and a background object. The method comprising the steps of accessing a depth map of a scene which includes the foreground and background objects, detecting and identifying noisy and interpolated depth measurements within the depth map using a method, defining and applying a correction to each of the detected defective noisy and interpolated depth measurements using a specifically defined weighted correction factor. By providing the corrected defective depth values in depth map images, edges are sharpened in depth and continuous surfaces are flattened, enabling higher efficiency and robustness of further image processing.

Abstract: A gesture-based user interface method and corresponding apparatus that includes a light source configured to irradiate light to a user, an image sensor configured to receive light reflected from the user and output a depth image of the user, an image processor configured to recognize a user gesture based on the depth image output from the image sensor, and a controller configured to control the light source and the image sensor such that at least one of an optical wavelength of the light source, an optical power level of the light source, a frame rate of the light source and a resolution of the depth image is adjusted according to a gesture recognition mode.

Abstract: Disclosed herein is a parallax barrier including a first substrate, a second substrate and a liquid crystal layer disposed between the first and the second substrates. A plurality of first strip electrodes and a plurality of second strip electrodes are arranged on the first substrate, whereas a plurality of third electrodes and a plurality of fourth electrodes are arranged on the second substrate. Each of the third electrodes has a step-shaped first portion and each of the fourth electrodes has a step-shaped second portion.

Abstract: A stereoscopic image display apparatus and method which reduce crosstalk and select either high resolution images or bright images. The stereoscopic image display apparatus includes first and second image forming areas, each area including multiple contiguous horizontal rows. The areas are alternately disposed in a liquid crystal display, and display right and left eye images on the first and second image forming areas, respectively. The display displays the images in a fixed manner or replaces or overwrites the image areas every time a frame is switched, and displays a frame image in which the right and left eye images are simultaneously displayed. When the first and second image forming areas are alternately replaced, according to the frame switching timing, the backlight is controlled to turn on and phase difference states of right and left eye glasses of polarized eyeglasses are alternately replaced.

Abstract: A digital broadcast receiving apparatus for displaying a stereoscopic image comprises: a demultiplexing unit configured to demultiplex a received digital broadcast signal; a PSIP or PSI/SI processor configured to extract extension view video information from the demultiplexed digital broadcast signal; a decoder configured to decode an extension view video stream and a base view video stream from the demultiplexed digital broadcast signal; and an output formatting unit configured to format the extension view video stream and the base view video stream based on the extension view video information. The extension view video information may include at least any one of a relative position relationship between a camera which has generated the extension view video stream and a camera which has generated the base view video stream, the number of the extension view video streams, and information regarding an arrangement structure of the cameras.

Abstract: Techniques are described for deriving a disparity vector for a current block based on a disparity motion vector of a neighboring block in a 3D-AVC video coding process. The disparity vector derivation allows for texture-first coding where a depth view component of a dependent view is coded subsequent to the coding of the corresponding texture component of the dependent view.

Abstract: A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image includes a mirror for optically coupling to a fisheye lens having a first field of view, the mirror configured for reflecting an image of a second field of view through the fisheye lens. A housing has a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system. When the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image and a second portion of the panoramic image, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image.

Abstract: An approach is provided for enabling viewers to control the depth of three-dimensional content rendered via a set-top box. A 3D content platform receives a user input for specifying a user identifier and a mode of operation of a set-top box. A depth setting parameter is determined based on user profile information related to the user identifier. Content is then presented for display via the set-top box at the dept setting corresponding to the parameter.

Abstract: A method of filling occluded areas of a depth or disparity map estimated from at least two images and consisting of a matrix of pixels forming a set of lines and columns, each pixel of the map being associated with a depth or disparity value (pixel value) and any pixel of an occluded area (invalid pixel) being associated with a pixel value identifiable as being invalid. This method comprises a step of processing each line of the map pixel by pixel in a predefined direction and assigning each invalid pixel Pi encountered on a current line a value determined as a function of the values associated with the pixels in a predefined vicinity around the first valid pixel P1, if any, that follows the invalid pixel Pi on the current line and the value V(P1) of which corresponds to a greater depth or a lesser disparity relative to the value V(P0) of the last valid pixel P0, if any, that precedes the invalid pixel Pi on the current line.

Abstract: A moving picture decoding method of an embodiment according to the present invention is a moving picture decoding method for decoding encoded data of an interlaced scanned picture including Top field and Bottom field, and the method includes a stereo information acquisition step for acquiring stereo information indicating whether Top field and Bottom field are two pictures forming a stereo picture from the encoded data, a decoding step for decoding two fields corresponding to each other from the encoded data and generating two decoded fields, and an output step for outputting the two decoded fields. In the output step, the stereo information is referred to and the two decoded fields are outputted simultaneously.