Abstract: The invention relates to a method, performed by at least one apparatus. The method comprises obtaining sample measurements at least in part comprising altitude information and observed in an area at least in part represented by an altitude map, the altitude map comprising sub-sections representing respective sub-areas of the area; The method further comprises determining altitude estimates from the altitude information. The method further comprises updating one or more altitude estimate distributions associated with respective sub-sections of the altitude map based on the determined altitude estimates. The method further comprises determining, for one or more sub-sections of the altitude map, whether a respective sub-section of the altitude map represents a single level sub-area or multilevel sub-area, based on respective altitude estimate distributions associated with respective sub-sections of the altitude map.

Abstract: An encoding method and an encoding device for 3D video are provided. The method includes the following. Pixel data of a first macro block in a first frame to be encoded is loaded, wherein the first frame belongs to a first view angle. Pixel data of a search window in a reference frame is loaded. A first motion estimation is executed according to the pixel data of the search window and the first macro block. Pixel data of a second macro block in a second frame to be encoded is loaded, wherein the second frame belongs to a second view angle different from the first view angle. A second motion estimation is executed according to the pixel data of the search window and the second macro block, thereby sharing the pixel data of the search window with the first motion estimation. Accordingly, the demand for a memory bandwidth is decreased.

Abstract: A method of depth map generation is disclosed. The method comprises the steps of: scaling down a video unit and a previous video unit to generate a reduced video unit and a reduced previous video unit; dividing the reduced video unit into N1 portions and a buffer into N2 storing units; performing a motion estimation for a target pixel of the reduced video unit to obtain a motion vector based on pixels in a preset search window established in the reduced previous video unit; assigning a depth value to the target pixel according to the motion vector; storing the target pixel in one of the N2 storing units sequentially; and, repeating the steps of performing, assigning and storing until all pixels of the reduced video unit are processed to obtain a motion depth map.

Abstract: Embodiments are directed towards enabling digital cameras to digitally process captured two dimensional image sequences at a real time video rate, to convert the two dimensional image sequences into stereoscopic three dimensional image sequences. In one embodiment, using a pipelining architecture, various statistics are obtained for a captured two dimensional sequence. The statistics are used to estimate depth within each frame image within the sequence, in real time. Using the depth data a disparity map is generated that is provided to a warping component to generate a second perspective of the two dimensional image. The two images for the frame provide a three dimensional perspective for the frame within the sequence. Together the two perspective images for the frame are provided to a video encoder component to encode the stereoscopic three dimensional frame for the sequence.

Abstract: A device for outputting a chrominance signal and a method thereof are disclosed. The device includes a motion detection unit, a frame edge detection unit, and an output unit. The motion detection unit judges a motion degree of a frame. The frame edge detection unit judges whether a non-3D luminance signal is extracted from an edge of the frame. The output unit outputs one of a 3D chrominance signal and a non-3D chrominance signal as a resultant chrominance signal according to the motion degree which is judged by the motion detection unit and the judgment result of the frame edge detection unit. The present invention is capable of appropriately selecting the 3D chrominance signal and the non-3D chrominance signal when the frame is in the motion condition.

Abstract: A device and apparatus for processing a depth-map including obtaining a depth-map based on a lossy compressed depth-map, the depth-map including depth information of a scene from a viewpoint, the scene includes an object; obtaining occlusion information for the scene from the viewpoint, the occlusion information including information occluded by the object in the depth-map; and processing at least part of the depth information using at least part of the occlusion information in order to reduce compression artifacts in the depth-map.

Abstract: According to one embodiment, an electronic apparatus includes a text image generator, a first image generator, a video composite module, and a display image generator. The text image generator generates a first text image which is different from a second text image if a display device is set in a 3D mode, the second text image being generated if the display device is set in a 2D mode. The first image generator generates a first image including the first text image for displaying 2D video. The video composite module generates a composite video frame by combining the first image and a video frame for displaying 3D video. The display image generator generates a display image by using the composite video frame.

Abstract: The invention relates to coding of depth information for multi-view video coding. Different parameters and/or any features from picture encoding or the encoded and reconstructed pictures may be used in the coding of the depth information, especially in filtering the depth picture using e.g. a loop filter in the depth coding loop. The same principle may be applied in decoding, that is, the decoded (texture) pictures and parameters may be used to control the decoding of the depth data, e.g. to control the filtering of the depth data in a loop filter. Parameters and data that may be used as such control may comprise features extracted from the reconstructed pictures, the encoded video data and parameters, the motion estimation data and others.

Abstract: Disclosed are a method for displaying 3D images and a broadcast receiver. The method for displaying 3D images according to one embodiment of the present invention comprises the steps of: receiving broadcasting signals including video data and 3D object data; decoding the 3D object data, the 3D object data including texts or image information for a 3D object, output position information of the 3D object, and disparity information of the 3D object; obtaining parallax values from the disparity information and producing distortion compensation coefficients using the parallax values; adjusting a display size of the 3D object using the distortion compensation coefficients; and outputting and displaying the 3D object.

Abstract: In an example aspects of this disclosure generally relate to a method of coding video data that includes determining a first bit depth for outputting video data and a second bit depth for coding the video data, wherein the first bit depth is less than the second bit depth. The method also includes determining whether the video data will be used as reference data when coding other video data. The method also includes storing, based on the determination, the video data at the first bit depth when the video data is not used as reference data, and the video data at the second bit depth when the video data is used as reference data.

Abstract: One object of the invention is a digital video signal comprising a sequence of frames, wherein each video frame in the sequence differs with respect to the previous frame in the sequence by a number of pixels which is not higher than a predetermined pixels maximum threshold amount.

Abstract: There is provided an image processing method which includes obtaining a first original image and a second original image, and determining, in accordance with magnitude relationship between parallactic information about an original image of one of the first original image and the second original image and parallactic information about an interpolation image of the first original image and the second original image, whether video information about the original image of the one of the first original image and the second original image is drawn onto the interpolation image.

Abstract: A method of receiving stereoscopic video according to the present invention includes receiving a bit stream including image information, extracting a base image stream corresponding to a base image and an additional image stream corresponding to an additional image from the bit stream, generating the base image and the additional image by decoding the base image stream and the additional image stream, respectively, and generating a left image and a right image by using at least one of the base image and the additional image. According to the present invention, 2D/3D broadcasting service efficiency may be improved.

Abstract: Movies to be colorized/depth enhanced (2D->3D) are broken into backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors/depths are automatically applied with masks throughout a scene from the composite background and to motion objects. Areas never exposed by motion or foreground objects may be partially or fully realistically drawn/rendered/applied to the occluded areas and applied throughout the images to generate artifact-free secondary viewpoints during 2D->3D conversion.

Abstract: A method identifies the presence of a three-dimensional (3D) image format in received image through the use of image difference determination. The received image is sampled using a candidate 3D format to generate two sub-images from the received image. When the candidate 3D format is a non-blended 3D format, these sub-images are compared to determine whether these sub-images are similar with respect to structure. If the sub-images are not similar, a new 3D format is selected and the method is repeated. If the sub-images are similar, an image difference is computed between the two sub-images to form an edge map. Thicknesses are computed for the edges in the edge map. The thickness and uniformity distribution of the edges are then used to determine whether the format is 2D or 3D and, if 3D, which of the 3D formats was used for the received image.

Abstract: The receiving apparatus according to the present invention includes a demultiplexer (104) that obtains video signal including data of image for right eye and data of image for left eye, a CPU (102) that obtains display control information included in the video signal, a digital tuner (126) that switches the video signal, and a 3D signal processing unit (130) that controls output of the video signal when switching the video signal based on the display control information.

Abstract: A 3-dimensional (3D) video rendering device may convert a first left view video of a decompressed 3D video having a first frame rate to generate a second left view video having a second frame rate, and convert a first right view video having the first frame rate to generate a second right view video having the second frame rate. The second left view video having a particular pixel resolution may be converted by the 3D video rendering device to generate a third left view video having full pixel resolution of the decompressed 3D video. The second right view video having the particular pixel resolution may be converted to generate a third right view video having the full pixel resolution. The 3D video rendering device may generate a sequence of video frames for 3D video display based on the third left view video and the third right view video.

Abstract: Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.

Abstract: Inter-frame blanking involves blanking the transition period between two video frames of a three-dimensional video signal. One implementation includes receiving a three-dimensional video signal and determining a frame overlap interval. The frame overlap interval is the time period in which a display device will concurrently display at least one portion of a first video frame and at least one portion of a second video frame during a transition period. The implementation also includes, based on the frame overlap interval, generating an inter-frame blanking signal that instructs a blanking device to filter the display of the three-dimensional video signal.

Abstract: A frame sequential 3D display system includes an image source, an image processor, and a display device. The image source is configured to provide a 2D video signal consisting of multiple frames for representing an image and generate an upsampled 2D video signal by increasing the frame rate of the source 2D video signal. The image processor includes an identical frame detector and a 2D/3D converter. After identify corresponding pairs of frames in the upsampled 2D video signal, the identical frame detector instructs the 2D/3D converter to convert the corresponding pairs of frames in the upsampled 2D video signal into corresponding right-eye images and corresponding left-eye images constituting a 3D video signal. The display device is configured to receive and display the 3D video signal.

Abstract: It is an object of the present invention to provide a content receiving apparatus capable of receiving, storing, and externally exporting content distributed from various networks. A receiving apparatus for receiving a digital signal in which a 3D video program and a 2D video program are mixedly present, includes a program selection unit configured to display and select a received program list; and a function determination unit configured to determine a function of viewing the 3D video program and 2D video program included in the receiving apparatus, wherein the program selection unit displays a viewable program list of the receiving apparatus according to a determination result of the function determination unit at the time of displaying the received program list.

Abstract: A display is able to display 3D content in high resolution 2D by utilizing the many views contained in the 3D data and converting the 3D data into 2D data. In some embodiments, the 3D data is converted using shifts in different views of a pixel. In some embodiments, the 3D is converted using shifts in different views of a local pixel and global pixels as well. Displays implementing the 2D high resolution display in addition to a low resolution 3D display are able to display 3D and 2D data depending on a user's preference.

Abstract: A broadcasting service monitoring apparatus includes: a stream separation unit to extract a partial stream from an inputted 3D stream and separate detailed stream configuration and service-related information and a stream for 3D video service from the 3D stream; a configuration information analysis unit to minutely analyze the separated service-related information and the separated stream for 3D video service; a 2D image decoding unit to decode the separated stream for 3D video service into a predetermined image; an image separation unit to separate one screen of the decoded predetermined image into two screens and generate two images; a 3D image reproduction unit to reproduce the generated two images; a depth information extraction unit to extract depth information for 3D video service from the generated two images; and a 3D information representation unit to represent the analyzed values and the extracted depth information.

Abstract: According to one embodiment, there is provided an electronic apparatus, including: a movie-noise reduction processor configured to successively perform a movie-noise reduction process on an input luminance signal to thereby generate an output luminance signal, the output luminance signal being generated based on the input luminance signal and another output luminance signal having been generated; a frame memory configured to store the output luminance signals; and a signal entry module configured to determine whether or not the input luminance signal is of a 3D video, to select one of the output luminance signals stored in the frame memory such that a frame associated with a selected one of the output luminance signals has no parallax with a frame associated with the input luminance signal, and to enter the selected one of the output luminance signals into the movie-noise reduction processor as the another output luminance signal.

Abstract: A broadcast transmitter, a broadcast receiver, and a 3D video data processing method are disclosed. A 3D video data processing method includes processing, by a video formatter, 3D video data, encoding, by an encoder, 3D video data, generating, by a system information processor, system information having 3D video composition information including information about the processing and encoding of 3D video data, multiplexing, by a multiplexer, the system information and the 3D video data, and transmitting, by a transmitter, a broadcast signal. In a 3D video data processing method, a receiver receives a broadcast signal including 3D video data and system information, a system information processor obtains 3D video composition information by parsing the system information, a decoder decodes the 3D video data according to the 3D video composition information, and an output formatter formats and outputs the decoded 3D video data according to the 3D video composition information.

Abstract: An image coding apparatus records stereoscopic video partially as 2D video so as to enable display to be performed while seamlessly switching between 3D video and 2D video, and includes: a control unit that sets one of a 2D coding mode and a 3D coding mode which are modes of coding the stereoscopic video so that, when displayed in 3D, the stereoscopic video is displayed as 2D video and 3D video respectively; and a coding unit that, in the case where the control unit switches from the 3D coding mode to the 2D coding mode, codes the to stereoscopic video according to a 3D coding standard in the 3D coding mode, and codes the stereoscopic video according to the 3D coding standard using a coding condition in the 2D coding mode, the coding condition being a condition for causing the stereoscopic video to be viewed as the 2D video when displayed.

Abstract: A 3D image processing apparatus includes: L and R graphic decoders which decode coded stream data to generate left-eye and right-eye image data; an image output control unit which outputs the generated image data; and a control unit which, when a decoding error occurs in generating one of the image data, and a successful decode occurs in generating the other of the image data, (i) shifts, by a preset offset, a pixel position of the other of the image data, to generate pseudo image data as the one of the image data, and (ii) outputs the pseudo image data to an image output control unit, wherein the image output control unit outputs the other of the image data and the pseudo image data, when the decoding error occurs in generating the one of the image data and the successful decode occurs in generating the other of the image data.

Abstract: A method of processing video images is provided. The method includes reproducing 3-dimensional (3D) video images by generating left-eye video images and right-eye video images from a video stream, receiving a first command for activating a pop-up interactive graphics stream during the reproduction of the 3D video images, and reproducing 2-dimensional (2D) video images by generating either left-eye video images or right-eye video images from the video stream, in response to the first command for activating the pop-up interactive graphics stream.

Abstract: An image processing apparatus that corrects gradation of a first image, which is one image from among the image for left eye and the image for right eye, and gradation of a second image, which is the other image from among the image for left eye and the image for right eye, the image processing apparatus comprises: a detection unit that detects parallax between the first image and second image; a correction unit that detects a pixel in the second image corresponding to a pixel in the first image on the basis of the parallax, and corrects a gradation value of the pixel in the first image and a gradation value of the pixel in the second image corresponding to the pixel in the first image by using a single gradation conversion curve.

Abstract: Various implementations are described. Several implementations relate to filtering of depth maps. According to a general aspect, a first depth picture is accessed that corresponds to a first video picture. For a given portion of the first depth picture, a co-located video portion of the first video picture is determined. A video motion vector is accessed that indicates motion of the co-located video portion of the first video picture with respect to a second video picture. A second depth picture is accessed that corresponds to the second video picture. A depth portion of the second depth picture is determined, from the given portion of the first depth picture, based on the video motion vector. The given portion of the first depth picture is updated based on the depth portion of the second depth picture.

Abstract: A stereoscopic production solution, e.g., for live events, that provides 3D video asset distribution to multiple devices and networks is described. In some embodiments, live or recorded 3D video content may be accessible by different service providers with different subscribers/users and protocols across a network of the content provider. A first video signal corresponding to a first video feed for one eye of a viewer may be received and a second video signal corresponding to a second video feed for the second eye of the viewer may be received. The first video signal and the second video signal may be encoded. The encoded first video signal and the encoded second video signal may be transmitted independently over a network. The two video signals may be received and frame synced at an off-site location for eventual rendering to a display device.

Abstract: Techniques for converting 3D images using alpha maps are described. A left-view image and a right-view image may be determined from media data received by a 3D display system. An alpha map specifying a plurality of operations for a plurality of locations that correspond to the first plurality of locations in the images may also be determined. The plurality of operations specified in the alpha map may be applied by the 3D display system to process the left-view and right-view images, and to generate, based on the left-view and right-view images, a third image in an appropriate 3D format.

Abstract: A digital broadcasting stream transmitting method and a digital broadcasting stream receiving method and apparatus for providing three-dimensional (3D) video services are provided. The transmitting method including: generating a plurality of elementary streams (ESs) for a plurality of pieces of video information including at least one of information about a base-view video of a 3D video, information about an additional-view video corresponding to the base-view video, and a two-dimensional (2D) video having a different view from views of the 3D video; multiplexing the plurality of ESs with link information for identifying at least one piece of video information linked with the plurality of pieces of video information, to generate at least one transport stream (TS); and transmitting the generated at least one TS via at least one channel.

Abstract: A code stream conversion system and method, a code stream identifying unit and a solution determining unit are provided. The code stream conversion method includes: receiving an original code stream format obtained by parsing an original code stream; and determining a transcoding solution according to a target code stream format and the original code stream format, and using the original code stream format to decode the original code stream and using the target code stream format to encode a decoded code stream according to the transcoding solution, thus completing code stream conversion, and obtaining a target code stream corresponding to the target code stream format. Through the code stream conversion system and method, the original code stream is parsed and the transcoding solution is determined, thus achieving mutual conversion between a three-dimensional video code stream and a planar video code stream.

Abstract: Provided are a method and apparatus for providing a 3D image and a method and apparatus for displaying a 3D image.

Abstract: A method and system are provided in which a video feeder may receive video data from multiple sources. The video data from one or more of those sources may comprise three-dimensional (3D) video data. The video data from each source may be stored in corresponding different areas in memory during a capture time for a single picture. Each of the different areas in memory may correspond to a different window of multiple windows in an output video picture. The video data from each source may be stored in memory in a 2D format or in a 3D format, based on a format of the output video picture. When a 3D format is to be used, left-eye and right-eye information may be stored in different portions of memory. The video data may be read from memory to a single buffer during a feed time for a single picture.

Abstract: A method of generating a stereoscopic image signal and scaling the same includes receiving a left-eye image signal and a right-eye image signal, generating a progressive stereoscopic image signal by multiplexing the left-eye image signal and the right-eye image signal, and scaling up or down the progressive stereoscopic image signal. Accordingly, it is possible to simplify a structure of an apparatus to generate the stereoscopic image signal and reduce manufacturing costs of the apparatus to generate the stereoscopic image signal.

Abstract: Encoding of video sequences for frame sequential stereoscopic video, such as from spatially distinct right and left imagers. During the encoding process, reference frames are reordered if it is determined that reordering will increase the number of macroblocks (MBs) which can be skipped from the encoded output, or to otherwise increase coding efficiency. Then encoding is completed using motion prediction and entropy encoding for frame sequential stereoscopic video in response to the ordering of the reference frames. Side-information is encoded about reference frame sequencing within the sequential stereoscopic video output allowing a decoder to properly decode the reference frames. As a result the number of skipped MBs can be dramatically increased and the number of MBs referenced during motion prediction significantly reduced.

Abstract: Methods and apparatus for stereoscopic image encoding and decoding are described. Left and right eye images are encoded following an entropy reduction operation being applied to one of the eye images when there is a difference between the left and right images of an image pair. Information about regions of negative parallax within the entropy reduced image of an image pair is encoded along with the images. Upon decoding a sharpening filter is applied to the image in an image pair which was subjected to the entropy reduction operation. In addition edge enhancement filtering is performed on the regions of the recovered entropy reduced image which are identified in the encoded image data as regions of negative parallax. Interleaving of left and right eye images at the input of the encoder combined with entropy reduction allows for efficient encoding, storage, and transmission of 3D images.

Abstract: In one embodiment of the invention, a robotic surgical system includes a master control console having a stereo viewer to view stereo images; a surgical manipulator having a stereo endoscopic camera coupled to a robotic arm to generate the stereo images of a surgical site; a stereo telestration device coupled between the stereo endoscopic camera and the stereo viewer to mix telestration graphics and the stereo images of the surgical site together for viewing by the stereo viewer; and a telestration generator coupled to the stereo telestration device to generate the telestration graphics for overlay on the stereo images of the surgical site.

Abstract: A three-dimensional video conversion recording device capable of recording three-dimensional video data on a recording medium after reducing data amount thereof, includes a separating unit for separating an inputted three-dimensional video stream into a plurality of video streams, a decoding unit for decoding at least one of the plurality of separated video streams, a frame thinning unit for reducing data amount of the decoded video stream, an encoding unit for encoding the video stream whose data amount is reduced, a multiplexing unit for multiplexing other video streams which are video streams other than the video stream inputted to the decoding unit out of the plurality of separated video streams and the encoded video stream, and a recording unit for recording the multiplexed video data on a recording medium.

Abstract: Various implementations are described. Several implementations relate to a virtual reference view. According to one aspect, coded information is accessed for a first-view image. A reference image is accessed that depicts the first-view image from a virtual-view location different from the first-view. The reference image is based on a synthesized image for a location that is between the first-view and the second-view. Coded information is accessed for a second-view image coded based on the reference image. The second-view image is decoded. According to another aspect, a first-view image is accessed. A virtual image is synthesized based on the first-view image, for a virtual-view location different from the first-view. A second-view image is encoded using a reference image based on the virtual image. The second-view is different from the virtual-view location. The encoding produces an encoded second-view image.

Abstract: A stereoscopic data processing method and apparatus to provide service of stereoscopic data interoperating with digital multimedia broadcasting (DMB) is provided. The stereoscopic data processing method, including: receiving a transmission stream (TS) including a program map table from an external device; recognizing stereoscopic program information descriptor in the program map table; and recognizing defined bit values in the stereoscopic program information descriptor and processing data.

Abstract: A method of constructing an encoded stereoscopic image data file is provided. The encoded stereoscopic image data file includes a file type declaration unit indicating whether the file is a stereoscopic image, a meta data unit including one or more track containers for containing meta data of the encoded stereoscopic image data, and an image data unit including one or more stereoscopic image data containers for containing image information of the encoded stereoscopic image data.

Abstract: A video plane generation unit decodes stream data into a pair of left-view and right-view video planes, and outputs the pair alternately in a 3D display mode and either of the pair repeatedly in a pseudo 2D display mode. An image plane generation unit generates a pair of left-view and right-view image planes having an OSD at different horizontal locations according to its depth to be perceived, and alternately output the pair of image planes. A pseudo 2D display control unit instructs the video plane generation unit to operate in the 3D display mode and the pseudo 2D display mode in periods where the image plane generation unit does not and does output the image planes, respectively. The adder unit combines a video plane and an image plane generated by the video plane generation unit and the image plane generation unit, respectively, onto a frame, and outputs the frame.

Abstract: In an optical motion capture system, it is possible to measure spatially high-dense data by increasing the number of measuring points. In the motion capture system using a mesh marker, intersections of lines for the mesh marker are called nodes and the lines connecting the nodes are called edges. The system includes a plurality of cameras for capturing a two-dimensional image of the mesh marker by imaging a subject having the mesh marker, a node/edge detecting section for detecting node/edge information on the mesh marker from the two-dimensional image captured by the respective cameras, and a three-dimensional reconstructing section for acquiring three-dimensional position information of the nodes by using the node/edge information detected from the plurality of two-dimensional images captured by different cameras.

Abstract: A method for demultiplexing frames of compressed image data is provided. The image data includes a series of left compressed images and a series of right compressed images, the right compressed images and left compressed images compressed using a compression function. The method includes receiving the frames of compressed image data via a medium configured to transmit images in single frame format, and performing an expansion function on frames of compressed image data, the expansion function configured to select pixels from the series of left compressed images and series of right compressed images to produce replacement pixels to form a substantially decompressed set of stereo image pairs. Additionally, a system for receiving stereo pairs, multiplexing the stereo pairs for transmission across a medium including single frame formatting, and demultiplexing received data into altered stereo pairs is provided.

Abstract: A system includes a stereo image creation device for converting image data created by image detectors into stereo image data, receiving sounds collected by microphones so as to create sound data from the received sounds, creating stereo moving image data containing the stereo image data, the sound data, and synchronization information necessary to synchronize them, and transmitting the stereo moving image data via a communication network and a stereo image output device for receiving the stereo moving image data via the communication network, separating the stereo image data, sound data, and synchronization information from the stereo moving image data, synchronizing the stereo image data with the sound data according to the synchronization information, and outputting the stereo image data and the sound data via output units so that a performance is simulated at a remote place.