Abstract: The present invention is a general purpose, modular, portable, integrated system for synthesizing real-time color, depth, occlusion, and transparency data into formats for Volumetric and Holographic Rendering, Coding and Delivery.

Abstract: The present invention discloses a device for obtaining stereoscopic images with conventional single optic channel endoscope using a single lens camera. The device comprises of an aperture each half of which is covered with complimentary additive and subtractive color filters and is installed between the endoscope and camera. The filters can be transversely adjusted to center on the principal ray so as to obtain optimal stereopsis. Images are viewed on a standard monitor using eyewear comprising the same complimentary additive and subtractive color filters on the left and the right side, or on specialized video monitors using active or passive polarized glasses.

Abstract: A method of encoding a video data signal (15) is provided, together with a method for decoding. The encoding comprises providing color information (51) for pixels in an image, providing a depth map with depth information (52) for the pixels, providing transition information (56, 57, 60, 70, 71) being representative of a width (63, 73) of a transition region (61, 72) in the image, the transition region (61, 72) comprising a depth transition (62) and blended pixels in which colors of a foreground object and a background object are blended, and generating (24) the video data signal (15) comprising encoded data representing the color information (51), the depth map (52) and the transition information (56, 57, 60, 70, 71). The decoding comprises using the transition information (56, 57, 60, 70, 71) for determining the width (63, 73) of the transition regions (61, 72) and for determining alpha values (53) for pixels inside the transition regions (61, 72).

Abstract: A video signal processing device processes a 3D video signal including a left-eye image and a right-eye image. The video signal processing device includes an OSD control unit generating a left-eye superimposition image and a right-eye superimposition image, an OSD superimposing unit superimposing the left-eye superimposition image on the left-eye image and the right-eye superimposition image on the right-eye image, so as to generate an output image, and a video output unit providing the output image. The OSD control unit includes a first register holding a left-eye parameter for generating the left-eye superimposition image, and a second register holding a right-eye parameter for generating the right-eye superimposition image. The OSD control unit generates the left-eye superimposition image and the right-eye superimposition image by shifting positions of pixels in a predetermined image based on the left-eye parameter and the right-eye parameter.

Abstract: The present disclosure generally provides a system and method for providing a real-time three-dimensional digital impact virtual audience. The system and method may include processing video associated with a live event to produce a corresponding data stream, compositing the corresponding data stream with at least one sequence of predictability data stream to create a digital framework, processing the digital framework into at least one full-form representation of at least one object depicted in the video, and transmitting the at least one full-form representation to one or more remote audience devices associated with one or more virtual audience members, wherein the one or more virtual audience members are viewing the same live event using their respective remote audience devices.

Abstract: A method of converting two-dimensional video data to three-dimensional video data. The method includes receiving at least one frame of two-dimensional video data and receiving side information of image elements in the at least one frame of the two-dimensional video data. The method also includes data clustering the two-dimensional video data with the side information to create a layered side map and side image based rendering using the two-dimensional video data and the layered side map to create three-dimensional video data for stereoscopic video.

Abstract: A playback method for processing a multi-view content includes: detecting a location of each viewer and accordingly generating a detecting result; and driving a display device according to the multi-view content and the detecting result. A playback apparatus for processing a multi-view content includes a detecting circuit and a driving circuit. The detecting circuit is arranged to detect a location of each viewer and accordingly generate a detecting result. The driving circuit is coupled to the detecting circuit, and implemented for driving a display device according to the multi-view content and the detecting result.

Abstract: A sub-title detection system and method for television video are provided in which a static region detection is performed, and the results of the static region detection are pruned using a feature based on density of horizontal transition pairs, an intelligent adaptive temporal filtering is performed that uses object-level subtitle information and has suitable properties for integration in a streaming video environment, rectangular bounding boxes are computed around the subtitle using height, width and filling-degree constraints, and finally, subtitle bounding boxes are identified by binary classification based on text stroke alignment features.

Abstract: Abstract: A broadcast receiver and a 3D video data processing method are disclosed. The method includes receiving a broadcast signal including system information and video data, parsing system information of a program, and determining whether the program provides a 3D broadcast service from the system information, extracting, if the program provides a 3D broadcast service, broadcast data of the program, and processing video data of broadcast data according to the system information. The broadcast receiver includes a receiving unit receiving a broadcast signal including system information and video data, an SI processor parsing system information of a program, and determining whether the program provides a 3D broadcast service from the system information, a demultiplexer extracting, if the program provides a 3D broadcast service, broadcast data of the program, and a video processor processing video data of the broadcast data according to system information.

Abstract: A three-dimensional measuring apparatus includes a projecting unit that includes an illumination capable of varying illuminance and that projects a stripe to a measurement object with light from the illumination and shifts a phase of the stripe projected to the measurement object; an imaging unit which captures an image of the measurement object; and a control unit which allows the imaging unit to capture a plurality of the images by allowing the projecting unit to shift the phase of the stripe projected to the measurement object a plurality of times, extracts luminance values from the plurality of captured images, calculates an error rate in three-dimensional measurement of the measurement object based on the extracted luminance values, calculates the error rate for each illuminance by varying the illuminance of the illumination, and determines measurement illuminance for three-dimensionally measuring the measurement object based on the calculated error rate of each illuminance.

Abstract: A decoder, a projecting system, and a method for processing an image thereof are provided. The decoder is adapted to the projecting system having a projecting module and a shutter glass. The decoder includes a decoding circuit and an indicating unit. The projecting module outputs a frame turning control signal to the shutter glass. The decoding circuit receives and decodes a three-dimensional (3D) video signal to produce a first image data and a second image data to the projecting module. The indicating unit is coupled to the decoding circuit and correspondingly produces an indicating signal when the decoding circuit outputs one of the first image data and the second image data.

Abstract: A motion picture depth information processing system for processing depth information of a plurality of frames in a motion picture segment, each of which has corresponding color information, is composed of a buffer, a motion estimation unit, a motion compensation unit, and an adaptive post-filtering unit. The system can carry out motion estimation by referring to the color information of the frames to obtain a motion vector for each block in a frame and depth motion compensation based on the aforementioned motion vectors to get an initial depth map for each frame in the segment, then do a post-processing via the adaptive post-filtering unit to get a refined depth map of every frame, and finally generate more definite depth information for the whole motion picture segment, thus reducing geometrical texturing burrs, which are commonly known in the depth processing prior art technology.

Abstract: An image processing apparatus and method includes extracting video depth information indicating a depth of a 3D video image from a video stream. The image processing apparatus and method also includes adjusting a depth value of a graphic screen, to be synchronized with the 3D video image, using the video depth information.

Abstract: A pseudo 3D image generation device includes frame memories that store a plurality of basic depth models used for estimating depth data based on a non-3D image signal and generating a pseudo 3D image signal; a depth model combination unit that combines the plurality of basic depth models for generating a composite depth model based on a control signal indicating composite percentages for combining the plurality of basic depth models; an addition unit that generates depth estimation data from the non-3D image signal and the composite depth models; and a texture shift unit that shifts the texture of the non-3D image for generating the pseudo 3D image signal.

Abstract: A radio transceiver included in or attached to an imaging camera is used to facilitate the automatic determination of a scale factor in a three-dimensional (3D) reconstruction. The radio transceiver transmits a radio signal from each of one or more camera positions and measures a reflection profile for the transmitted signal. The measured reflection profile is compared to a simulated reflection profile, generated from a 3D model of the subject/scene of interest, to determine an estimate of an unknown scale for the 3D model. In various embodiments, the radio transceiver may be adapted from a radio device that already exists in or on the imaging camera (e.g., a cellular radio, Bluetooth® radio, or the like) or may be added to an imaging camera.

Abstract: A video communication system includes a 3D video recording system, a 3D video display system, a first control for activating the 3D recording system to record a video message, a second control for playing back the video message on the 3D display, a power supply, and a microprocessor configured to: receive input commands from the first control and the second control, receive video data from the 3D video recording system, and control the 3D video recording system and the 3D video display system.

Abstract: A stereophonic sound generating apparatus of an embodiment includes a depth vector detecting unit, a motion vector detecting unit, an area dividing unit which divides a frame into a plurality of areas on the basis of motion vectors detected by the motion vector detecting unit, a depth vector average calculating unit, a voice processing unit which divides a frequency spectrum extracted from a voice signal into a plurality of frequency components, an associating unit which associates the plurality of areas divided by the area dividing unit with the plurality of frequency components divided by the voice processing unit, and a voice source identifying unit which identifies a source of a voice of a corresponding frequency component from the plurality of frequency components on the basis of the average of the depth vectors calculated for each of the areas by the depth vector average calculating unit.

Abstract: An apparatus for viewing of a three dimensional image of a scene including a monocular device worn by a viewer over one eye for displaying first two-dimensional images of the scene and a mechanism for rotating the first display in response to perceived rotational misalignments with a second display that displays second two dimensional images in stereo image pairs. A second display for displaying the second two-dimensional images of the scene. A way of determining lateral, longitudinal and rotational misalignments of the first images relative to the second images. A controller for providing lateral and longitudinal shifts of the first images on the first display and rotational movements of the mechanism to align the first and second images so the viewer perceives a three dimensional image of the scene.

Abstract: Methods, devices, and non-transitory computer-readable storage media are disclosed for allowing video conferencing participants to maintain eye contact with each other. A display is disposed between a first video capture device and a second video capture device. The video capture devices capture images of a subject video conferencing participant. Images from the first capture device are associated with images from the second video capture device for transmission over a network to a video conferencing agent of a peer video conferencing participant. Images of the peer video conferencing participant are received over the network and displayed on the display that is disposed between the video capture devices.

Abstract: Method for filling a hole-region and a three-dimensional (3D) video system using the same. In order to synthesize an image, a plurality of images each having a different viewpoint may be obtained. By using depth maps of the obtained plurality of images, an intermediate virtual viewpoint image may be synthesized. After synthesizing, a hole-region in the intermediate virtual viewpoint image may be filled using a color image of the intermediate virtual viewpoint image, a mask image indicating the hole-region in the intermediate virtual viewpoint image, and a depth image of the intermediate virtual viewpoint image.

Abstract: Systems and methods are disclosed for mapping a sound spatialization field to a displayed panoramic image as the viewing angle of the panoramic image changes. As the viewing angle of the image data changes, the audio data is processed to rotate the captured sound spatialization field to the same extent. Thus, the audio data remains mapped to the image data whether the image data is rotated about a single axis or about more than one axis.

Abstract: A method and system that enhances a user's experience when using a near eye display device, such as a see-through display device or a head mounted display device is provided. The user's intent to interact with one or more objects in the scene is determined. An optimized image is generated for the user based on the user's intent. The optimized image is displayed to the user, via the see-through display device. The optimized image visually enhances the appearance of objects that the user intends to interact with in the scene and diminishes the appearance of objects that the user does not intend to interact with in the scene. The optimized image can visually enhance the appearance of the objects that increase the user's comprehension. The optimized image is displayed to the user, via the see-through display device.

Abstract: A device for creating multi-view video contents includes a virtual view position and distribution unit that calculates a plurality of virtual views corresponding to the number of predetermined virtual views based on input information and distributes the calculated positions of the plurality of virtual views to a plurality of view synthesis processing units; a view synthesis processor that operates the plurality of view synthesis processing units in parallel, allows each of the view synthesis processing units to create at least one virtual view video corresponding to a position of at least one virtual view distributed from the virtual view position calculation and distribution unit, and performs partial multiplexing based on at least one created virtual view video; and a video integration unit that integrates a plurality of partially multiplexed videos output from the plurality of view synthesis processing units.

Abstract: According to one embodiment, a basic format having a first area to arrange main video data, a second area to arrange graphic data, a third area to arrange control information of pixels of the graphic data, and a fourth area to arrange control information of pixels of the main video data are defined. A distribution module distributes a first plane containing data in the first area and the second area and a second plane containing data in the third area and the fourth area. A first image quality adjustment module makes image quality adjustments of the data of the first plane. A combination module combines data of the second plane with the data of the first plane whose image quality has been adjusted.

Abstract: A method for transmission of a signal simultaneously including a first stream of binary data and one or more other streams of binary data, the method including, in the following order: dynamic distribution of bits of the data streams between coders, with one coder per data stream; coding the distributed bits using the coders; dynamic distribution of the coded bits between hierarchical levels of a modulator; and hierarchical modulation using the modulator.

Abstract: A video image data encoder comprises an input to receive stereoscopic image data. The stereoscopic image data includes first and second image data having chronological correspondence. An error correction encoding unit combines portions of the first image data and corresponding portions of the second image data from the input unit into a common encoding matrix. An error correcting code derived from the combined portions is added to the encoding matrix.

Abstract: An apparatus and method for reconstructing a hologram are disclosed. An illuminator emits a reference beam, a hologram display driver displays an interference pattern based on a video signal, a lens unit adjusts a magnification and a focus of a hologram reproduced by projecting the emitted reference beam onto the displayed interference pattern, and a scanning unit scans the adjusted hologram to pixels of a screen by controlling a direction of the adjusted hologram.

Abstract: This invention provides a system and method for training and performing runtime 3D pose determination of an object using a plurality of camera assemblies in a 3D vision system. The cameras are arranged at different orientations with respect to a scene, so as to acquire contemporaneous images of an object, both at training and runtime. Each of the camera assemblies includes a non-perspective lens that acquires a respective non-perspective image for use in the process. The searched object features in one of the acquired non-perspective image can be used to define the expected location of object features in the second (or subsequent) non-perspective images based upon an affine transform, which is computed based upon at least a subset of the intrinsics and extrinsics of each camera. The locations of features in the second, and subsequent, non-perspective images can be refined by searching within the expected location of those images.

Abstract: A method performed by one or more computing devices includes receiving, by a data center and from a user device via a public network connection, a selection of high-definition three-dimensional (HD3D) content and sending, by the data center and to the user device, a link to a content delivery system to provide the selected HD3D content. The method also includes receiving, by the content delivery system and from the user device, a streaming request for the selected HD3D content; reserving, by the content delivery system, bandwidth, for the selected HD3D content, within a managed network; and sending, by the content delivery system and to the user device, a streaming Internet protocol (IP) address for providing the selected HD3D content over the managed network.

Abstract: An electronic device including a receiver configured to receive a stereoscopic moving image including a plurality of frames; a controller configured to obtain a change in depth information of at least one object included in the stereoscopic moving image and to produce a sound zooming factor reflecting the obtained change in depth information; and an audio processor configured to apply the produced sound zooming factor to a sound signal corresponding to at least one speaker of a plurality of speakers outputting sound signals for the stereoscopic moving image.

Abstract: A method and apparatus for providing a broadcasting service are provided. The broadcasting service may be classified based on a broadcasting service type, such as a frame-compatible service, and a service-compatible service. Additionally, a descriptor may be generated based on the broadcasting service type, and a compatibility between a stereoscopic three-dimensional (3D) broadcasting service and a single stream-based broadcasting service may be provided.

Abstract: A method for adjusting three-dimensional (3D) depth including performing block matching on left-eye/right-eye frames of a stereo video signal to generate a motion vector of a specific object and to obtain 3D depth of the specific object; and adjusting 3D depth of an additive object according to that of the specific object, wherein the additive object is one of a subtitle object, an on screen display (OSD) object or a program guide object.

Abstract: A three dimensional [3D] video signal (41) is provided for transferring to a 3D destination device (50). Depth metadata is determined indicative of depths occurring in the 3D video data, which depth metadata includes a near value indicative of depths of video data nearest to a user. The 3D video signal, which comprises the 3D video data, now also includes the depth metadata. The 3D destination device (50) is enabled to retrieve the depth metadata, to provide auxiliary data, and to position the auxiliary data at an auxiliary depth in dependence of the retrieved metadata for displaying the auxiliary data in combination with the 3D video data such that obscuring the auxiliary data by said nearest video data, and/or disturbing effects at the boundary of the auxiliary data, is avoided.

Abstract: This document discloses apparatus and methods related to image taking and processing. For example, some embodiments may contain a front facing camera and a back facing camera and can be used for including the image-taker as part of the images taken by the image-taker, for verifying authorship of the images, for creating documentary style still or moving images combining the images of the person creating the documentary and the images of the subject or the scene being documented, and for creating a wide field of views of still and moving images.

Abstract: A combination image has a pair of 3D-presentation images horizontally or vertically arranged and resulting from compressing original 3D-presentation images into half size. One of the left-hand and right-hand haves or the upper and lower halves of the combination image is set as a to-be-enhanced image while the other is set as a reference image. A block having a prescribed number of pixels is formed in the to-be-enhanced image. The formed block extends at and around an interpolation object position. The reference image is searched for a reference block matching in pattern with the formed block. A value at a pixel in the reference block which positionally corresponds to the interpolation object position is decided to be a candidate value for an interpolation-result pixel. The interpolation-result pixel having the candidate value is placed at the interpolation object position to change the to-be-enhanced image into a resolution-enhanced image.

Abstract: The present invention relates to method and apparatus for multiview video coding. In particular, the present invention describes a disparity compensated prediction to exploit the inter-view correlation in multiview video coding by providing stretching, compression, and shearing (SCSH) disparity compensation to approximate the actual disparity effects in addition to the translational disparity. A sub-sampled block-matching disparity estimation technique is provided to implement the SCSH disparity compensation which makes use of the interpolated reference frames for subpixel motion and disparity estimation in conventional hybrid video coding structure.

Abstract: The invention relates to a method of and apparatus for displaying a holographically generated video image having plural video frames. For each period there is provided a respective sequential plurality of holograms. The holograms of the plural video frames are displayed for viewing the replay field thereof, and the noise variance of each frame is perceived as attenuated by averaging across said plurality of holograms.

Abstract: Techniques for rendering at least one object into a stereoscopic image for a display device are provided. Perceptual depth data as a fraction of viewer distance for the object is received. This perceptual depth data can be normalized. A pixel separation offset for a particular display device is calculated from the perceptual depth data. Left and right eye images of the object are respectively inserted into the stereoscopic image with the pixel separation offset. For a specific embodiment, the object includes captioning to be inserted.

Abstract: The present invention relates to a stereoscopic content service system and method, and more particularly to a stereoscopic content service system and method which defines a Scene Descriptor (SD) including information required for stereoscopic contents, displays the stereoscopic contents based on the information of the defined SD, and thereby may perform a two-dimension (2D)/three-dimension (3D) display conversion through user interaction and display a stereoscopic text based on information about a left and right text and disparity information.

Abstract: A method for embedding subtitles and/or graphic overlays in a 3D or multi-view video application is described. The subtitles and/or graphic overlays are provided separately for each view of the 3D or multi-view video application. The views with the subtitles and/or graphic overlays are then processed to form a subtitled and/or graphic overlaid 3D or multi-view video application.

Abstract: A broadcast transmitter/receiver and a 3D video data processing method of the same are disclosed. A 3D video data processing method of a broadcast transmitter includes encoding 3D video data, using an encoder, generating system information included in 3D video metadata, using a system information processor, outputting a transport stream by inserting frame sync information in the 3D vide data and multiplexing the 3D video data and system information, using a TP encoder, and modulating and transmitting the transport stream, using a transmitting unit.

Abstract: Full resolution graphic overlays (e.g., graphics, menus, arrows, buttons, captions, banners, picture in picture information) and subtitles in frame compatible 3D delivery for a scalable system are described.

Abstract: Disclosed herein is an information processing apparatus, including: an acquisition section adapted to acquire stereoscopic image information for displaying a stereoscopic image; and a production section adapted to compare a first image and a second image, which configure the acquired stereoscopic image information, with each other to produce a parameter indicative of a position of a body included in the stereoscopic image in the depthwise direction when the stereoscopic image is displayed.

Abstract: First and second closed captioning (CC) windows containing identical text are presented on a video display slightly offset from each other so as to give a 3D appearance to the combined text.

Abstract: Disclosure is directed to projecting holographic images in connection with a program service such as cable or satellite television. In one instance, the projected holographic image may be an image of product that is featured in advertisement or other portion of program service. In another instance, the projected holographic image may be an image of a electronic programming guide with screens or menu displayed on sides of a cube or other geometric form. In still another instance, the projected holographic image is a video that supplements an instructional video or live broadcast.

Abstract: 3D image data can be modified based on user preference data received from a user. The user preference data may be received at a first device and used to adjust 3D image data generated by the first device for presentation by a display device, or the first device may receive the user preference data and transmit it to a display device such that the display device may adjust the 3D image data based on the user preference data. The 3D image data may be adjusted based on user preference data to support presentation of 3D imagery on the display device in a manner desired by a user. 3D user viewing preferences may include an amount of pop-out effect in images, a stereo baseline of images, a depth range of images, a spatial distribution of images, a degree of depth sharpness in images, or specification of a user's dominant eye.

Abstract: [Object] To enable a receiver compatible with MVC to adequately handle dynamic change in the contents of distribution and to perform correct stream reception. [Solution] A broadcasting station 100 transmits a first transport stream TS1 and a second transport stream TS2 in a time-sharing manner. The TS1 includes the video elementary streams of a base view and a predetermined number of non-base views. The TS2 includes a video elementary stream of two-dimensional (2D) image data. Stream association information for associating the base view and a predetermined number of non-base views is inserted into the TS1. A receiver 200 recognizes that the TS1 has been transmitted, based on the stream association information, and also recognizes association between the base view and non-base views. The receiver 200 can adequately handle dynamic change of the TS1 and TS2, i.e., dynamic change in the contents of distribution, and perform correct stream reception.

Abstract: A technique for tracking and highlighting an object in stereoscopic images by changing the depth of the object is disclosed. A stereoscopic image is processed using an object detection algorithm to select the pixels associated with the object in the image. The depth of the object is adjusted in the stereoscopic image by adjusting the disparity between the pixels associated with the object in the left and right stereoscopic image pair. The processed stereoscopic image is then displayed on a stereoscopic display or stored in memory. An object is tracked by highlighting the object in consecutive stereoscopic images that depict the object.

Abstract: An apparatus generating audio cues for content indicative of the position of audio objects within the content comprising: an audio processor receiving raw audio tracks for said content and information indicative of the positions of at least some of said audio tracks within frames of said content, said audio processor generating corresponding audio parameters; an authoring tool receiving said audio parameters and generating encoding coefficients, said audio parameters including audio cue of the position of audio objects corresponding to said tracks in at least one spatial dimension; and a first audio/video encoder receiving an input and encoding said input into an audio visual content having visual objects and audio objects, said audio objects being disposed at location corresponding to said one spatial position, said encoder using said encoding coefficients for said encoding.

Abstract: Disclosed is an apparatus and method for transmitting/receiving reference image data and 3D additional image data in 3D image data so as to provide a 3D image in a digital broadcasting system. In the method, a basic image and a 3D additional image in a 3D image of a 3D broadcasting service is processed in a stereoscopic image format of one of a side-by-side method and a top-down method. The basic image and the 3D additional image processed in the stereoscopic image format are encoded to a basic image stream and a 3D additional image stream. The encoded basic image stream and the encoded 3D additional image stream are multiplexed to a 3D image stream of a single stream using a dual stream method, and the multiplexed 3D image stream is then transmitted.