Abstract: Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.

Abstract: Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.

Abstract: Adaptive interpolation filters for multi-layered video delivery are described. Combinations of such adaptive filters with other pre-processing steps in the context of frame or 2D compatible 3D and 2D scalable video delivery system are also addressed.

Abstract: Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.

Abstract: Error resilient rate distortion optimization (ERRDO) is used for transmitting high quality images and video over constrained bandwidth networks, e.g., in streaming applications. Transmitting high quality images and video by reducing computational complexity is described.

Abstract: Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.

Abstract: Multi-layer encoding and decoding systems and methods are provided. A processing module processes outputs of a first base or enhancement layer and sends the processed outputs to a second, enhancement layer. Operation of the processing module is controlled, so that the second layer can receive processed or unprocessed outputs of the first layer in accordance with the circumstances. Processing of the outputs of the first layer can occur together with or separately from a disparity compensation process.

Abstract: Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.

Abstract: Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.

Abstract: Method for reconstructing interleaved views of a 3D image comprising the steps of: receiving interleaved views of a 3D image, de-interleaving said interleaved views into a first view and a second view, each de-interleaved view comprising missing pixels, at each pixel location determining an amount of disparity between said first and second views, for each view interpolating each missing pixel based on the amount of disparity determined at the associated pixel location, wherein when the determined disparity is above a predetermined disparity threshold, the missing pixel value is interpolated from the data of the view to be interpolated only (i.e. the view comprising said missing pixel value), and when the determined disparity is at or below said predetermined disparity threshold, the missing pixel value is interpolated from the data of both views.

Abstract: Error resilient rate distortion optimization (ERRDO) is used for transmitting high quality images and video over constrained bandwidth networks, e.g., in streaming applications. Transmitting high quality images and video by reducing computational complexity is described.

Abstract: A scalable frame compatible three-dimensional video encoding and decoding system for use in a multiview video coding system is described. A base layer includes low resolution information from a plurality of views while one or more enhancement layers may include high resolution information for at least one of the plurality of views. Interpolation filters are derived based on a combination of low resolution information and high resolution information are discussed. For a given view, sending high resolution information at some times and low resolution information at other times are also described.

Abstract: Reference processing may be used in a video encoder or decoder to derive reference pictures that are better correlated with a source image to be encoded or decoded, which generally yields better coding efficiency. Methods for filter selection for a reference processing unit adapted for use in a video codec system are discussed. Specifically, methods for filter selection based on performing motion estimation and obtaining distortion/cost information by comparing reference pictures, either processed or non-processed, with the source image to be encoded are discussed.

Abstract: Joint layer optimization for a frame-compatible video delivery is described. More specifically, methods for efficient mode decision, motion estimation, and generic encoding parameter selection in multiple-layer codecs that adopt a reference processing unit (RPU) to exploit inter-layer correlation to improve coding efficiency as described.

Abstract: Video data that represents two or more views is coded. The regions of the views are asymmetrically processed according to different coding patterns. Techniques that impose asymmetry at the region level, but at the same time may consider overall/average symmetry or significantly reduced asymmetry at the picture/view level are presented.

Abstract: Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.

Abstract: Enhancement methods for sampled and multiplexed image and video data are described. Each component picture is separately processed either after de-multiplexing or on the fly. Processing and de-multiplexing can be combined in a single joint step. The methods apply to both encoding and decoding system and include applications to scalable video coding systems.

Abstract: The present disclosure describes a system and method for multi-layered image and video delivery using reference processing signal. A multi-layered encoder and a multi-layered decoder, both comprising at least one enhancement layer processor that uses reference processing and a base layer processor are provided. A multi-layered encoder and a multi-layered decoder that use reference processing and are capable of frame-compatible 3D video delivery are also described.

Abstract: Adaptive decoding and streaming multi-layer video systems and methods are described. The decoding systems comprise a base layer decoder and one or more enhancement layer decoders. The streaming systems comprise a base layer packetizer and one or more enhancement layer packetizers. A decoding adaptor controls operation of the base layer and/or enhancement layer decoders. A packetizing adaptor controls operation of the base layer and/or enhancement layer packetizers.

Abstract: Quality evaluation or consistency computation of images is described. Disparity estimation is performed among images in one or more domains, and a metric based on the disparity estimation is computed to evaluate the quality or consistency.