Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: Encoding and decoding architectures for 3D video delivery are described, such as 2D compatible 3D video delivery and frame compatible 3D video delivery. The architectures include pre-processing stages to pre-process the output of a base layer video encoder and/or decoder and input the pre-processed output into an enhancement layer video encoder and/or decoder of one or more enhancement layers. Multiplexing methods of how to combine the base and enhancement layer videos are also described.

Abstract: Encoding and decoding architectures for 3D video delivery are described, such as 2D compatible 3D video delivery and frame compatible 3D video delivery. The architectures include pre-processing stages to pre-process the output of a base layer video encoder and/or decoder and input the pre-processed output into an enhancement layer video encoder and/or decoder of one or more enhancement layers. Multiplexing methods of how to combine the base and enhancement layer videos are also described.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: The present disclosure describes a system and method for multi-layered image and video delivery using reference processing signal. A multi-layered encoder and a multi-layered decoder, both comprising at least one enhancement layer processor that uses reference processing and a base layer processor are provided. A multi-layered encoder and a multi-layered decoder that use reference processing and are capable of frame-compatible 3D video delivery are also described.

Abstract: Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.

Abstract: Reference processing may be used in a video encoder or decoder to derive reference pictures that are better correlated with a source image to be encoded or decoded, which generally yields better coding efficiency. Methods for filter selection for a reference processing unit adapted for use in a video codec system are discussed. Specifically, methods for filter selection based on performing motion estimation and obtaining distortion/cost information by comparing reference pictures, either processed or non-processed, with the source image to be encoded are discussed.

Abstract: Filtering lower quality images or sequences of images with higher quality images or sequences of images. The filtering is utilized in a post-process, decoded, or encoded images including multiple sets of images that are filtered and/or combined. Different image features including, for example, quality, frequency characteristics, temporal resolution, spatial resolution, number of views, or bit-depth are present in the images. In one embodiment, the filtering comprises a multi-hypothesis filtering and the confidence value comprises a difference between the filtered sample and samples lying within a filter support. The post processes images are then stored or distributed.

Abstract: Multi-layered frame-compatible video delivery is described. Multi-layered encoding and decoding methods, comprising a base layer and at least one enhancement layer with reference processing, are provided. In addition, multi-layered encoding and decoding methods with inter-layer dependencies are described. Encoding and decoding methods that are capable of frame-compatible 3D video delivery are also described.

Abstract: Adaptive decoding and streaming multi-layer video systems and methods are described. The decoding systems comprise a base layer decoder and one or more enhancement layer decoders. The streaming systems comprise a base layer packetizer and one or more enhancement layer packetizers. A decoding adaptor controls operation of the base layer and/or enhancement layer decoders. A packetizing adaptor controls operation of the base layer and/or enhancement layer packetizers.

Abstract: The present disclosure describes a system and method for multi-layered image and video delivery using reference processing signal. A multi-layered encoder and a multi-layered decoder, both comprising at least one enhancement layer processor that uses reference processing and a base layer processor are provided. A multi-layered encoder and a multi-layered decoder that use reference processing and are capable of frame-compatible 3D video delivery are also described.

Abstract: A method for adaptive streaming of video data over a network is disclosed. The method includes receiving, by one or more decoders of a video streaming client, first video information of a video data stream with one or more operations of first complexity. The method further includes obtaining client-related information based at least in part on a decoding capability of the video streaming client related to decoding the first video information with the one or more operations of the first complexity by the one or more decoders. The method also includes using, by the video streaming client, the client-related information to cause the video streaming from the video streaming server to the video streaming client to be adapted to a different overall bit rate and based at least in part on the client-related information.

Abstract: Enhancement methods for sampled and multiplexed image and video data are described. Each component picture is separately processed either after de-multiplexing or on the fly. Processing and de-multiplexing can be combined in a single joint step. The methods apply to both encoding and decoding system and include applications to scalable video coding systems.

Abstract: Sampled data is packaged in checkerboard format for encoding and decoding. The sampled data may be quincunx sampled multi-image video data (e.g., 3D video or a multi-program stream), and the data may also be divided into sub-images of each image which are then multiplexed, or interleaved, in frames of a video stream to be encoded and then decoded using a standardized video encoder. A system for viewing may utilize a standard video decoder and a formatting device that de-interleaves the decoded sub-images of each frame reformats the images for a display device. A 3D video may be encoded using a most advantageous interleaving format such that a preferred quality and compression ratio is reached. In one embodiment, the invention includes a display device that accepts data in multiple formats.

Abstract: Reference processing may be used in a video encoder or decoder to derive reference pictures that are better correlated with a source image to be encoded or decoded, which generally yields better coding efficiency. Methods for filter selection for a reference processing unit adapted for use in a video codec system are discussed. Specifically, methods for filter selection based on performing motion estimation and obtaining distortion/cost information by comparing reference pictures, either processed or non-processed, with the source image to be encoded are discussed.

Abstract: An encoding device evaluates a plurality of processing and/or post-processing algorithms and/or methods to be applied to a video stream, and signals a selected method, algorithm, class or category of methods/algorithms either in an encoded bitstream or as side information related to the encoded bitstream. A decoding device or post-processor utilizes the signaled algorithm or selects an algorithm/method based on the signaled method or algorithm. The selection is based, for example, on availability of the algorithm/method at the decoder/post-processor and/or cost of implementation. The video stream may comprise, for example, downsampled multiplexed stereoscopic images and the selected algorithm may include any of upconversion and/or error correction techniques that contribute to a restoration of the downsampled images.

Abstract: A device includes a coder or a codec configured for interleaved image data utilizing diamond shaped blocks for motion estimation and/or motion compensation and utilizing square or orthogonal transforms of residual data. In various embodiments, the decoder may be configured, among others, to perform de-blocking on edges of the diamond shaped blocks and/or data padding at boundaries of the image data.

Abstract: Reference processing may be used in a video encoder or decoder to derive reference pictures that are better correlated with a source image to be encoded or decoded, which generally yields better coding efficiency. Methods for filter selection for a reference processing unit adapted for use in a video codec system are discussed. Specifically, methods for filter selection based on performing motion estimation and obtaining distortion/cost information by comparing reference pictures, either processed or non-processed, with the source image to be encoded are discussed.

Abstract: Conversion of interleaved data and/or correction of color samples or other data are corrected by recognizing an underlying arrangement or format of different data sets within a data stream and a conversion process applied that causes bleeding between the sets. The data sets are, for example, separate channel views of a 3D display, and the corruption occurs, for example, upon up-conversion of color samples that take into account both views together rather than individually. The invention is embodied, for example, as part of a playback device, display, or as a stand alone converter box that corrects the corrupted samples by at least one of substitution, filtering, or interpolation with appropriately selected samples (e.g., neighboring samples of a same view).

Abstract: A device includes a coder or a codec configured for interleaved image data utilizing diamond shaped blocks for motion estimation and/or motion compensation and utilizing square or orthogonal transforms of residual data. In various embodiments, the decoder may be configured, among others, to perform de-blocking on edges of the diamond shaped blocks and/or data padding at boundaries of the image data. Additionally a method is proposed in which at least one of a transform and quantization process to be applied to de-multiplexed data is modified. One application is to combine left and right stereoscopic images, interleaved in a checkerboard manner.