Abstract: Techniques use multiple lower bit depth (e.g., 8 bits) codecs to provide higher bit depth (e.g., 12+ bits) high dynamic range images from an upstream device to a downstream device. Multiple layers comprising a base layer and one or more enhancement layers may be used to carry video signals comprising image data compressed by lower bit depth encoders to a downstream device, wherein the base layer cannot be decoded and viewed on its own. Lower bit depth input image data to base layer processing may be generated from higher bit depth high dynamic range input image data via advanced quantization to minimize the volume of image data to be carried by enhancement layer video signals. The image data in the enhancement layer video signals may comprise residual values, quantization parameters, and mapping parameters based in part on a prediction method corresponding to a specific method used in the advanced quantization.

Abstract: In an embodiment, a source video signal comprising reference code values and mapping function parameters for one or more mapping functions to map the reference code values to device-specific pixel values. The reference code values and the mapping function parameters are combined into first video frames in a first video signal format. The mapping function parameters represent DM metadata carried in the first video frames. Second video frames in a second video signal format are generated based on the first video frames in the first video signal format and a mapping between the first video signal format and the second video signal format. The second video frames are sent to a video sink device through the video link in an encoded video signal of the second video signal format.

Abstract: A processor for video coding receives a full-frame rate (FFR) HDR video signal and a corresponding FFR SDR video signal. An encoder generates a scalable bitstream that allows decoders to generate half-frame-rate (HFR) SDR, FFR SDR, HFR HDR, or FFR HDR signals. Given odd and even frames of the input FFR SDR signal, the scalable bitstream combines a base layer of coded even SDR frames with an enhancement layer of coded packed frames, where each packed frame includes a downscaled odd SDR frame, a downscaled even HDR residual frame, and a downscaled odd HDR residual frame. In an alternative implementation, the scalable bitstream combines four signals layers: a base layer of even SDR frames, an enhancement layer of odd SDR frames, a base layer of even HDR residual frames and an enhancement layer of odd HDR residual frames. Corresponding decoder architectures are also presented.

Abstract: HDR images are coded and distributed. An initial HDR image is received. Processing the received HDR image creates a JPEG-2000 DCI-compliant coded baseline image and an HDR-enhancement image. The coded baseline image has one or more color components, each of which provide enhancement information that allows reconstruction of an instance of the initial HDR image using the baseline image and the HDR-enhancement images. A data packet is computed, which has a first and a second data set. The first data set relates to the baseline image color components, each of which has an application marker that relates to the HDR-enhancement images. The second data set relates to the HDR-enhancement image. The data packets are sent in a DCI-compliant bit stream.

Abstract: Methods and systems for controlling judder are disclosed. Judder can be introduced locally within a picture, to restore a judder feeling which is normally expected in films. Judder metadata can be generated based on the input frames. The judder metadata includes base frame rate, judder control rate and display parameters, and can be used to control judder for different applications.

Abstract: Novel methods and systems for color grading are disclosed. The color grading process for a visual dynamic range image can be guided by information relating to the color grading of other images such as the standard dynamic range image.

Abstract: Methods are disclosed for adaptive display management using look-up table interpolation. Given a target maximum brightness value for a display, a new look-up table (LUT) for color gamut mapping is determined based on interpolating values from two other pre-computed color gamut LUTs; one computed for a first maximum display brightness larger than the target maximum brightness value, and one computed for a second maximum display brightness lower than the target brightness value. An interpolation scale is computed based at least on the target maximum brightness value and the first maximum display brightness. Methods to reduce the computation load for the translation of RGB data from one color representation (say, ST 2084) to another color representation (say, BT 1866) using fast interpolation methods are also presented.

Abstract: A display management processor receives an input image with enhanced dynamic range to be displayed on a target display which has a different dynamic range than a reference display. The input image is first transformed into a perceptually-quantized (PQ) color space. A non-linear mapping function generates a tone-mapped intensity image in response to the characteristics of the source and target display and a measure of the intensity of the PQ image. After a detail-preservation step which may generate a filtered tone-mapped intensity image, an image-adaptive intensity and saturation adjustment step generates an intensity adjustment factor and a saturation adjustment factor as functions of the measure of intensity and saturation of the PQ image, which together with the filtered tone-mapped intensity image are used to generate the output image. Examples of the functions to compute the intensity and saturation adjustment factors are provided.

Abstract: Techniques use multiple lower bit depth (e.g., 8 bits) codecs to provide higher bit depth (e.g., 12+ bits) high dynamic range images from an upstream device to a downstream device. Multiple layers comprising a base layer and one or more enhancement layers may be used to carry video signals comprising image data compressed by lower bit depth encoders to a downstream device, wherein the base layer cannot be decoded and viewed on its own. Lower bit depth input image data to base layer processing may be generated from higher bit depth high dynamic range input image data via advanced quantization to minimize the volume of image data to be carried by enhancement layer video signals. The image data in the enhancement layer video signals may comprise residual values, quantization parameters, and mapping parameters based in part on a prediction method corresponding to a specific method used in the advanced quantization.

Abstract: Techniques use multiple lower bit depth codecs to provide higher bit depth, high dynamic range, images from an upstream device to a downstream device. A base layer and one or more enhancement layers may be used to carry video signals, wherein the base layer cannot be decoded and viewed on its own. Lower bit depth input image data to base layer processing may be generated from higher bit depth high dynamic range input image data via advanced quantization to minimize the volume of image data to be carried by enhancement layer video signals. The image data in the enhancement layer video signals may comprise residual values, quantization parameters, and mapping parameters based in part on a prediction method corresponding to a specific method used in the advanced quantization. Adaptive dynamic range adaptation techniques take into consideration special transition effects, such as fade-in and fade-outs, for improved coding performance.

Abstract: A high resolution 3D Image may be encoded into a reduced resolution image in a base layer and a full resolution unfiltered image in one or more enhancement layers. Encoded asymmetric-resolution image data for the 3D image may be distributed to a wide variety of devices for 3D image processing and rendering. A recipient device may reconstruct the reduced resolution image and the full resolution unfiltered image for 3D image rendering with high subjective perceptual quality due to interocular masking. Full resolution unfiltered images may be alternating between left and right eyes.

Abstract: Novel methods and systems for color grading are disclosed. The color grading process for a visual dynamic range image can be guided by information relating to the color grading of other images such as the standard dynamic range image.

Abstract: In an embodiment, a source video signal comprising reference code values and mapping function parameters for one or more mapping functions to map the reference code values to device-specific pixel values. The reference code values and the mapping function parameters are combined into first video frames in a first video signal format. The mapping function parameters represent DM metadata carried in the first video frames. Second video frames in a second video signal format are generated based on the first video frames in the first video signal format and a mapping between the first video signal format and the second video signal format. The second video frames are sent to a video sink device through the video link in an encoded video signal of the second video signal format.

Abstract: Representation and coding of multi-view images using tapestry encoding are described for standard and enhanced dynamic ranges compatibility. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. Different methods for achieving compatibility are described.

Abstract: An input image is divided into non-overlapping regions. For each of the non-overlapping regions, first output data is predicted with a first prediction function, parameters related thereto and region-specific input image data. For each region with prior-predicted neighbor regions, a pixel border portion, adjacent to the neighbor region, is defined. For the pixels in the defined border portion, second output data is predicted with a second prediction function, parameters related thereto, input image data from the border portion of the current region, and input prediction parameter data from the neighbor region. The first output prediction data is fused with the second output data to predict a final set of output prediction values.

Abstract: A sequence of enhanced dynamic range (EDR) images and a sequence of standard dynamic range images are encoded using a backwards-compatible SDR high-definition (HD) base layer and one or more enhancement layers. The EDR and SDR video signals may be of the same resolution (e.g., HD) or at different resolutions (e.g., 4K and HD) and are encoded using a dual-view-dual-layer (DVDL) encoder to generate a coded base layer (BL) and a coded enhancement layer (EL). The DVDL encoder includes a reference processing unit (RPU) which is adapted to compute a reference stream based on the coded BL stream. The RPU operations include post-processing, normalization, inverse normalization, and image registration. Decoders for decoding the coded BL and EL streams to generate a backwards compatible 2D SDR stream and additional 2D or 3D SDR or EDR streams, are also described.

Abstract: A method, an apparatus, and a non-transitory computer readable medium for performing 2D to 3D conversion are presented. A 2D input source is extracted into left and right 3D images. Motion vectors are calculated for the left and right 3D images. Frame rate conversion is performed on the left 3D image and the right 3D image, using the respective calculated motion vectors, to produce motion compensated left and right 3D images. The left and right 3D images and the motion compensated left and right 3D images are reordered for display.

Abstract: An encoder receives an input enhanced dynamic range (EDR) image to be stored or transmitted using multiple coding formats in a layered representation. A layer decomposer generates a lower dynamic range (LDR) image from the EDR image. One or more base layer (BL) encoders encode the LDR image to generate a main coded BL stream and one or more secondary coded BL streams, where each secondary BL stream is coded in a different coding format than the main coded BL stream. A single enhancement layer (EL) coded stream and related metadata are generated using the main coded BL stream, the LDR image, and the input EDR image. An output coded stream includes the coded EL stream, the metadata, and either the main coded BL stream or one of the secondary coded BL streams. Computation-scalable decoding and display management processes for EDR images are also described.

Abstract: A display management processor receives an input image with enhanced dynamic range to be displayed on a target display which has a different dynamic range than a reference display. The input image is first transformed into a perceptually-quantized (PQ) color space. A non-linear mapping function generates a tone-mapped intensity image in response to the characteristics of the source and target display and a measure of the intensity of the PQ image. After a detail-preservation step which may generate a filtered tone-mapped intensity image, an image-adaptive intensity and saturation adjustment step generates an intensity adjustment factor and a saturation adjustment factor as functions of the measure of intensity and saturation of the PQ image, which together with the filtered tone-mapped intensity image are used to generate the output image. Examples of the functions to compute the intensity and saturation adjustment factors are provided.

Abstract: Systems and methods for overlaying a second image/video data onto a first image/video data are described herein. The first image/video data may be intended to be rendered on a display with certain characteristics—e.g., HDR, EDR, VDR or UHD capabilities. The second image/video data may comprise graphics, closed captioning, text, advertisement—or any data that may be desired to be overlaid and/or composited onto the first image/video data. The second image/video data may be appearance mapped according to the image statistics and/or characteristics of the first image/video data. In addition, such appearance mapping may be made according to the characteristics of the display that the composite data is to be rendered. Such appearance mapping is desired to render a composite data that is visually pleasing to a viewer, rendered upon a desired display.