Abstract: Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback. Given an input video stream and associated minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. The instantaneous dynamic range of a target display is determined based on the filtered output value and the minimum and maximum brightness values of the display. A backlight control level is computed based on the instantaneous dynamic range, and the input signal is tone mapped by a display management process to be displayed on the target display at the selected backlight level. The design of a temporal filter based on an exponential moving average filter and scene-change detection is presented.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Abstract: A spherical image of a spatial environment is received and contains spherically arranged pixel values indexed by a time value. The spherical image is represented in a content creation coordinate system in reference to a spatial position in the spatial environment. The spatial position is indexed by the time value. A spatial relationship is determined between the content creation coordinate system and a spherical image reference coordinate system. Based at least in part on the spatial relationship and the spherically arranged pixel values, spherical distributions of image metadata are determined for the spherical image.

Abstract: Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback. Given an input video stream and associated minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. The instantaneous dynamic range of a target display is determined based on the filtered output value and the minimum and maximum brightness values of the display. A backlight control level is computed based on the instantaneous dynamic range, and the input signal is tone mapped by a display management process to be displayed on the target display at the selected backlight level. The design of a temporal filter based on an exponential moving average filter and scene-change detection is presented.

Abstract: Methods are disclosed for adaptive display management using one or more viewing environment parameters. Given the one or more viewing environment parameters, an effective luminance range for a target display, and an input image, a tone-mapped image is generated based on a tone-mapping curve, an original PQ luminance mapping function, and the effective luminance range of the display. A corrected PQ (PQ?) luminance mapping function is generated according to the viewing environment parameters. A PQ-to-PQ? mapping is generated, wherein codewords in the original PQ luminance mapping function are mapped to codewords in the corrected (PQ?) luminance mapping function, and an adjusted tone-mapped image is generated based on the PQ-to-PQ? mapping.

Abstract: Input VR imagery is received. Global motions as represented in the input VR imagery relative to a viewer of a virtual reality (VR) application is extracted. A dampening factor is applied to the global motions to generate dampened global motions. VR imagery to be rendered to the viewer at a time point is generated based on the input VR imagery and the dampened global motions.

Abstract: Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback or for generating filtered video metadata. Given an input video stream and associated metadata values of minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. At least one filtering coefficient of the temporal filter is adapted based on a logistic function controlled by slope and sensitivity values. The instantaneous dynamic range of a target display is determined based on the filtered metadata values and the minimum and maximum brightness values of the display.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Abstract: An encoder receives an input enhanced dynamic range (EDR) image and a corresponding lower dynamic range (LDR) image to be coded at a given target rate. Before coding, a pre-dithering process is applied to the input LDR image to generate a dithered LDR image at a second bit depth, lower than its original bit depth. The pre-dithering process includes: generating uniformly-distributed noise, applying a spatial filter to the noise to generate low-pass or high-pass filtered noise, applying a temporal high pass or low pass filter to the spatially-filtered noise to generate output noise, adding the output noise to the input LDR image to generate a noise-enhanced LDR image, and quantizing the noise-enhanced image to generate the dithered LDR image. Selecting the characteristics of the dithering filters is based on both the target bit rate and luminance characteristics of the pixels in the input LDR image.

Abstract: A highlight mask is generated for an image to identify one or more highlights in the image. One or more highlight classifiers are determined for the one or more highlights in the image. One or more highlight gains are applied with the highlight mask to luminance amplitudes of pixels in the one or more highlights in the image to generate a scaled image. The one or more high-light gains for the one or more highlights are determined based at least in part on the one or more highlight classifiers determined for the one or more highlights.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Abstract: A content-adaptive quantizer processor receives an input image with an input bit depth. A noise-mask generation process is applied to the input image to generate a noise mask image which characterizes each pixel in the input image in terms of its perceptual relevance in masking quantization noise. A noise mask histogram is generated based on the input image and the noise mask image. A masking-noise level to bit-depth function is applied to the noise mask histogram to generate minimal bit depth values for each bin in the noise mask histogram. A codeword mapping function is generated based on the input bit depth, a target bit depth, and the minimal bit depth values. The codeword mapping function is applied to the input image to generate an output image in the target bit depth.

Abstract: Representation and coding of multi-view images are carried out through tapestry encoding. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. The tapestry image is generated from a leftmost view image, a rightmost view image, a disparity map and an occlusion map.

Abstract: Input VR imagery is received. Global motions as represented in the input VR imagery relative to a viewer of a virtual reality (VR) application is extracted. A dampening factor is applied to the global motions to generate dampened global motions. VR imagery to be rendered to the viewer at a time point is generated based on the input VR imagery and the dampened global motions.

Abstract: Methods and systems for controlling judder are disclosed. Judder can be introduced locally within a picture, to restore a judder feeling which is normally expected in films. Judder metadata can be generated based on the input frames. The judder metadata includes base frame rate, judder control rate and display parameters, and can be used to control judder for different applications.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Abstract: Dithering techniques for images are described herein. An input image of a first bit depth is separated into a luma and one or more chroma components. A model of the optical transfer function (OTF) of the human visual system (HVS) is used to generate dither noise which is added to the chroma components of the input image. The model of the OTF is adapted in response to viewing distances determined based on the spatial resolution of the chroma components. An image based on the original input luma component and the noise-modified chroma components is quantized to a second bit depth, which is lower than the first bit depth, to generate an output dithered image.

Abstract: Several embodiments of systems and methods are disclosed that create iso-perceptible image data from input image data. Such iso-perceptible image data may be created from Just-Noticeable-Difference (JND) modeling that leverages models from the Human Visual System (HVS). From a set of iso-perceptible image data set, an output image data may be selected, such that the chosen output image data has a less power and/or energy requirement to render than the input image data. Further, the output image data may have a substantially lower power and/or energy requirement than the set of iso-perceptible image data.

Abstract: Several embodiments of display systems that use narrowband emitters are disclosed herein. In one embodiment, a display system comprises, for at least one primary color, a plurality of narrowband emitters distributed around the primary color point. The plurality of narrowband emitters provides a more regular power vs. spectral distribution in a desired band of frequencies.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.