Abstract: A highlight mask is generated for an image to identify one or more highlights in the image. One or more highlight classifiers are determined for the one or more highlights in the image. One or more highlight gains are applied with the highlight mask to luminance amplitudes of pixels in the one or more highlights in the image to generate a scaled image. The one or more high-light gains for the one or more highlights are determined based at least in part on the one or more highlight classifiers determined for the one or more highlights.

Abstract: Representation and coding of multi-view images are carried out through tapestry encoding. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. The tapestry image is generated from a leftmost view image, a rightmost view image, a disparity map and an occlusion map.

Abstract: Image data relating to real-world objects or persons is collected from a scene while collecting audio data relating to the real-world objects or persons from the same scene. The audio data is used to derive sound objects corresponding to the real-world objects or persons. The image data is used to derive video objects corresponding to the real-world objects or persons. Based on the sound objects and the video objects, candidate salient objects are generated. A salient object is selected from among the candidate salient objects. Perceptual enhancement operations are performed on the selected salient object.

Abstract: An image sensor of a camera configured with a diffraction grating is used to capture a diffraction image of an image rendering surface of a display device, for example, while a target image is being rendered on the image rendering surface of the display device. The diffraction image of the image rendering surface of the display device is analyzed to obtain measurements of native display capabilities of the display device. Display capability data is transmitted to a display management module for the display device. At least a portion of the display capability data is generated from the measurements of native display capabilities of the display device that are obtained from analyzing the diffraction image of the image rendering surface of the display device.

Abstract: Several embodiments of a media processor for the creation of metadata from a set of images are given. The media processor receives a set of image data and computes metadata from the image data. The metadata may comprise statistical data based on the image data; from which the media processor may generate and store a multi-scale version of the metadata. The metadata may comprise statistical attributes derived directly from the image data or statistical attributes derived from image appearance correlates of the image data. The media processor may generate a subsampled set of the metadata and the subsampled set may be stored in an efficient data structure, such as a pyramidal structure. The pyramidal structure may be generated from spatial image information, from temporal image information or from spatial-temporal image information.

Abstract: A display system comprises light sources configured to emit first light with a first spectral power distribution; light regeneration layers configured to be stimulated by the first light and to convert at least a portion of the first light and recycled light into second light, the second light comprising (a) primary spectral components that correspond to primary colors and (b) secondary spectral components that do not correspond to the primary colors; and notch filter layers configured to receive a portion of the second light and to filter out the secondary spectral components from the portion of the second light. The portion of the second light can be directed to a viewer of the display system and configured to render images viewable to the viewer.

Abstract: A display system comprises light sources configured to emit first light with a first spectral power distribution; light regeneration layers configured to be stimulated by the first light and to convert at least a portion of the first light and recycled light into second light, the second light comprising (a) primary spectral components that correspond to primary colors and (b) secondary spectral components that do not correspond to the primary colors; and notch filter layers configured to receive a portion of the second light and to filter out the secondary spectral components from the portion of the second light. The portion of the second light can be directed to a viewer of the display system and configured to render images viewable to the viewer.

Abstract: The present invention provides a cinema screen that improves audience perception of brightness at, for example, a premium theater without additional illumination cost. The screen is produced from materials that also help mitigate speckle from laser illumination. The screen has properties and includes structures that may be tuned to the specific capabilities of the projection system, arrangement of the theater, and projector (and angle of projection, angle of viewing). Light reflected from the screen are direct toward audience members and away from walls and ceilings.

Abstract: A plurality of input images in an input video signal of a wide dynamic range is received. A specific setting of global light modulation is determined based on a specific input image in the plurality of input images. The specific setting of global light modulation produces a specific dynamic range window. A plurality of input code values in the specific input image is converted to a plurality of output code values in a specific output image corresponding to the specific input image. The plurality of output code values produces the same or substantially the same luminance levels as represented by the plurality of input code values. Any other pixels in the specific input image are converted to different luminance levels in the specific output image through display management.

Abstract: Novel methods and systems for inverse tone mapping are disclosed. A scene can be analyzed to obtain highlight detection from bright light sources and specular reflections. An inverse tone mapping curve can be calculated based on the lower dynamic range and higher dynamic range displays. Multi-scale filtering can be applied to reduce noise or artifacts.

Abstract: Systems and methods are disclosed for dynamically adjusting the backlight of a display during video playback or for generating filtered video metadata. Given an input video stream and associated metadata values of minimum, average, or maximum luminance values of the video frames in the video stream, values of a function of the frame min, mid, or max luminance values are filtered using a temporal filter to generate a filtered output value for each frame. At least one filtering coefficient of the temporal filter is adapted based on a logistic function controlled by slope and sensitivity values. The instantaneous dynamic range of a target display is determined based on the filtered metadata values and the minimum and maximum brightness values of the display.

Abstract: Video data with enhanced dynamic range (EDR) are color graded for a first and a second reference display with different dynamic range characteristics to generate a first color-graded output, a second color graded output, and associated first and second sets of metadata. The first color-graded output and the two sets of metadata are transmitted from an encoder to a decoder to be displayed on a target display which may be different than the second reference display. At the receiver, a decoder interpolates between the first and second set of metadata to generate a third set of metadata which drives the display management process for displaying the received video data onto the target display. The second set of metadata of metadata may be represented as delta metadata values from the first set of metadata values.

Abstract: Novel methods and systems for inverse tone mapping are disclosed. A scene can be analyzed to obtain highlight detection from bright light sources and specular reflections. An inverse tone mapping curve can be calculated based on the lower dynamic range and higher dynamic range displays. Multi-scale filtering can be applied to reduce noise or artifacts.

Abstract: Video data with enhanced dynamic range are color graded for a first and a second reference display with different dynamic range characteristics to generate a first color-graded output, a second color graded output, and associated first and second sets of metadata. The first color-graded output and the two sets of metadata are transmitted from an encoder to a decoder to be displayed on a target display which may be different than the second reference display. At the receiver, a decoder interpolates between the first and second set of metadata to generate a third set of metadata which drives the display management process for displaying the received video data onto the target display. The second set of metadata of metadata may be represented as delta metadata values from the first set of metadata values.

Abstract: An image sensor of a camera configured with a diffraction grating is used to capture a diffraction image of an image rendering surface of a display device, for example, while a target image is being rendered on the image rendering surface of the display device. The diffraction image of the image rendering surface of the display device is analyzed to obtain measurements of native display capabilities of the display device. Display capability data is transmitted to a display management module for the display device. At least a portion of the display capability data is generated from the measurements of native display capabilities of the display device that are obtained from analyzing the diffraction image of the image rendering surface of the display device.

Abstract: Representation and coding of multi-view images using tapestry encoding are described for standard and enhanced dynamic ranges compatibility. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. Different methods for achieving compatibility are described.

Abstract: A display management processor receives an input image with enhanced dynamic range to be displayed on a target display which has a different dynamic range than a reference display. The input image is first transformed into a perceptually-corrected IPT color space. A non-linear mapping function generates a first tone-mapped signal by mapping the intensity of the input signal from the reference dynamic range into the target dynamic range. The intensity (I) component of the first tone-mapped signal is sharpened to preserve details, and the saturation of the color (P and T) components is adjusted to generate a second tone-mapped output image. A color gamut mapping function is applied to the second tone-mapped output image to generate an image suitable for display onto the target display. The display management pipeline may also be adapted to adjust the intensity and color components of the displayed image according to specially defined display modes.

Abstract: Systems and methods for overlaying a second image/video data onto a first image/video data are described herein. The first image/video data may be intended to be rendered on a display with certain characteristics—e.g., HDR, EDR, VDR or UHD capabilities. The second image/video data may comprise graphics, closed captioning, text, advertisement—or any data that may be desired to be overlaid and/or composited onto the first image/video data. The second image/video data may be appearance mapped according to the image statistics and/or characteristics of the first image/video data. In addition, such appearance mapping may be made according to the characteristics of the display that the composite data is to be rendered. Such appearance mapping is desired to render a composite data that is visually pleasing to a viewer, rendered upon a desired display.

Abstract: A method for merging graphics and high dynamic range video data is disclosed. In a video receiver, a display management process uses metadata to map input video data from a first dynamic range into the dynamic range of available graphics data. The remapped video signal is blended with the graphics data to generate a video composite signal. An inverse display management process uses the metadata to map the video composite signal to an output video signal with the first dynamic range. To alleviate perceptual tone-mapping jumps during video scene changes, a metadata transformer transforms the metadata to transformed so that on a television (TV) receiver metadata values transition smoothly between consecutive scenes. The TV receiver receives the output video signal and the transformed metadata to generate video data mapped to the dynamic range of the TV's display.

Abstract: A plurality of input images in an input video signal of a wide dynamic range is received. A specific setting of global light modulation is determined based on a specific input image in the plurality of input images. The specific setting of global light modulation produces a specific dynamic range window. A plurality of input code values in the specific input image is converted to a plurality of output code values in a specific output image corresponding to the specific input image. The plurality of output code values produces the same or substantially the same luminance levels as represented by the plurality of input code values. Any other pixels in the specific input image are converted to different luminance levels in the specific output image through display management.