Abstract: Peripheral-vision expanded images are streamed to a video streaming client. The peripheral-vision expanded images are generated from source images in reference to view directions of the viewer at respective time points. View direction data is collected and received in real time while the viewer is viewing display images derived from the peripheral-vision expanded images. A second peripheral-vision expanded image is generated from a second source image in reference to a second view direction of the viewer at a second time point. The second peripheral-vision expanded image has a focal-vision image portion covering the second view direction of the viewer and a peripheral-vision image portion outside the focal-vision image portion. The second peripheral-vision expanded image is transmitted to the video streaming client.

Abstract: Bordering pixels delineating a texture hole region in an image are identified. Depth values of the bordering pixels are recorded. The depth values are automatically clustered into two depth value clusters with a depth value threshold separating the two depth value clusters. A subset of bordering background pixels is identified in the bordering pixels as those with depth values in one of the two depth value clusters that is declared as a background depth value cluster. The subset of bordering background pixels is used to predict texture hole pixel values in the texture hole region based on multiple candidate prediction directions. Quality indicator values are computed for the multiple candidate prediction directions and used to select a specific candidate prediction direction for filling in final texture hole pixel values in the texture hole region of the image.

Abstract: Techniques for driving a dual modulation display include generating backlight drive signals to drive individually-controllable illumination sources. The illumination sources emit first light onto a light conversion layer. The light conversion layer converts the first light into second light. The light conversion layer can include quantum dots or phosphor materials. Modulation drive signals are generated to determine transmission of the second light through individual subpixels of the display. These modulation drive signals can be adjusted based on one or more light field simulations. The light field simulations can include: (i) a color shift for a pixel based on a point spread function of the illumination sources; (ii) binning difference of individual illumination sources; (iii) temperature dependence of display components on performance; or (iv) combinations thereof.

Abstract: A target view to a 3D scene depicted by a multiview image is determined. The multiview image comprises multiple sampled views. Each sampled view comprises multiple texture images and multiple depth images in multiple image layers. The target view is used to select, from the multiple sampled views of the multiview image, sampled views. A texture image and a depth image for each sampled view in the selected sampled views are encoded into a multiview video signal to be transmitted to a downstream device.

Abstract: At a first time point, a first light capturing device at a first spatial location in a three-dimensional (3D) space captures first light rays from light sources located at designated spatial locations on a viewer device in the 3D space. At the first time point, a second light capturing device at a second spatial location in the 3D space captures second light rays from the light sources located at the designated spatial locations on the viewer device in the 3D space. Based on the first light rays captured by the first light capturing device and the second light rays captured by the second light capturing device, at least one of a spatial position and a spatial direction, at the first time point, of the viewer device is determined.

Abstract: An overall displacement tolerance applicable to each pixel tile in a plurality of pixel tiles to be used as parts of an image rendering surface is determined. Each pixel tile in the plurality of pixel tiles comprises a plurality of sub-pixels. Random displacements are generated in each pixel tile in the plurality of pixel tiles based on the overall displacement tolerance. The plurality of image rendering tiles with the random displacements are combined into the image rendering surface.

Abstract: A handheld imaging device has a data receiver that is configured to receive reference encoded image data. The data includes reference code values, which are encoded by an external coding system. The reference code values represent reference gray levels, which are being selected using a reference grayscale display function that is based on perceptual non-linearity of human vision adapted at different light levels to spatial frequencies. The imaging device also has a data converter that is configured to access a code mapping between the reference code values and device-specific code values of the imaging device. The device-specific code values are configured to produce gray levels that are specific to the imaging device. Based on the code mapping, the data converter is configured to transcode the reference encoded image data into device-specific image data, which is encoded with the device-specific code values.

Abstract: Techniques for driving a dual modulation display include generating backlight drive signals to drive individually-controllable illumination sources. The illumination sources emit first light onto a light conversion layer. The light conversion layer converts the first light into second light. The light conversion layer can include quantum dots or phosphor materials. Modulation drive signals are generated to determine transmission of the second light through individual subpixels of the display. These modulation drive signals can be adjusted based on one or more light field simulations. The light field simulations can include: (i) a color shift for a pixel based on a point spread function of the illumination sources; (ii) binning difference of individual illumination sources; (iii) temperature dependence of display components on performance; or (iv) combinations thereof.

Abstract: A target view to a 3D scene depicted by a multiview image is determined. The multiview image comprises multiple sampled views. Each sampled view comprises multiple texture images and multiple depth images in multiple image layers. The target view is used to select, from the multiple sampled views of the multiview image, sampled views. A texture image and a depth image for each sampled view in the selected sampled views are encoded into a multiview video signal to be transmitted to a downstream device.

Abstract: Peripheral-vision expanded images are streamed to a video streaming client. The peripheral-vision expanded images are generated from source images in reference to view directions of the viewer at respective time points. View direction data is collected and received in real time while the viewer is viewing display images derived from the peripheral-vision expanded images. A second peripheral-vision expanded image is generated from a second source image in reference to a second view direction of the viewer at a second time point. The second peripheral-vision expanded image has a focal-vision image portion covering the second view direction of the viewer and a peripheral-vision image portion outside the focal-vision image portion. The second peripheral-vision expanded image is transmitted to the video streaming client.

Abstract: A target view to a 3D scene depicted by a multiview image is determined. The multiview image comprising sampled views at sampled view positions distributed throughout a viewing volume. Each sampled view in the sampled views comprises a wide-field-of-view (WFOV) image and a WFOV depth map as seen from a respective sampled view position in the sampled view positions. The target view is used to select, from the sampled views, a set of sampled views. A display image is caused to be rendered on a display of a wearable device. The display image is generated based on a WFOV image and a WFOV depth map for each sampled view in the set of sampled views.

Abstract: An input media signal encoded with a portion of image data to be rendered with a target display device is received. It is determined, based on the portion of image data, whether a first power profile is to be applied to rendering the portion of image data with the target display device. In response to determining, based on the portion of image data, that the first power profile is not to be applied to rendering the portion of image data with the target display device, a second power profile is applied to rendering the portion of image data with the target display device.

Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Abstract: Techniques for high dynamic range image processing are presented. Base layer data, first checksum parameter, and residual ratio data for a high dynamic range (HDR) image are each received. A second checksum parameter is computed for the base layer data based upon the first SOF after the last APP11 marker segment and includes all following bytes up to and including the EOI marker. The first and second checksum parameters are compared to determine if base layer has been altered.

Abstract: A target view to a 3D scene depicted by a multiview image is determined. The multiview image comprising sampled views at sampled view positions distributed throughout a viewing volume. Each sampled view in the sampled views comprises a wide-field-of-view (WFOV) image and a WFOV depth map as seen from a respective sampled view position in the sampled view positions. The target view is used to select, from the sampled views, a set of sampled views. A display image is caused to be rendered on a display of a wearable device. The display image is generated based on a WFOV image and a WFOV depth map for each sampled view in the set of sampled views.

Abstract: Techniques for driving a dual modulation display include generating backlight drive signals to drive individually-controllable illumination sources. The illumination sources emit first light onto a light conversion layer. The light conversion layer converts the first light, such as blue or ultraviolet light, into second light, such as white light. The light conversion layer can include quantum dot materials. Liquid crystal display (LCD) modulation drive signals are generated to determine transmission of the second light through individual color subpixels of the display. These LCD modulation drive signals can be adjusted based on one or more light field simulations to account for non-uniform, spatial color shifts. Alternatively, one or more light field simulations based on a uniformity assumption determine intermediate LCD modulation drive signals. A compensation field simulation, using backlight drive signals, is then used to adjust the intermediate LCD modulation drive signal for color correction.

Abstract: A display system comprises light sources configured to emit first light with a first spectral power distribution; light regeneration layers configured to be stimulated by the first light and to convert at least a portion of the first light and recycled light into second light, the second light comprising (a) primary spectral components that correspond to primary colors and (b) secondary spectral components that do not correspond to the primary colors; and notch filter layers configured to receive a portion of the second light and to filter out the secondary spectral components from the portion of the second light. The portion of the second light can be directed to a viewer of the display system and configured to render images viewable to the viewer.

Abstract: Techniques are provided to encode and decode image data comprising a tone mapped (TM) image with HDR reconstruction data in the form of luminance ratios and color residual values. In an example embodiment, luminance ratio values and residual values in color channels of a color space are generated on an individual pixel basis based on a high dynamic range (HDR) image and a derivative tone-mapped (TM) image that comprises one or more color alterations that would not be recoverable from the TM image with a luminance ratio image. The TM image with HDR reconstruction data derived from the luminance ratio values and the color-channel residual values may be outputted in an image file to a downstream device, for example, for decoding, rendering, and/or storing. The image file may be decoded to generate a restored HDR image free of the color alterations.

Abstract: A target view to a 3D scene depicted by a multiview image is determined. The multiview image comprising sampled views at sampled view positions distributed throughout a viewing volume. Each sampled view in the sampled views comprises a wide-field-of-view (WFOV) image and a WFOV depth map as seen from a respective sampled view position in the sampled view positions. The target view is used to select, from the sampled views, a set of sampled views. A display image is caused to be rendered on a display of a wearable device. The display image is generated based on a WFOV image and a WFOV depth map for each sampled view in the set of sampled views.

Abstract: A display system comprises light sources configured to emit first light with a first spectral power distribution; light regeneration layers configured to be stimulated by the first light and to convert at least a portion of the first light and recycled light into second light, the second light comprising (a) primary spectral components that correspond to primary colors and (b) secondary spectral components that do not correspond to the primary colors; and notch filter layers configured to receive a portion of the second light and to filter out the secondary spectral components from the portion of the second light. The portion of the second light can be directed to a viewer of the display system and configured to render images viewable to the viewer.