Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes obtaining a plurality of semantic values respectively associated with a plurality of portions within image data. The plurality of portions includes a first portion of the image data and a second portion of the image data. The method includes identifying a first one of the plurality of semantic values that satisfies a criterion. The first one of the plurality of semantic values is associated with the first portion of the image data. The method includes mapping, based on a function of a portion of the plurality of luminance values, the image data to predetermined display characteristics of the first portion of the image data within a performance threshold.

Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes identifying respective portions of the plurality of luminance values, across the see-through display, based on corresponding portions of rendered image data. The method includes modifying one or more of the respective portions of the plurality of luminance values based on a function of predetermined display characteristics associated with the rendered image data, in order to generate one or more modified portions of the plurality of luminance values. The method includes modifying the corresponding portions of the rendered image data in order to generate display data, based on the one or more modified portions of the plurality of luminance values. The method includes displaying, on the see-through display, the display data.

Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

Abstract: In accordance with some implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a plurality of light superposition characteristic values associated with ambient light from a physical environment. The plurality of light superposition characteristic values quantifies the ambient light. The method includes modifying image data in order to generate modified image data, based on a function of the plurality of light superposition characteristic values and a reference perceptual gamut. The method includes transforming the modified image data into display data based on a function of a portion of the plurality of light superposition characteristic values and a reference physical gamut that is associated with the see-through display. The method includes displaying the display data on the see-through display.

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, and a see-through display. The method includes determining a light superposition value that quantifies ambient light from a physical environment. The method includes obtaining image data that is associated with a color characteristic vector. The color characteristic vector includes a first chroma value. The method includes determining, via a color correction function, a second chroma value based on the color characteristic vector and the light superposition value. The first chroma value is different from the second chroma value. The method includes generating, from the image data, display data that is associated with the second chroma value. The method includes displaying the display data on the see-through display.

Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

Abstract: Implementations of the subject technology provide extended reality display devices that can be used on and/or off of a moving platform. Systems and methods are disclosed for separating out the motion of the moving platform from other motions of the device so that virtual content can be displayed without erroneous motions caused by the motion of the moving platform. The subject technology can provide extended reality settings on any suitable moving platform such as in a car, a watercraft, an aircraft, a train, or any other vehicle.

Abstract: Various implementations disclosed herein adjust the luminance values of an image to improve the appearance of the image on an augmented reality device. In some implementations, the luminance values of an image are adjusted so that the image can be displayed on an augmented reality device (e.g., with background luminance) such that the image will be perceived more similarly to how the image would be perceived otherwise (e.g., on a device without background luminance). In some implementations, an image is adjusted based on an estimate of human perception of luminance that is not linear.

Abstract: A method includes sensing a plurality of luminance values associated with ambient light from a physical environment. The plurality of luminance values quantifies the ambient light arriving at a see-through display. The method includes identifying respective portions of the plurality of luminance values, across the see-though display, based on corresponding portions of rendered image data. The method includes modifying one or more of the respective portions of the plurality of luminance values based on a function of predetermined display characteristics associated with the rendered image data, in order to generate one or more modified portions of the plurality of luminance values. The method includes modifying the corresponding portions of the rendered image data in order to generate display data, based on the one or more modified portions of the plurality of luminance values. The method includes displaying, on the see-through display, the display data.

Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.

Abstract: Various implementations disclosed herein adjust the luminance values of an image to improve the appearance of the image on an augmented reality device. In some implementations, the luminance values of an image are adjusted so that the image can be displayed on an augmented reality device (e.g., with background luminance) such that the image will be perceived more similarly to how the image would be perceived otherwise (e.g., on a device without background luminance). In some implementations, an image is adjusted based on an estimate of human perception of luminance that is not linear.

Abstract: According to one implementation, a system for rendering a volume includes a computing platform having a hardware processor, and a system memory storing a volume rendering software code. The hardware processor is configured to execute the volume rendering software code to receive data characterizing a volume to be rendered and to decompose the volume into a first volume portion and a second volume portion. The hardware processor is further configured to execute the volume rendering software code to perform a first tracking of a light ray in the first volume portion to determine a first interaction distance of the light ray in the first volume portion, perform a second tracking of the light ray in the second volume portion to determine a second interaction distance of the light ray in the second volume portion, and render the volume based on the shorter of the first and second interaction distances.

Abstract: According to one implementation, a system for rendering a volume includes a computing platform having a hardware processor, and a system memory storing a volume rendering software code. The hardware processor is configured to execute the volume rendering software code to receive data characterizing a volume to be rendered and to decompose the volume into a first volume portion and a second volume portion. The hardware processor is further configured to execute the volume rendering software code to perform a first tracking of a light ray in the first volume portion to determine a first interaction distance of the light ray in the first volume portion, perform a second tracking of the light ray in the second volume portion to determine a second interaction distance of the light ray in the second volume portion, and render the volume based on the shorter of the first and second interaction distances.

Abstract: There is provided a scene rendering system and method for use by such a system to perform depth buffering for subsequent scene rendering. The system includes a memory storing a depth determination software including a reduced depth set identification software module, and a hardware processor configured to execute the depth determination software. The hardware processor is configured to execute the depth determination software to determine, before rendering a scene, a depth buffer based on at least one fixed depth identified for each element of a rendering framework for the scene. The hardware processor is further configured to render the scene using the depth buffer.

Abstract: According to one exemplary implementation, a method for use by a global illumination system including a hardware processor includes identifying, using the hardware processor, a first interior vertex of multiple first interior vertices of a light path, the first interior vertices being situated within a volume having a refractive boundary. In addition, the method includes determining, using the hardware processor, a surface vertex of the light path at the refractive boundary, and determining, using the hardware processor, a linear direction from the surface vertex to a light source of the light path. The method also includes determining, using the hardware processor, one or more second interior vertices for completing the light path by constructing a path from the surface vertex to the first interior vertex, based on the linear direction, the surface vertex and the first interior vertex.

Abstract: According to one exemplary implementation, a method for use by a global illumination system including a hardware processor includes identifying, using the hardware processor, a first interior vertex of multiple first interior vertices of a light path, the first interior vertices being situated within a volume having a refractive boundary. In addition, the method includes determining, using the hardware processor, a surface vertex of the light path at the refractive boundary, and determining, using the hardware processor, a linear direction from the surface vertex to a light source of the light path. The method also includes determining, using the hardware processor, one or more second interior vertices for completing the light path by constructing a path from the surface vertex to the first interior vertex, based on the linear direction, the surface vertex and the first interior vertex.

Abstract: There is provided a scene rendering system and method for use by such a system to perform depth buffering for subsequent scene rendering. The system includes a memory storing a depth determination software including a reduced depth set identification software module, and a hardware processor configured to execute the depth determination software. The hardware processor is configured to execute the depth determination software to determine, before rendering a scene, a depth buffer based on at least one fixed depth identified for each element of a rendering framework for the scene. The hardware processor is further configured to render the scene using the depth buffer.

Abstract: The disclosure provides an approach for rendering granular media. According to one aspect of the disclosure, granular media are rendered using bidirectional point scattering distribution functions (BPSDFs). The dimensionality of BPSDFs may be reduced by making certain assumptions, such as random orientations of grains, thereby simplifying light transport for computational efficiency. To generate a BPSDF from a grain, light transport may be precomputed using a Monte Carlo simulation in which photons are shot onto the grain from all directions. The precomputed BPSDF may be used, during rendering, for describing the interactions within grains. When a light ray traced during rendering intersects proxy geometry which replaces grain geometry, the BPSDF may be evaluated to determine light transport. By repeating this process for many light rays in a Monte Carlo simulation, the light propagation through the granular medium may be determined.

Abstract: An efficient numerical method for accurately rendering translucent materials using photon beam diffusion is provided that can account for multilayer materials and directional incident and exitant effects at the surface. In an embodiment, refracted incident light is represented continuously as a photon beam instead of as discrete photons. An integration scheme for calculating a radiant exitance value at a point on the surface of the translucent material is disclosed that uses importance sampling and evaluates a radiant function at a limited number of points along the beam.

Abstract: The disclosure provides an approach for rendering granular media. According to one aspect of the disclosure, granular media are rendered using bidirectional point scattering distribution functions (BPSDFs). The dimensionality of BPSDFs may be reduced by making certain assumptions, such as random orientations of grains, thereby simplifying light transport for computational efficiency. To generate a BPSDF from a grain, light transport may be precomputed using a Monte Carlo simulation in which photons are shot onto the grain from all directions. The precomputed BPSDF may be used, during rendering, for describing the interactions within grains. When a light ray traced during rendering intersects proxy geometry which replaces grain geometry, the BPSDF may be evaluated to determine light transport. By repeating this process for many light rays in a Monte Carlo simulation, the light propagation through the granular medium may be determined.