Abstract: Aspects presented herein relate to methods and devices for graphics processing including an apparatus, e.g., a GPU or a DPU. The apparatus may obtain at least one image in a set of images corresponding to a scene associated with the graphics processing. The apparatus may also perform a non-linear foveated compression process on the at least one image, where the non-linear foveated compression process corresponds to a continuous non-linear compression for a portion of the at least one image. The apparatus may also transmit the at least one image after the non-linear foveated compression process, such that the transmitted at least one image corresponds to at least one compressed image.

Abstract: Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

Abstract: The present disclosure relates to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may process at least one frame including frame content associated with a grid including a plurality of grid sections, each of a plurality of portions of the frame content being aligned with at least a portion of at least one of the plurality of grid sections. The apparatus may also shift the frame content with respect to the grid, such that at least one portion of the plurality of portions of the frame content is aligned with at least a portion of at least one distinct grid section of the plurality of grid sections. Additionally, the apparatus may store the shifted frame content including the at least one portion of the frame content that is aligned with at least a portion of the at least one distinct grid section.

Abstract: The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.

Abstract: A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

Abstract: A frame processor may generate a mask based on one or more static regions of a first set of frames of a plurality of previous frame and adjust the mask to at least one of determine alpha data or conceal distorted content associated with the one or more static regions of the first set of frames. The distorted content may be caused by extrapolation of a frame from a second set of frames of the plurality of previous frames. The frame processor may generate a composite frame based on application of at least one of the mask or the alpha data to a previous frame of the plurality of frames, and application of the previous frame based on the at least one of the mask or the alpha data to the frame extrapolated from the second set of frames of the plurality of previous frames.

Abstract: The present disclosure relates to methods and devices for graphics processing including an apparatus, e.g., a GPU. The apparatus may process at least one frame including frame content associated with a grid including a plurality of grid sections, each of a plurality of portions of the frame content being aligned with at least a portion of at least one of the plurality of grid sections. The apparatus may also shift the frame content with respect to the grid, such that at least one portion of the plurality of portions of the frame content is aligned with at least a portion of at least one distinct grid section of the plurality of grid sections. Additionally, the apparatus may store the shifted frame content including the at least one portion of the frame content that is aligned with at least a portion of the at least one distinct grid section.

Abstract: The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.

Abstract: The present disclosure relates to methods and devices for image or frame processing including an apparatus, e.g., a GPU. In some aspects, the apparatus may identify a discontinuity between at least one first region of a first frame and at least one second region of a second frame, the at least one first region corresponding to the at least one second region. The apparatus may also determine whether the discontinuity between the at least one first region and the at least one second region is greater than or equal to a motion estimation threshold. The apparatus may also skip a motion estimation for the at least one first region and the at least one second region when the discontinuity between the at least one first region and the at least one second region is greater than or equal to the motion estimation threshold.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Abstract: Example techniques are described for generating graphics content by obtaining a rendering command for a frame of the graphics content, obtaining an eye position of a user after obtaining the rendering command, determining a foveation parameter for a region of the graphics content based on the eye position; and rendering a tile, of the frame, corresponding to the region of the graphics content using the foveation parameter and the rendering command.

Abstract: Example techniques are described for generating graphics content by assigning a first region of the graphics content to a first tile, assigning a second region of the graphics content to a second tile, determining, at the first tile and at a first resolution, a first set of samples of the graphics content for each pixel of multiple pixels associated with the first region, determining, at the second tile and at a second resolution that is lower than the first resolution, a second set of samples of the graphics content for each pixel of multiple pixels associated with the second region, downsampling the first set of samples into a combined set of samples, preserving samples of the second set of samples to generate a third set of samples with preserved samples, storing the combined set of samples, and storing the third set of samples with preserved samples.

Abstract: Example techniques are described for generating graphics content by obtaining a rendering command for a first frame of the graphics content, rendering a full frame based on the rendering command for the first frame, storing the full frame in a buffer, obtaining a rendering command for a second frame of the graphics content, obtaining an eye position of a user, rendering a partial frame based on the rendering command for the second frame and the eye position of the user, obtaining the full frame from the buffer, and outputting the second frame, wherein the second frame is based on the full frame and the partial frame.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Abstract: The present disclosure relates to methods and devices for display processing. The device can receive a first image including a plurality of first pixels. Each of the first pixels can include a first red, green, blue (RGB) color value. The device can also determine an RGB adjustment value based on a lens correction value. Additionally, the device can determine a second RGB color value for each first pixel based on the determined RGB adjustment value. The device can also generate a second image including a plurality of second pixels, where each of the second pixels includes a determined second RGB color value. Moreover, the device can separate at least one of a red color value, green color value, or blue color value of the RGB color value and adjust at least one of a red color value or a blue color value based on the lens correction value.

Abstract: Example techniques are described for generating graphics content by obtaining a rendering command for a first frame of the graphics content, rendering a full frame based on the rendering command for the first frame, storing the full frame in a buffer, obtaining a rendering command for a second frame of the graphics content, obtaining an eye position of a user, rendering a partial frame based on the rendering command for the second frame and the eye position of the user, obtaining the full frame from the buffer, and outputting the second frame, wherein the second frame is based on the full frame and the partial frame.

Abstract: This disclosure describes examples for foveated rendering. A graphics processing unit (GPU) may render image content for portions of an image at different sizes such as at sizes smaller than the size of the portions, and store the smaller-sized image content in system memory. The GPU or some other processing circuitry may retrieve the smaller-sized image content from the system memory, and perform resizing operations to resize the image content to its actual size.

Abstract: The present disclosure relates to methods and apparatus of operation of a graphics processing unit (GPU). The apparatus can write, for each tile in a set of tiles in a tile memory, clear color information to a buffer corresponding to the tile. Additionally, the apparatus can render at least one tile in the set of tiles to a system memory. In some aspects, the at least one tile can include additional information other than the clear color information. The apparatus can also write, for the at least one tile that includes the additional information, information associated with the additional information to the buffer corresponding to the tile. Further, the apparatus can generate, for each tile in the set of tiles, visibility information for the tile. In some aspects, the visibility information can include information regarding whether the tile includes visible draw calls.

Abstract: The present disclosure relates to methods and devices for display processing. The device can receive a first image including a plurality of first pixels. Each of the first pixels can include a first red, green, blue (RGB) color value. The device can also determine an RGB adjustment value based on a lens correction value. Additionally, the device can determine a second RGB color value for each first pixel based on the determined RGB adjustment value. The device can also generate a second image including a plurality of second pixels, where each of the second pixels includes a determined second RGB color value. Moreover, the device can separate at least one of a red color value, green color value, or blue color value of the RGB color value and adjust at least one of a red color value or a blue color value based on the lens correction value.

Abstract: The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.