Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for sampler feedback for texture space shading. A processor may assign each shading element in a set of shading elements associated with a geometry unit to a corresponding shading element group in a set of shading element groups. The processor may identify whether each shading element is a visible shading element. The processor may calculate a group offset value for each shading element group in the set of shading element groups based on a number of visible shading elements in the set of shading elements. The processor may calculate an element offset value for each shading element based on a number of visible shading elements. The processor may allocate, based on the element offset value and the group offset value, texture memory to the visible shading elements.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a dicing oracle for texture space shading. A processor obtains an indication of a UV parameterization for each of a set of geometry units and a target number of pixels per region of the UV parameterization, where the UV parameterization includes a first set of UV coordinates for an object space. The processor renders the set of geometry units in order to obtain a second set of UV coordinates for a screen space and a set of derivatives for the second set of UV coordinates. The processor calculates a resolution for a mip region map based on the set of derivatives and the target number of pixels per region. The processor outputs an indication of the calculated resolution.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: Example in-band delay measurement techniques are described. An example first computing device transmits, to a second computing device, a first data packet, the first data packet including a first time indicator and at least one header extension element. The at least one header extension element includes a header extension element header, the header extension element header having a length of at least one byte. The first computing device receives, from the second computing device, a second data packet, the second data packet including a second time indicator. The first computing device determines a data packet delay associated with the first data packet based on the first time indicator and the second time indicator and transmits an indication of the data packet delay to at least one of the second computing device or a third computing device.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a split-compute compiler and game engine. A processor may obtain an executable for an application including a first set of application functions associated with the UE and a second set of application functions associated with a computing device that is different from the UE. The processor may obtain an estimated quality of a link between the UE and the computing device. The processor may obtain, based on the estimated quality of the link, a split-compute configuration between the first set of application functions and the second set of application functions. The processor may output an indication of the split-compute configuration.

Abstract: Various aspects of the present disclosure generally relate to wireless communication. In some aspects, a wireless communication device may predict user behavior in an extended reality (XR) application on a user equipment (UE) based at least in part on current content presented by the XR application. The wireless communication device may predict channel information for a communication link of the UE based at least in part on the predicted user behavior. The wireless communication device may adjust one or more parameters of the communication link based at least in part on the predicted channel information. Numerous other aspects are described.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for a mesh GPU codec for real-time streaming. A graphics processor may obtain an indication of a compressed representation of a topology associated with at least one generalized triangle strip associated with a subset of triangles in a set of triangles. The graphics processor may obtain an intermediate representation of the topology associated with the at least one generalized triangle strip by a decompression of the compressed representation. The graphics processor may obtain a sequence of indices based on the intermediate representation of the topology associated with the at least one generalized triangle strip. The graphics processor may compute at least one set of offsets based on the intermediate representation. The graphics processor may reconstruct the set of triangles based on the sequence of indices and the at least one set of offsets.

Abstract: Extended reality (XR) management systems and techniques are described. In some examples, an XR management system receives sensor data from an XR interface device having at least one sensor. The XR management system generates, based on the receipt of the sensor data from the XR interface device, processing instructions for an XR processing device to process the sensor data to generate XR content. The XR management system sends the sensor data and the processing instructions to the XR processing device. The XR management system receives the XR content from the XR processing device. The XR management system generates layer content. The XR management system sends the XR content and the layer content to the XR interface device to cause the XR interface device to output the XR content and the layer content in a layered arrangement.

Abstract: Various aspects of the present disclosure generally relate to wireless communication. In some aspects, a wireless communication device may predict user behavior in an extended reality (XR) application on a user equipment (UE) based at least in part on current content presented by the XR application. The wireless communication device may predict channel information for a communication link of the UE based at least in part on the predicted user behavior. The wireless communication device may adjust one or more parameters of the communication link based at least in part on the predicted channel information. Numerous other aspects are described.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for PVS over UDP for split rendering. A graphics processor may obtain, a PVS and a set of video packets. The graphics processor may determine, if a data loss associated with the PVS or the set of video packets is detected, one or more first visible primitives in the set of visible primitives that are currently affected by the data loss associated with the PVS or the set of video packets. The graphics processor may identify concealment information for the one or more first visible primitives in the set of visible primitives based on the one or more first visible primitives in a previous frame. The graphics processor may update information associated with the one or more first visible primitives based on the concealment information for the one or more first visible primitives.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.

Abstract: A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.

Abstract: Graphics processing in a client device includes receiving, as part of a vector streaming split rendering process, a bit stream encoding a sequence of shading atlases of the process. Each shading atlas includes blocks. The client decodes a particular shading atlas of the sequence of shading atlases, and determines that a particular block of the particular shading atlas was unsuccessfully decoded. The client identifies a stored block of a prior shading atlas of the sequence of shading atlases as a successfully decoded earlier version of the particular block. The client renders the particular shading atlas using the stored block instead of the particular block.

Abstract: A method of dynamically updating a feature database that contains features corresponding to a known target object includes providing an image, extracting a first set of features from within the captured image, and comparing the first set of features to the features stored in the feature database. If it is determined that the target object is present in the image then at least one of the extracted features of the first set that are not already included in the feature database are added to the feature database.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: For a scene comprising real-world objects and generated (CG) objects, the scene characterized by a scene geometry of a first time, one or more processors can generate, based on the scene geometry, shadow information for each of one or more shadows cast by a CG object of the scene on one or more real-world objects of the scene. The one or more processors can rendering and display a frame of the scene as a function of the shadow information and a scene geometry at a time of the rendering later than the first time. In some examples, the shadow information includes shadow factors and identifiers. Each shadow factor can describe a light attenuation effect of a cast shadow on a real world object surface and can be incorporated into a shading atlas of the scene. Each identifier identifies a real-world object surface of the scene affected by a shadow factor.