Abstract: Various aspects of the present disclosure generally relate to wireless communication. In some aspects, a wireless communication device may predict user behavior in an extended reality (XR) application on a user equipment (UE) based at least in part on current content presented by the XR application. The wireless communication device may predict channel information for a communication link of the UE based at least in part on the predicted user behavior. The wireless communication device may adjust one or more parameters of the communication link based at least in part on the predicted channel information. Numerous other aspects are described.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for PVS over UDP for split rendering. A graphics processor may obtain, a PVS and a set of video packets. The graphics processor may determine, if a data loss associated with the PVS or the set of video packets is detected, one or more first visible primitives in the set of visible primitives that are currently affected by the data loss associated with the PVS or the set of video packets. The graphics processor may identify concealment information for the one or more first visible primitives in the set of visible primitives based on the one or more first visible primitives in a previous frame. The graphics processor may update information associated with the one or more first visible primitives based on the concealment information for the one or more first visible primitives.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.

Abstract: A client device of a split rendering graphics processing architecture, receives an encoded shading atlas for a current frame. The encoded shading atlas is characterized by slices. The client decodes the received encoded shading atlas and identifies unsuccessfully decoded slices. The client then determines whether each patch of the decoded shading atlas intersects an identified unsuccessfully decoded slice. The client determines, for each intersecting patch, whether a prior valid version of each intersecting patch is stored at the client device. The client error conceals each intersecting patch having a prior valid version stored at the client device with the corresponding prior valid version to create an error concealed atlas. The client renders the current frame using the error concealed atlas.

Abstract: Graphics processing in a client device includes receiving, as part of a vector streaming split rendering process, a bit stream encoding a sequence of shading atlases of the process. Each shading atlas includes blocks. The client decodes a particular shading atlas of the sequence of shading atlases, and determines that a particular block of the particular shading atlas was unsuccessfully decoded. The client identifies a stored block of a prior shading atlas of the sequence of shading atlases as a successfully decoded earlier version of the particular block. The client renders the particular shading atlas using the stored block instead of the particular block.

Abstract: A method of dynamically updating a feature database that contains features corresponding to a known target object includes providing an image, extracting a first set of features from within the captured image, and comparing the first set of features to the features stored in the feature database. If it is determined that the target object is present in the image then at least one of the extracted features of the first set that are not already included in the feature database are added to the feature database.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. Aspects of the present disclosure may identify a first content group and a second content group in a scene. Further, aspects of the present disclosure may determine whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. Additionally, the present disclosure may represent the first content group and the second content group based on the determination whether at least a portion of the first content group occludes or potentially occludes at least a portion of the second content group. In some aspects, the first content group may include at least some real content and the second content group includes at least some augmented content. The present disclosure may also render at least a portion of surfaces of the first content group using an occlusion material.

Abstract: Graphics processing in a client device includes receiving, as part of a vector streaming split rendering process, a bit stream encoding a sequence of shading atlases of the process. Each shading atlas includes blocks. The client decodes a particular shading atlas of the sequence of shading atlases, and determines that a particular block of the particular shading atlas was unsuccessfully decoded. The client identifies a stored block of a prior shading atlas of the sequence of shading atlases as a successfully decoded earlier version of the particular block. The client renders the particular shading atlas using the stored block instead of the particular block.

Abstract: For a scene comprising real-world objects and generated (CG) objects, the scene characterized by a scene geometry of a first time, one or more processors can generate, based on the scene geometry, shadow information for each of one or more shadows cast by a CG object of the scene on one or more real-world objects of the scene. The one or more processors can rendering and display a frame of the scene as a function of the shadow information and a scene geometry at a time of the rendering later than the first time. In some examples, the shadow information includes shadow factors and identifiers. Each shadow factor can describe a light attenuation effect of a cast shadow on a real world object surface and can be incorporated into a shading atlas of the scene. Each identifier identifies a real-world object surface of the scene affected by a shadow factor.

Abstract: Methods, systems, and devices for computer graphics are described. A device may perform a shadow rendering operation in an object-space shading pipeline for a set of potentially visible surfaces. The device may represent the potentially visible surfaces in an atlas. The device may determine a set of world-space coordinates corresponding to the one or more potentially visible surfaces and may store the set of world-space coordinates in a geometry buffer (G-buffer). The device may determine a number of shadow factors associated with the potentially visible surfaces based on a transformation of the world-space coordinates stored in the G-buffer and a set of depth values associated with each shadow caster present in a scene. The device may store the shadow factors in an atlas shadow mask and perform a shading of the potentially visible surfaces in the atlas based on the atlas shadow mask.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: The present disclosure relates to methods and apparatus for computer processing. Aspects of the present disclosure can determine at least one of a quality, latency, or capacity of a communication link for communication between a client device and a server. Aspects of the present disclosure can also determine a computational load for an application computation between the client device and the server. Moreover, aspects of the present disclosure can adjust a computational distribution for the application computation between the client device and the server based on at least one of the computational load for the application computation or the at least one of the quality, latency, or capacity of the communication link. Aspects of the present disclosure can also determine a computational capacity of at least one of the client device or the server.

Abstract: Aspects of the present disclosure provide a method for compressing a point cloud. The method includes determining a sub-division technique for the volume based on one or more numbers derived from a distribution of points in the volume, dividing the volume into a number of sub-volumes according to the sub-division technique, and determining whether each sub-volume of the sub-volumes is occupied by at least one point. The method includes generating a bit sequence for the volume comprising a control code that is based on the sub-division technique and an occupancy indicator that indicates whether or not each sub-volume is occupied by at least one point.

Abstract: An improved wireless split rendering system for displaying Extended Reality (XR) content is discussed. A rendering server and client head-mounted device (HMD) may communicate over a wireless medium, where communication control is given to a server application layer logic. This allows the server to use request pose information from the HMD only when needed for rendering, while preserving bandwidth on the wireless medium for transmitting frames of the rendered content. This reduces contention and improves channel efficiency.

Abstract: A method, an apparatus, and a computer-readable medium for wireless communication are provided. In one aspect, an example method may include determining to control a bit rate of a content encoder. The method may include generating a first number of shaded texture atlases for use in rendering a second number of frames by a second device based on the determination to control the bit rate of the content encoder. Each respective shaded texture atlas may include a respective plurality of shaded primitives. The method may include encoding, by the content encoder of the first device, a first shaded texture atlas of the first number of shaded texture atlases. The method may include transmitting, by the first device, the encoded first shaded texture atlas to the second device.

Abstract: A method, an apparatus, and a computer-readable medium for wireless communication are provided. In one aspect, an example method may include determining to control a bit rate of a content encoder. The method may include generating a first number of shaded texture atlases for use in rendering a second number of frames by a second device based on the determination to control the bit rate of the content encoder. Each respective shaded texture atlas may include a respective plurality of shaded primitives. The method may include encoding, by the content encoder of the first device, a first shaded texture atlas of the first number of shaded texture atlases. The method may include transmitting, by the first device, the encoded first shaded texture atlas to the second device.