Abstract: Systems and techniques are provided for imaging. For example, a process can include determining a direction of gaze of a user toward one or more displays, wherein the direction of gaze is based on image data obtained using one or more cameras. The process can include determining a region of the one or more displays corresponding to the direction of gaze of the user. The process can include generating one or more graphical user interface (GUI) control actions indicative of a respective configuration of a GUI associated with the one or more displays, wherein the one or more GUI control actions are based on the determined region. The process can include outputting, using the one or more displays and based on the one or more GUI control actions, the respective configuration of the GUI.

Abstract: Systems and techniques are provided for imaging. For example, a process can include determining estimated transmission power information associated with a channel between the apparatus and a computing device. The process can include obtaining one or more extended reality (XR) application parameters associated with an XR application corresponding to one or more of the apparatus or the computing device. The process can include determining, based on the estimated transmission power information and the one or more XR application parameters, a split perception configuration for balancing a perception workload of the XR application between the apparatus and the computing device.

Abstract: A device includes a memory device configured to store output data of a large language model (LLM). The device also includes one or more processors configured to obtain, from a temperature sensor, a first sensor output indicating a first temperature associated with the device. The one or more processors are configured to, based on the first temperature and first output data of the LLM, control generation of second output data by the LLM.

Abstract: Aspects presented herein relate to methods and devices for data or graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may obtain an indication of a data write for data associated with data processing. The apparatus may write, based on the indication, the data associated with the data processing to a memory address. The apparatus may receive a read request for the data including the memory address, where the read request is associated with a read with invalidate process. The apparatus may retrieve, based on the read request, the data from at least one of a first cache or at least one second memory, where the retrieval of the data is based on a timing of the indication of the data write. The apparatus may output the retrieved data from at least one of the first cache or the at least one second memory.

Abstract: Systems and techniques are described herein for displaying images. For instance, a method for displaying images is provided. The method may include obtaining image data for display at a display of a head-mounted device (HMD); determining a content-based region of interest (ROI) within the image data based on content of the image data; determining a gaze-based ROI of the image data based on gaze information; displaying, at the display, content-based-ROI image data of the content-based ROI at a first resolution; displaying, at the display, gaze-based ROI image data of the gaze-based ROI at a second resolution; and displaying, at the display, peripheral image data outside the content-based ROI and outside the ROI at a third resolution.

Abstract: Reconfigurable shared memory systems, and related processor-based systems and methods are disclosed. The reconfigurable shared memory system can be included in a processor-based system to provide memory for data storage. In exemplary aspects, the reconfigurable shared memory system not only includes the dedicated memory and the general memory (e.g., system cache memory), but also includes a reconfigurable memory. The reconfigurable memory can be configured as either part of addressable memory space of the dedicated memory if an application requires such additional dedicated memory, and/or configured as part of the addressable memory space of the general memory to provide additional memory to other clients for increased processing performance if such reconfigurable memory is not needed as part of the dedicated memory. The dedicated memory does not have to be sized to the worst-case size requirements of a given application.

Abstract: Systems and techniques are described herein for displaying images. For instance, a method for displaying images is provided. The method may include obtaining image data for display at a display of a head-mounted device (HMD); determining a content-based region of interest (ROI) within the image data based on content of the image data; determining a gaze-based ROI of the image data based on gaze information; displaying, at the display, content-based-ROI image data of the content-based ROI at a first resolution; displaying, at the display, gaze-based ROI image data of the gaze-based ROI at a second resolution; and displaying, at the display, peripheral image data outside the content-based ROI and outside the ROI at a third resolution.

Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for sparse composition. A processor obtains at least one frame including at least one component, where the at least one component includes (1) data of the at least one component and (2) metadata of the at least one component, and where the metadata includes enclosing boundary information of the at least one component. The processor predicts, based on the enclosing boundary information and pose information, a set of boundary coordinates of the at least one component. The processor adjusts, based on a display order, the predicted set of boundary coordinates of the at least one component. The processor determines whether the predicted set of boundary coordinates overlaps with at least one component boundary associated with a composition engine. The processor processes, based on the determination, the data.

Abstract: In one aspect, a wearable device a set of one or more temperature sensors configured to generate a first set of one or more temperature signals indicative of one or more skin temperatures of a user; a thermal controller configured to generate a signal indicative of a thermal mitigation level based on the set of one or more temperature signals; a set of one or more subsystems configured to perform one or more operations based on the thermal mitigation level signal, respectively; and a communication interface configured to send the thermal mitigation level signal to a companion device. In another aspect, a companion device configured to assist the wearable device in thermal management by offloading processes from the wearable device, and providing reduced data to the wearable device.

Abstract: Aspects presented herein relate to methods and devices for data or graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may configure an address range in a cache. The apparatus may also obtain a request to access data in the cache, where the request to access the data includes an address in the cache that maps to a set index in a plurality of set indexes, where an address value for the set index corresponds to a portion of the address. Further, the apparatus may select an updated address value for the set index, where the updated address value is associated with an updated address within the address range, and the updated address value corresponds to a portion of the updated address. The apparatus may also allocate the data in the request to the updated address value for the set index.

Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

Abstract: Aspects presented herein relate to methods, devices, and apparatuses for display processing. The apparatus may obtain a first intensity map associated with first luminance information for a scene. The apparatus may also configure a second intensity map based on the first intensity map and at least one coordinate frame from a perspective of a user of a device for display content associated with the scene. The apparatus may also determine whether luminance information for at least one region in the second intensity map is within a suitable luminance range for the display content associated with the scene. The apparatus may also process a set of pixels corresponding to a section in a display associated with the at least one region based on the luminance information being at least one of: within the suitable luminance range, outside of the suitable luminance range, or within an indistinguishable luminance range.

Abstract: Aspects presented herein relate to methods and devices for data or graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may obtain an indication of a data write for data associated with data processing. The apparatus may write, based on the indication, the data associated with the data processing to a memory address. The apparatus may receive a read request for the data including the memory address, where the read request is associated with a read with invalidate process. The apparatus may retrieve, based on the read request, the data from at least one of a first cache or at least one second memory, where the retrieval of the data is based on a timing of the indication of the data write. The apparatus may output the retrieved data from at least one of the first cache or the at least one second memory.

Abstract: Aspects presented herein relate to methods and devices for data or graphics processing including an apparatus, e.g., a graphics processing unit (GPU). The apparatus may configure an address range in a cache. The apparatus may also obtain a request to access data in the cache, where the request to access the data includes an address in the cache that maps to a set index in a plurality of set indexes, where an address value for the set index corresponds to a portion of the address. Further, the apparatus may select an updated address value for the set index, where the updated address value is associated with an updated address within the address range, and the updated address value corresponds to a portion of the updated address. The apparatus may also allocate the data in the request to the updated address value for the set index.

Abstract: Reconfigurable shared memory systems, and related processor-based systems and methods are disclosed. The reconfigurable shared memory system can be included in a processor-based system to provide memory for data storage. In exemplary aspects, the reconfigurable shared memory system not only includes the dedicated memory and the general memory (e.g., system cache memory), but also includes a reconfigurable memory. The reconfigurable memory can be configured as either part of addressable memory space of the dedicated memory if an application requires such additional dedicated memory, and/or configured as part of the addressable memory space of the general memory to provide additional memory to other clients for increased processing performance if such reconfigurable memory is not needed as part of the dedicated memory. The dedicated memory does not have to be sized to the worst-case size requirements of a given application.

Abstract: Aspects presented herein relate to methods, devices, and apparatuses for display processing. The apparatus may obtain a first intensity map associated with first luminance information for a scene. The apparatus may also configure a second intensity map based on the first intensity map and at least one coordinate frame from a perspective of a user of a device for display content associated with the scene. The apparatus may also determine whether luminance information for at least one region in the second intensity map is within a suitable luminance range for the display content associated with the scene. The apparatus may also process a set of pixels corresponding to a section in a display associated with the at least one region based on the luminance information being at least one of: within the suitable luminance range, outside of the suitable luminance range, or within an indistinguishable luminance range.

Abstract: Various embodiments include methods and devices for implementing a criterion aware cache replacement policy by a computing device. Embodiments may include updating a staling counter, writing a value of a local counter to a system cache in association with a location in the system cache for with data, in which the value of the local counter includes a value of the staling counter when (i.e., at the time) the associated data is written to the system cache, and using the value of the local counter of the associated data to determine whether the associated data is stale.

Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

Abstract: Media processing systems and techniques are described. A media processing system receives image data that represents an environment captured by an image sensor. The media processing system receives an indication of an object in the environment that is represented in the image data. The media processing system divides the image data into regions, including a first region and a second region. The object is represented in one of the plurality of regions. The media processing system modifies the image data to obscure the first region without obscuring the second region based on the object being represented in the one of the plurality of regions. The media processing system outputs the image data after modifying the image data. In some examples, the object is depicted in the first region and not the second region. In some examples, the object is depicted in the second region and not the first region.

Abstract: Various embodiments include methods and devices for implementing a criterion aware cache replacement policy by a computing device. Embodiments may include updating a staling counter, writing a value of a local counter to a system cache in association with a location in the system cache for with data, in which the value of the local counter includes a value of the staling counter when (i.e., at the time) the associated data is written to the system cache, and using the value of the local counter of the associated data to determine whether the associated data is stale.