Abstract: An apparatus of operating a neural network is configured to compress one or more of activations or weights in one or more layer of the neural network. The activations and/or weights may be compressed based on a compression ratio or a system event. The system event may be a bandwidth condition, a power condition, a debug condition, a thermal condition or the like. The apparatus may operate the neural network to compute an inference based on the compressed activations or the compressed weights.

Abstract: Systems, methods, and non-transitory media are provided for predictive camera initialization. An example method can include obtain, from a first image capture device, image data depicting a scene; classify the scene based on the image data; based on the classification of the scene, predict a camera use event; and based on the predicted camera use event, adjust a power mode of at least one of the first image capture device and a second image capture device.

Abstract: Disclosed are systems, apparatuses, processes, and computer-readable media to provide haptic feedback in electronic devices based on contextual awareness. According to some aspects, a method of controlling haptic feedback includes obtaining environmental information indicative of an environment of a computing device from at least one sensor and determining a context associated with the mobile device based on the environmental information. The method may include determining haptic feedback for output by the mobile device based on the context.

Abstract: Systems, methods, and non-transitory media are provided for adjusting camera settings based on event data. An example method can include obtaining, via an image capture device of a mobile device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe; and based on the match, adjusting one or more settings of the image capture device.

Abstract: Systems, methods, and non-transitory media are provided for predictive camera initialization. An example method can include obtain, from a first image capture device, image data depicting a scene; classify the scene based on the image data; based on the classification of the scene, predict a camera use event; and based on the predicted camera use event, adjust a power mode of at least one of the first image capture device and a second image capture device.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: Systems, methods, and non-transitory media are provided for adjusting camera settings based on event data. An example method can include obtaining, via an image capture device of a mobile device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe; and based on the match, adjusting one or more settings of the image capture device.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

Abstract: Systems, methods, and computer-readable media are provided for providing pose estimation in extended reality systems. An example method can include tracking, in a lower-power processing mode using a set of lower-power circuit elements on an integrated circuit, a position and orientation of a computing device during a lower-power processing period, the set of lower-power circuit elements including a static random-access memory (SRAM); suspending, based on a triggering event, the tracking in the lower-power processing mode; initiating a higher-power processing mode for tracking the position and orientation of the computing device during a higher-power processing period; and tracking, in the higher-power processing mode using a set of higher-power circuit elements on the integrated circuit and a dynamic random-access memory (DRAM), the position and orientation of the computing device during the higher-power processing period.

Abstract: Techniques and systems are provided for capturing self-images in extended reality environments. In some examples, a system captures a pose of a user of an extended reality system. The pose of the user includes a location of the user within a real-world environment associated with the extended reality system. The system also generates a digital representation of the user. The digital representation of the user reflects the pose of the user. The system further captures one or more frames of the real-world environment and overlays the digital representation of the user onto the one or more frames of the real-world environment.

Abstract: Systems, methods, and non-transitory media are provided for generating obfuscated control interfaces for extended reality (XR) experiences. An example method can include determining a pose of an XR device within a mapped scene of a physical environment associated with the XR device; rendering a virtual control interface within the mapped scene according to a configuration including a first size, a first position relative to the pose of the XR device, a first ordering of input elements, and/or a first number of input elements; and adjusting the configuration of the virtual control interface based on a privacy characteristic of data associated with the virtual control interface and/or characteristics of the physical environment associated with the XR device, the adjusted configuration including a second size, a second ordering of input elements, a second number of input elements, and/or a second position relative to the pose of the XR device and/or first position.

Abstract: Systems, methods, and non-transitory media are provided for a vehicle and mobile device interface for vehicle occupant assistance. An example method can include determining, based on one or more images of an interior portion of a vehicle, a pose of a mobile device relative to a coordinate system of the vehicle; determine a state of an occupant of the vehicle; and send, to the vehicle, data indicating the state of the occupant and the pose of the mobile device relative to the coordinate system of the vehicle.

Abstract: Systems and techniques are provided for processing one or more frames. For example, a process can include obtaining a first plurality of frames associated with a first settings domain from an image capture system, wherein the first plurality of frames is captured prior to obtaining a capture input. The process can include obtaining a reference frame associated with a second settings domain from the image capture system, wherein the reference frame is captured proximate to obtaining the capture input. The process can include obtaining a second plurality of frames associated with the second settings domain from the image capture system, wherein the second plurality of frames is captured after the reference frame. The process can include, based on the reference frame, transforming at least a portion of the first plurality of frames to generate a transformed plurality of frames associated with the second settings domain.

Abstract: Systems and techniques are described for imaging. An imaging system includes an image sensor with a plurality of photodetectors, grouped into a first group of photodetectors and a second group of photodetectors. The imaging system can reset its image sensor. The imaging system exposes its image sensor to light from a scene. The plurality of photodetectors convert the light into charge. The imaging system stores analog photodetector signals corresponding to the charge from each the photodetectors. The imaging system reads first digital pixel data from a first subset of the analog photodetector signals corresponding to the first group of photodetectors without reading second digital pixel data from a second subset of the analog photodetector signals corresponding to the second group of photodetectors. The imaging system generates an image of the scene using the first digital pixel data.

Abstract: Systems, methods, and non-transitory media are provided for extended reality (XR) control of smart devices. An example method can include generating, by a first computing device, a cryptographic key; outputting, by the first computing device, a pattern that encodes the cryptographic key, the pattern including a visual pattern, an audio pattern, and/or a light pattern; receiving, by the first computing device from a second computing device, a signed message including a command to modify an operation of the first computing device; determining, by the first computing device, whether the signed message is signed with the cryptographic key encoded in the pattern; and based on a determination that the signed message is signed with the cryptographic key encoded in the pattern, modifying the operation of the first computing device according to the command in the signed message.

Abstract: Systems, methods, and non-transitory media are provided for predictive camera initialization. An example method can include obtain, from a first image capture device, image data depicting a scene; classify the scene based on the image data; based on the classification of the scene, predict a camera use event; and based on the predicted camera use event, adjust a power mode of at least one of the first image capture device and a second image capture device.

Abstract: Systems, methods, and non-transitory media are provided for generating private control interfaces for extended reality (XR) experiences. An example method can include determining a pose of an XR device within a mapped scene of a physical environment associated with the XR device; detecting a private region in the physical environment and a location of the private region relative to the pose of the XR device, the private region including an area estimated to be within a field of view (FOV) of a user of the XR device and out of a FOV of a person in the physical environment, a recording device in the physical environment, and/or an object in the physical environment; based on the pose of the XR device and the location of the private region, mapping a virtual private control interface to the private region; and rendering the virtual private control interface within the private region.

Abstract: Systems, methods, and non-transitory media are provided for adjusting camera settings based on event data. An example method can include obtaining, via an image capture device of a mobile device, an image depicting at least a portion of an environment; determining a match between one or more visual features extracted from the image and one or more visual features associated with a keyframe; and based on the match, adjusting one or more settings of the image capture device.