Abstract: Systems, methods, and non-transitory media are provided for low-power visual tracking systems. An example method can include receiving one or more images captured by each image sensor system from a set of image sensor systems on a first device, the one or more images capturing a set of patterns on a second device, wherein the first device has lower power requirements than the second device, the set of patterns having a predetermined configuration on the second device; determining, from the one or more images captured by each image sensor system, a set of pixels corresponding to the set of patterns on the second device; determining, based on the set of pixels corresponding to the set of patterns, a location and relative pose in space of each pattern; and determining, based on the location and relative pose of each pattern, a pose of the first device relative to the second device.

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for performing mathematical operations on processing units based on data in the modulo space. An example method includes receiving a binary-space input to process (e.g., using a neural network or other processing system). The binary-space input is converted into a modulo-space input based on a set of coprimes defined for executing operations in a modulo space. A modulo-space result is generated through one or more modulo-space multiply-and-accumulate (MAC) units based on the modulo-space input. The modulo-space result is converted into a binary-space result, and the binary-space result is output.

Abstract: In some aspects, a user device may detect an authentication event associated with unlocking the user device. The user device may determine, based at least in part on sensor data from a sensor of the user device, an environmental context of the user device. The user device may select, from a plurality of authentication functions of the user device, an authentication function based at least in part on the environmental context of the user device. The user device may activate an authentication component that is associated with the authentication function to authenticate a user in association with unlocking the user device. Numerous other aspects are provided.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: An image sensor device includes two or more image sensor arrays (or two or more regions of an image sensor array) and a low-power processor in a same package for capturing two or more images of an object, such as an eye of a user, using light in two or more wavelength bands, such as visible band, near-infrared band, and short-wave infrared band. The image sensor device includes one or more lens assemblies and/or a beam splitter for forming an image of the object on each of the two or more image sensor arrays. The image sensor device also includes one or more filters configured to select light from multiple wavelength bands for imaging by the respective image sensor arrays.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: Various aspects of the present disclosure generally relate to a sensor module. In some aspects, a sensor module may include a collar configured to be attached to a camera module for a user device. The collar may include a first opening that is configured to align with an aperture of a camera of the camera module, and a second opening. The sensor module may include a sensor embedded in the collar. The sensor may be aligned with the second opening of the collar. Numerous other aspects are provided.

Abstract: In some aspects, a user device may receive, from a vision sensor of a user device, first image data associated with a first set of images. The user device may determine, using an image processing model, that a set of images depict a particular type of eye activity of an eye of a user. The user device may cause, based at least in part on determining that the first set of images depict the particular type of eye activity, a power level of a camera of the user device to be reduced.

Abstract: Various aspects of the present disclosure generally relate to a sensor module. In some aspects, an image sensor module may include an array of photon sensors configured to output a first set of signals corresponding to a set of photon sensors of the array of photon sensors. The set of photon sensors may include a row of photon sensors, or a column of photon sensors, of the array of photon sensors. The image sensor module may include a plurality of data selector components configured to receive the first set of signals and output a second set of signals corresponding to a subset of the set of photon sensors.

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for performing mathematical operations on processing units based on data in the modulo space. An example method includes receiving a binary-space input to process (e.g., using a neural network or other processing system). The binary-space input is converted into a modulo-space input based on a set of coprimes defined for executing operations in a modulo space. A modulo-space result is generated through one or more modulo-space multiply-and-accumulate (MAC) units based on the modulo-space input. The modulo-space result is converted into a binary-space result, and the binary-space result is output.

Abstract: Various aspects of the present disclosure generally relate to optical character detection. In some aspects, a user device may receive, from a vision sensor, a first image that is associated with a first optical character image. The user device may determine, using an image processing model, that the first image depicts the first optical character image. The user device may cause, based at least in part on determining that the first image depicts the first optical character image, a camera to capture a second image that is associated with a second optical character image. The user device may perform an action associated with the second image. Numerous other aspects are provided.

Abstract: In some aspects, a device may detect that an object is contacting a display of the device. The device may illuminate, based at least in part on detecting that the object is contacting the display, a plurality of pixel regions of the display. The plurality of pixel regions may be illuminated sequentially. The device may obtain, using one or more photosensors, a set of data relating to light that is reflected from at least a portion of the object based at least in part on illuminating the plurality of pixel regions. The set of data may include respective data for each sequential illumination of the plurality of pixel regions. The device may generate an image of at least the portion of the object based at least in part on the set of data. Numerous other aspects are described.

Abstract: In some aspects, a device may detect that an object is contacting a display of the device. The device may illuminate, based at least in part on detecting that the object is contacting the display, a plurality of pixel regions of the display. The plurality of pixel regions may be illuminated sequentially. The device may obtain, using one or more photosensors, a set of data relating to light that is reflected from at least a portion of the object based at least in part on illuminating the plurality of pixel regions. The set of data may include respective data for each sequential illumination of the plurality of pixel regions. The device may generate an image of at least the portion of the object based at least in part on the set of data. Numerous other aspects are described.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: Certain aspects of the present disclosure provide a method for compressing an activation function, comprising: determining a plurality of difference values based on a difference between a target activation function and a reference activation function over a range of input values; determining a difference function based on the plurality of difference values; and performing an activation on input data using the reference activation function and a difference value based on the difference function.

Abstract: An image sensor device includes two or more image sensor arrays (or two or more regions of an image sensor array) and a low-power processor in a same package for capturing two or more images of an object, such as an eye of a user, using light in two or more wavelength bands, such as visible band, near-infrared band, and short-wave infrared band. The image sensor device includes one or more lens assemblies and/or a beam splitter for forming an image of the object on each of the two or more image sensor arrays. The image sensor device also includes one or more filters configured to select light from multiple wavelength bands for imaging by the respective image sensor arrays.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.

Abstract: A connected oven, including a set of in-cavity sensors and a processor configured to automatically identify foodstuff within the cooking cavity, based on the sensor measurements; and automatically operate the heating element based on the foodstuff identity.