Abstract: The disclosed devices and methods provide beamforming for a head-worn microphone array that can adapt to changes in the user's head position/orientation. The microphone array may be part of a head-worn computing device, which can be configured to automatically detect a direction for the beamforming based on computer-assisted recognition of a conversation with a participant. After the participant is identified, the beamforming can automatically steer the sensitivity of the microphone array towards the participant regardless of the position of the head user to improve a quality of the captured audio without constraining movement of a user. The improved audio may be used to aid in a user's hearing of the conversation, aid an augmented reality application corresponding to the conversation, and/or provide a degree of privacy by limiting sensitivity to participants in the conversation.

Abstract: Systems and techniques are described for generating a color image by computationally combining chromatically undersampled and shifted information present in multiple component image frames captured via a sparse color filter array that includes a minority of wavelength-filtered picture elements and a remaining majority of panchromatic picture elements. A burst capture is initiated of multiple image frames via a color filter array comprising a plurality of subunits, each subunit including a minority of one or more wavelength-filtered adjacent pixels and a majority of remaining panchromatic pixels. Each of the multiple image frames is processed to generate a resulting color image.

Abstract: A non-transitory computer-readable storage medium can comprise instructions stored thereon. When executed by at least one processor, the instructions can be configured to cause a mobile computing device to receive, from a companion device, multiple files, each of the multiple files including at least media content, a trigger condition, and an action to be performed upon satisfaction of the trigger condition. The action included in at least one of the files can include playing media content from another one of the multiple files. The instructions can be further configured to cause the mobile computing device to play the media content included in at least one of the multiple files, receive at least one additional file from the companion device, erase at least one of the multiple files, and play media content included in the at least one additional file.

Abstract: A method including retrieving a set of first ultra-wide band (UWB) data representing locations in a physical space and device locations in the physical space, the first UWB data representing the locations being tagged as associated with a device, generating a set of first coordinates based on the set of first UWB data, generating second UWB data representing a current location of the UWB tag device in the physical space, generating a second coordinate based on the second UWB data, generating a tiled set of coordinates by partitioning a plane associated with the physical space based on the set of first coordinates and the second coordinate, determining whether the UWB tag device is proximate to a tagged coordinate in the tiled set of coordinates, and in response to determining the UWB tag device is proximate to a tagged coordinate, initiating an action by the device associated with the tagged coordinate.

Abstract: Techniques include performing a display calibration while a smartglasses device is stored in a case that enables the smartglasses device to perform display calibrations. The case includes an optical device configured to form an image of a test pattern formed in a first display and a second display of the smartglasses device.

Abstract: A wearable device, such as a head-wearable display (HWD), identifies a device pose based on a combination of angle-of-arrival (AOA) data generated by, for example, an ultra-wideband (UWB) positioning module, and inertial data generated by an inertial measurement unit (IMU). The HWD fuses the AOA data with the inertial data using data integration techniques such as one or more of stochastic estimation (e.g., a Kalman filter), a machine learning model, and the like, or any combination thereof. A computer device associated with the HWD can employ the fused data to identify a pose of the HWD (e.g., a six degree of freedom (6 DoF) pose) and can use the identified pose to modify virtual reality or augmented reality content implemented by the computer device, thereby providing an immersive and enjoyable experience for a user.

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

Abstract: Techniques of displaying content on a transparent display include detecting an individual present with respect to a world side, i.e., facing away from a user of a transparent display, opposite side of the transparent display as the user side. For example, circuitry connected to smartglasses detects the presence of an individual in the vicinity of the world side of a transparent display. In response, the circuitry causes an image of the individual to be generated and, based on the image, the circuitry classifies the individual as being in a state satisfying a set of criteria or not. In some implementations, the set of criteria include the individual being oriented in such a way as to be able to see the document. In response to the individual satisfying the criteria, the circuitry obscures the document from the view of the individual.

Abstract: Techniques include performing a display calibration while a smartglasses device is stored in a case that enables the smartglasses device to perform display calibrations. The case includes an optical device configured to form an image of a test pattern formed in a first display and a second display of the smartglasses device.

Abstract: This document describes systems and techniques to generate refined location estimates using ultra-wideband (UWB) communication links. Mobile devices, such as smartphones, include location sensors to estimate their location. The accuracy of location sensors is generally about 3 meters (or about 10 feet). More accurate location data would allow mobile devices to provide new and improved functionality. The described systems and techniques determine the distance between nearby mobile devices using UWB communication links. A mobile device can then use the distance between the mobile devices to determine their relative locations. By comparing the relative locations of the mobile devices with their location estimates, the mobile device can generate a refined location estimate.

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

Abstract: Techniques of displaying content on a transparent display include detecting an individual present with respect to a world side, i.e., facing away from a user of a transparent display, opposite side of the transparent display as the user side. For example, circuitry connected to smartglasses detects the presence of an individual in the vicinity of the world side of a transparent display. In response, the circuitry causes an image of the individual to be generated and, based on the image, the circuitry classifies the individual as being in a state satisfying a set of criteria or not. In some implementations, the set of criteria include the individual being oriented in such a way as to be able to see the document. In response to the individual satisfying the criteria, the circuitry obscures the document from the view of the individual.

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

Abstract: This document describes systems and techniques to generate refined location estimates using ultra-wideband (UWB) communication links. Mobile devices, such as smartphones, include location sensors to estimate their location. The accuracy of location sensors is generally about 3 meters (or about 10 feet). More accurate location data would allow mobile devices to provide new and improved functionality. The described systems and techniques determine the distance between nearby mobile devices using UWB communication links. A mobile device can then use the distance between the mobile devices to determine their relative locations. By comparing the relative locations of the mobile devices with their location estimates, the mobile device can generate a refined location estimate with greater accuracy.

Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.