Abstract: Disclosed implementations provide a streamlined, assisted search process for surfacing items from a database that enables guided exploratory searching. For example, a system may receive selected content from a client device and determine a first object and a second object for the selected content using a search converter. The system may generate first results by performing a first search of items in a database using the first object as a query, and generate second results by performing a second search of the items in the database using the second object as a query. The system may select a first set of the first results based on relevance of the first object to the selected content and a second set of the second results based on relevance of the second object to the selected content. The system may provide a combined search result including the first set and the second set.

Abstract: This document describes techniques and devices to detect and classify human and animal presence and/or motion based on changes in the interaction of the human or animal with Wireless Local Area Network (WLAN) radio frequency (RF) signals within or about a building structure, such as a home or office. A first WLAN device transmits a sounding packet to a second WLAN device and receives an acknowledgement (ACK) of receiving the sounding packet by the second WLAN device. The first WLAN device uses the received ACK to determine Channel State Information (CSI) for an RF signal path between the first WLAN device and the second WLAN device, aggregates the determined CSI with additional CSI, and uses the aggregated CSI to determine a presence or a motion within the structure.

Abstract: A method including generating two or more audio signals (e.g., by two or more microphones) based on a user interaction with a wearable device, generating an audio signature based on the two or more audio signals, and identifying at least one of a coordinate or a gesture based on an output of a machine-learned model given the audio signature.

Abstract: This document describes systems and techniques to generate refined location estimates using ultra-wideband (UWB) communication links. Mobile devices, such as smartphones, include location sensors to estimate their location. The accuracy of location sensors is generally about 3 meters (or about 10 feet). More accurate location data would allow mobile devices to provide new and improved functionality. The described systems and techniques determine the distance between nearby mobile devices using UWB communication links. A mobile device can then use the distance between the mobile devices to determine their relative locations. By comparing the relative locations of the mobile devices with their location estimates, the mobile device can generate a refined location estimate.

Abstract: Methods, devices, and systems for contactless cough detection and attribution are presented herein. Audio data may be received using a microphone. A cough may be identified as having occurred based on the received audio data. Radar data may be received indicative of reflected radio waves from a radar sensor. A state analysis process may be performed using the received radar data. The detected cough may be attributed to a particular user based at least in part on the state analysis process performed using the radar data.

Abstract: In general, techniques are described by which to enable a transparency mode in vehicles. A device comprising one or more microphones and one or more processors may be configured to perform the techniques. The microphones may capture audio data representative of a sound scene external to a vehicle. The processors may perform beamforming with respect to the audio data to obtain object audio data representative of an audio object in the sound scene external to the vehicle. The processors may next reproduce, by interfacing with one or more speakers included within the vehicle and based on the object audio data, the audio object in the sound scene external to the vehicle.

Abstract: A method for determining one or more vital signs of a person includes recording video images of a scene with an egocentric camera coupled to the person's body, detecting and magnifying image frame-to-image frame movements in the video images of the scene, representing the magnified image frame-to-image frame movements in the video images of the scene by a one-dimensional (1D) amplitude-versus-time series, and transforming the 1D amplitude-versus-time series representation into a frequency spectrum. The method further includes identifying one or more local frequency maxima in the frequency spectrum as corresponding to one or more vital signs of the person.

Abstract: A method for determining one or more vital signs of a person includes recording video images of a scene with an egocentric camera coupled to the person's body, detecting and magnifying image frame-to-image frame movements in the video images of the scene, representing the magnified image frame-to-image frame movements in the video images of the scene by a one-dimensional (1D) amplitude-versus-time series, and transforming the 1D amplitude-versus-time series representation into a frequency spectrum. The method further includes identifying one or more local frequency maxima in the frequency spectrum as corresponding to one or more vital signs of the person.

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; determining, by the mobile computing device, an instruction for installing the smart-home device at the location; and displaying, by a display of the mobile computing device, the view of the installation location for a smart-home device with the instruction for installing the smart-home device.

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.

Abstract: A method for facilitating a Parkinson's Disease (“PD”) assessment of a patient includes capturing first video of a patient performing first test movements while holding the mobile device; capturing second video of the patient performing second test movements while maintaining the mobile device on their person; capturing third video of the patient performing third test movements including standing and walking; capturing one or more IMU readings using an IMU of the mobile device; processing the first video, the second video, and the third video according to (i) a hand landmark model to generate one or more hand biomarkers, (ii) a face landmark model to generate one or more face biomarkers, and (iii) a body landmark model to generate one or more body biomarkers; and determining an assessment score based on a standardized PD assessment by processing the biomarkers.

Abstract: Various arrangements for performing fall detection are presented. A smart-home device (110, 201), comprising a monolithic radar integrated circuit (205), may transmit radar waves. Based on reflected radar waves, raw waveform data may be created. The raw waveform data may be processed to determine that a fall by a person (101) has occurred. Speech may then be output announcing that the fall has been detected via the speaker (217) of the smart home device (110, 201).

Abstract: A computing device, such as a wearable device, may include a light source and a photodetector array. The photodetector array may be used to determine a touch event of a user that occurs during a time interval. A subset of the plurality of photodetectors associated with the touch event may provide detection signals at each of a plurality of times within the time interval, which may be aggregated to obtain a time series of aggregated detection signals. Biometric data of the user may be generated, based on the time series of aggregated detection signals.

Abstract: Various arrangements for performing ballistocardiography using a mobile device are presented. A radar integrated circuit of a mobile device may emit frequency-modulated continuous-wave (FMCW) radar. Reflected radio waves based on the FMCW radar being reflected off objects may be received and used to create a raw radar waterfall. The raw radar waterfall may be analyzed to create a ballistocardiography waveform. Data based on the ballistocardiography waveform may be output, such as to a machine-learning application installed on the mobile device.

Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.

Abstract: Various arrangements for sonar-based vital sign monitoring are presented herein. A mobile device may be determined to be stationary. In response, sonar-based movement sensing can be activated. Sonar data can then be captured in response to activating the sonar-based movement sensing. A breathing pattern can be detected in the sonar data and used to collect respiration data about a user.

Abstract: Techniques and apparatuses are described that enable a device to be unlocked and continuous user authentication without a touch input dedicated to fingerprint requisition. A touch input is received that comprises one or more touches to a touchscreen, and raw image data corresponding to the touches is retrieved from a fingerprint imaging sensor. A pixel-clustering technique is performed on the raw image data to determine a portion of the raw image data that corresponds to each of the touches. Touch embeddings are formed for each of the portions of the raw image data and compared to one or more stored fingerprint embeddings that correspond to respective fingerprints of one or more authorized users. An authentication result is then determined for the touch input based on the comparison results.

Abstract: A computing device, such as a wearable device, may include at least two electrodes mounted on a body. The computing device may determine an electrical signal associated with a circuit that includes the at least two electrodes and the user. A pressure applied to at least one electrode of the at least two electrodes may be determined from the electrical signal, and at least one function of the computing device may be implemented, based on the pressure.

Abstract: Methods, devices, and systems for contactless cough detection and attribution are presented herein. Audio data may be received using a microphone. A cough may be identified as having occurred based on the received audio data. Radar data may be received indicative of reflected radio waves from a radar sensor. A state analysis process may be performed using the received radar data. The detected cough may be attributed to a particular user based at least in part on the state analysis process performed using the radar data.

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.