Abstract: Implementations relate to an automated assistant that can bypass invocation phrase detection when an estimation of device-to-device distance satisfies a distance threshold. The estimation of distance can be performed for a set of devices, such as a computerized watch and a cellular phone, and/or any other combination of devices. The devices can communicate ultrasonic signals between each other, and the estimated distance can be determined based on when the ultrasonic signals are sent and/or received by each respective device. When an estimated distance satisfies the distance threshold, the automated assistant can operate as if the user is holding onto their cellular phone while wearing their computerized watch. This scenario can indicate that the user may be intending to hold their device to interact with the automated assistant and, based on this indication, the automated assistant can temporarily bypass invocation phrase detection (e.g., invoke the automated assistant).

Abstract: Systems and methods related to simulated light-in-flight imaging are described. A computing device may execute a light-in-flight engine to process an optical image and a corresponding depth map to produce a light-in-flight image or video that simulates propagation of a wavefront across a scene. The light-in-flight engine may generate an optical simulation output by transforming a depth map to a three-dimensional lift domain to produce a three-dimensional data structure, then convolving the three-dimensional data structure with a convolutional operator, which may define a Gaussian sphere, to produce a filtered three-dimensional data structure. The light-in-flight engine then affine transforms the optical image with an identified slice of the filtered three-dimensional data structure to produce a light-in-flight image.

Abstract: To determine a location of a user, a tagless indoor positioning system is automatically calibrated by transmitting communication signals between at least two anchor devices and a user device to determine and store locations of a user with channel impulse responses of the communication signals for each location. A first anchor device at a first fixed location within a positioning system receives a communication signal transmitted by a second anchor device at a second fixed location within the positioning system, where the user is not using the user device. The first anchor device determines a channel impulse response of the communication signal. A location of the user is determined within the positioning system by comparing the channel impulse response of the communication signal to the stored channel impulse responses and corresponding stored locations.

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

Abstract: A computing device is described that includes one or more processors, a wireless transceiver that broadcasts a message over a wireless signal to locate a target tag, and a locator application. The locator application is operable by the one or more processors to receive, in response to the broadcast message, a plurality of intermediate responses from one or more intermediate tags, determine a first-hop direction and a first-hop distance to at least one first-hop intermediate tag based on the plurality of intermediate responses, and determine a target tag distance and a target tag direction from the computing device to the target tag based on each first-hop direction and the intermediate responses from each intermediate tag, wherein at least one of the plurality of intermediate responses from the one or more intermediate tags includes range data associated with a target-hop distance from the intermediate tag to the target tag.

Abstract: To automatically follow a host vehicle to a destination location, a client device in a vehicle identifies a host vehicle to follow to a destination location, transmits a communication signal to the identified host vehicle, and receives a response signal from the identified host vehicle. The client device determines a position of the host vehicle relative to the vehicle based on a round trip time of the communication signal and the response signal, and adjusts control of the vehicle in accordance with the position of the host vehicle relative to the vehicle.

Abstract: Techniques disclosed herein are directed towards pairing a first audio data stream of a first client device with a second audio data stream of a second client device based on identifying a user has imitated playback of media at the second client device, where the imitation of the playback by the user occurs at the first client device. Many implementations include the user controlling the media playback at the second client device using one or more automated assistant queries. Various implementations include deleting the pairing between the first audio data stream and the second audio data stream in response to determining whether one or more conditions have been satisfied (e.g., whether the user stops the playback, whether the first client device is a threshold distance away from the second client device, whether a period of time has elapsed, whether the entire media has played at the second client device, whether one or more additional or alternative conditions are satisfied, and/or combinations thereof).

Abstract: Techniques are described herein for arbitration between automated assistant devices based on interaction cues. A method includes: receiving, via one or more microphones of a first computing device, first audio data that captures a spoken utterance of a user; determining that each of one or more additional computing devices has detected the spoken utterance of the user; determining that hotword arbitration is to be initiated between the first computing device and the one or more additional computing devices; for each of the first computing device and the one or more additional computing devices, identifying a similarity score for the computing device; selecting a target computing device, from the first computing device and the one or more additional computing devices, based on the similarity scores; and causing the target computing device to respond to a query that is included in the spoken utterance of the user.

Abstract: Techniques include determining hand gestures formed by a user based on an electrical impedance tomograph of the wrist. For example, a user may be outfitted with a flexible wristband that fits snugly around the wrist and contains a plurality of electrodes, e.g., 32 electrodes. When a current is applied to a first subset of the electrodes, e.g., two of 32 electrodes, the electric field induced through at least one cross-section of the wrist will in turn induce a voltage across adjacent pairs of a second subset of the electrodes (e.g., the other 30 of 32 electrodes). From this current and induced voltage, one may use techniques of electrical impedance tomography (EIT) to determine the electrical impedance throughout the at least one cross-section of the wrist, e.g., in an electrical impedance tomograph. One may use a neural network to map the electrical impedance tomograph to a hand gesture.

Abstract: A computing system and method that can be used for a mapping system that can recommend paths for navigational routing to a primary user. More particularly, a primary user may be interested in navigational routes that secondary users, different from the primary user, have taken in the past. The mapping systems described herein can provide improved user navigational services by leveraging the insight that users who are connected (e.g., via social media, address books, etc.) may often be interested in visiting similar points of interest. More particularly, aspects of the present disclosure enable various interactions between connected users such as following in prior users' footsteps and taking a tour according to one or more prior users' route. Alternatively, aspects of the present disclosure enable an optimization of a primary user's navigational routing by leveraging the insight that the primary user may share interests with connected secondary users.

Abstract: Implementations set forth herein relate to facilitating control of an automated assistant or other application by rendering an ultrasonic signal that can be modulation through tactile interaction with physical portions of a computing device. The computing device can provide an acoustic signal via a speaker of the computing device, and the acoustic signal can be received by one or more microphones of the computing device. During transmission, a portion of the acoustic signal can travel through a housing of the computing device, which the user can tap or otherwise use to provide a gesture. Audio data generated using the microphone can reflect changes to the acoustic signal, and those changes can be indicative of a particular gesture received at the housing. When a particular gesture is detected, the automated assistant or other application can respond to the gesture by initiating one or more particular operations.

Abstract: To determine locations of ultra-wideband (UWB) anchor devices in an indoor positioning system, the indoor positioning system obtains distance measurements between each pair of N UWB anchor devices in the indoor positioning system. Each distance measurement is determined based on a round trip time of a UWB signal communicated between the pair of UWB anchor devices. The indoor positioning system also determines a location of each of the UWB anchor devices within the indoor positioning system using the distance measurements, and reconstructs an absolute network topology of the UWB anchor devices using the determined locations of the UWB anchor devices. The absolute network topology is used to determine a location of a client device within the indoor positioning system.

Abstract: Various arrangements for performing fall detection are presented. A smart-home device may transmit radar waves. Based on reflected radar waves, raw waveform data may be created. The raw waveform data may be processed to determine that a fall by a person has occurred. Speech may then be output announcing that the fall has been detected via the speaker of the smart home device.

Abstract: To provide indoor navigation directions to a user, a client device receives (181) a request for indoor navigation directions, and communicates (182) an ultra-wideband (UWB) signal with at least one anchor device in an indoor positioning system having a predetermined location within the indoor positioning system. The client device determines (183) a distance between the client device and the at least one anchor device based on a round trip time associated with the UWB signal, and determines (184) an indoor location of the client device based on (i) the distance between the client device and the at least one anchor device and (ii) the predetermined location for the at least one anchor device. Additionally, the client device generates (185) a set of indoor navigation directions for traversing the destination location, and provides (186) the indoor navigation directions via a user interface of the client device.

Abstract: Implementations relate to selecting a particular device, from an ecosystem of devices, to provide responses to a device-agnostic request of the user while a scenario is occurring. The user specifies a scenario and contextual features are identified from one or more devices of the ecosystem to generate scenario features indicative of the scenario occurring. The scenario features are stored with a correlation to a device that is specified by the user to handle responses while the scenario is occurring. When a subsequent device-agnostic request is received, current contextual features are identified and compared to the scenario features. Based on the comparison, the specified assistant device is selected to respond to the device-agnostic request.

Abstract: In general, techniques are described by which to enable a transparency mode in vehicles. A device comprising one or more microphones and one or more processors may be configured to perform the techniques. The microphones may capture audio data representative of a sound scene external to a vehicle. The processors may perform beamforming with respect to the audio data to obtain object audio data representative of an audio object in the sound scene external to the vehicle. The processors may next reproduce, by interfacing with one or more speakers included within the vehicle and based on the object audio data, the audio object in the sound scene external to the vehicle.

Abstract: Techniques of operating an AR system include determining hand gestures formed by a user based on a sequence of two-dimensional images through skin of the user's wrist acquired from a near-infrared camera. Specifically, an image capture device disposed on a band worn around a user's wrist includes a source of electromagnetic radiation, e.g., light-emitting diodes in the infrared (IR) wavelength band that emit the radiation into the user's wrist and an IR detector which produces the sequence of two-dimensional images of a region within a dermal layer in the user's wrist. From this sequence, gesture detection circuitry determines values of a biological flow metric, e.g., a change in perfusion index (PI) between frames of the sequence, based on a trained model that generates the metric from the sequence. Finally, the gesture detection circuitry maps the values of the biological flow metric to specific hand/finger movements that determine a gesture.

Abstract: According an embodiment, a computing device can: identify, in a chat view associated with a video chat session, a first authorized participant and a second authorized participant of the video chat session; render, in the chat view, first visual data indicative of the first authorized participant and second visual data indicative of the second authorized participant based at least in part on identification of the first authorized participant and the second authorized participant, respectively; define, in the chat view, a chat zone indicative of a reference location of the first authorized participant; determine that the first authorized participant moved outside the chat zone; and/or conceal, in the chat view, the first visual data indicative of the first authorized participant based at least in part on determination that the first authorized participant moved outside the chat zone.

Abstract: Computing systems and methods are provided for detecting skin conditions of humans. A computing device can authenticate a user via a fingerprint scan of a first skin region of the user using a three-dimensional (3D) sonic sensor. The device can generate a three-dimensional (3D) volumetric sonic measurement of a second skin region of the user based at least in part on one or more sonic pulses of the three-dimensional sonic sensor. The device can input data indicative of the 3D volumetric sonic measurement into one or more machine-learning models, generate one or more skin cancer condition identifications associated with the second skin region of the user based on one or more outputs of the one or more machine-learned models, and provide one or more outputs including the one or more skin cancer condition identifications associated with the second skin region of the user.

Abstract: A wearable device may be used to perform a health or medical assessment of a user. The wearable device may detect user movements of the user. The wearable device generates signal data representing the user movements. The signal data is input into a model to identify a feature set. The feature set is converted into a score that corresponds to a medical condition of the user.