Abstract: A method including determining historical user data associated with an event occurring on a wearable device, determining a probability of interacting with an object on a display of the wearable device based on the historical user data, scaling a hitbox associated with the object to form a scaled hitbox, detecting a user input based on an eye tracking being within the scaled hitbox, and in response to detecting the user input, initiating an action corresponding to the object.

Abstract: Various arrangements for performing an initial setup process of a sleep tracking device are presented. User input may be received that requests a sleep tracking setup process be performed. In response to the user input, a detection process may be performed based on data received from the radar sensor to determine whether a user is present and static. In response to the detection process determining that the user is present and static, a consistency analysis may be performed over a time period to assess a duration of time that the user is present and static. Based on the consistency analysis, sleep tracking may be activated such that when the user is detected in bed via the radar sensor, the user's sleep is tracked.

Abstract: A method including transmitting, by a peripheral device communicatively coupled to a wearable device, a frequency-modulated continuous wave (FMCW), receiving, by the peripheral device, a reflected signal based on the FMCW, tracking, by the peripheral device, a movement associated with the peripheral device based on the reflected signal, and communicating, from the peripheral device to the wearable device, an information corresponding to the movement associated with the peripheral device.

Abstract: A contactless health monitoring device may perform a beam steering process that creates a plurality of beam-steered radar data streams from the received radar data stream. The contactless health monitoring device may determine breathing displacement for a user in relation to time for each spatial zone radar data stream. The contactless health monitoring device may analyze the breathing displacement for the user in relation to time for each spatial zone radar data stream. The contactless health monitoring device may output a screening result based on analyzing the breathing displacement for the user.

Abstract: Various arrangements for monitoring for contactless human interactions and health using a single radar transmission modulation mode are provided. Radar chirps may be output by a radar sensor operating in a burst mode. The burst mode radar data stream may be monitored for a contactless human interaction performed by an active user. The burst mode radar data stream may be converted to a virtual continuous mode radar data stream. Health monitoring of an inactive user may be performed using the virtual continuous mode radar data stream.

Abstract: A first version of an electronic document is provided via a first region of a graphical user interface (GUI) for presentation to a first user of a collaborative document platform. A second region of the GUI includes an edit history GUI element that enables one or more users to access each edit made to the electronic document. A user selection of a portion of the edit history GUI element is detected. The user-selected portion of the edit history GUI element corresponds to edits made to the electronic document by a second user. A determination is made of a state of the electronic document following the edits made by the second user. The first region of the GUI is updated to include a rendering of a second version of the electronic document. The second version is rendered in view of the determined document state.

Abstract: Beamforming can improve the audio quality and/or intensity in a particular direction, which can help a user hear, especially in certain environments. Augmented reality glasses can track the eye, or eyes, of a user which can trigger and guide the beamforming towards a particular object of interest, such as a person speaking. The beamforming may be made efficient by storing information necessary for beamforming in a database and recalling the information at runtime.

Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.

Abstract: Various arrangements are presented for training and using a machine learning model. A first training data set may be created that has more samples but fewer dimensions than a second dataset. A second set of training data, created from the second dataset, has at least one additional dimension of data than the first set of training data. An additional dimension of data can then be simulated for the first set of training data. The simulated additional dimension of data can be incorporated with the first set of training data. A first machine learning model can be trained based on the first set of training data that comprises the simulated additional dimension of data to obtain various weights. A second machine learning model can then be trained based on the second set of training data and the obtained plurality of weights from the first trained machine learning model.

Abstract: The present disclosure provides a mechanism to synchronously drive distributed speakers around a user based on localization outputs of ultra wideband (UWB) communication chips already existing in devices. Distances may be determined between a user device, such as a phone or wearable, and a plurality of distributed speakers or other devices. Based on an intersection point of such distances, the user's location can be identified. Such location can be used to modify how audio is played on each of the plurality of distributed speakers.

Abstract: Techniques of controlling electronic devices using gestures use a wearable device on a user which translates, via a model, user movements into signals that both identify an electronic device to be controlled and a specific action to take with regard to that electronic device. The wearable device includes an inertial measurement unit (IMU) sensor and a photoplethysmography (PPG) sensor and measure six degrees of freedom (6DOF). The model is a convolutional neural network (CNN) that takes x, y, and z-acceleration signals generated by the IMU and PPG and places each acceleration component generated from each sensor in a separate channel. The CNN takes the input from each channel and generates a respective, separate model for each channel. The output at each of the stacked layers are combined in a fully connected layer to produce CNN output identifying an electronic device and a control for the electronic device.

Abstract: A method for separating target speech from background noise contained in an input audio signal includes receiving the input audio signal captured by a user device, wherein the input audio signal corresponds to target speech of multiple words spoken by a target user and containing background noise in the presence of the user device while the target user spoke the multiple words in the target speech. The method also includes receiving a sequence of time markers input by the target user in cadence with the target user speaking the multiple words in the target speech, and correlating the sequence of time markers with the input audio signal to generate enhanced audio features that separate the target speech from the background noise in the input audio signal. The method also includes processing, using a speech recognition model, the enhanced audio features to generate a transcription of the target speech.

Abstract: Various devices, systems and methods for performing targeted sleep tracking are presented herein. Multiple digital radar data streams from multiple antennas may be received. A direction optimization process may be performed to determine a first weighting and a second weighting. The first weighting may be applied to a first digital radar data stream. The second weighting may be applied to a second digital radar data stream. The weighted first digital radar data stream and the weighted second digital radar data stream may be combined to create a first directionally-targeted radar data stream. A sleep analysis can be performed based on the first directionally-targeted radar data stream. Sleep data may be output for a user based on the performed sleep analysis.

Abstract: A method performed by a head-mounted device can include, based on a front-facing camera included in the head-mounted device capturing an image of a wearable device, configuring the head-mounted device to receive input via the wearable device, determining that a gesture received by the wearable device includes a request to launch an application, and, in response to determining that the gesture includes the request to launch the application, launching the application.

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

Abstract: Smart glasses including a first audio device, a second audio device, a frame including a first portion, a second portion, and a third portion, the second portion and the third portion are moveable in relation to the first portion, the second portion including the first audio device and the third portion including the second audio device, and a processor configured to cause the first audio device to generate a signal, receive the signal via the second audio device, estimate a distance based on the received signal, and determine a configuration of the frame.

Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.

Abstract: A method for a contextual assistant to use mouse pointing or touch cues includes receiving audio data corresponding to a query spoken by a user, receiving, in a graphical user interface displayed on a screen, a user input indication indicating a spatial input applied at a first location on the screen, and processing the audio data to determine a transcription of the query. The method also includes performing query interpretation on the transcription to determine that the query is referring to an object displayed on the screen without uniquely identifying the object, and requesting information about the object. The method further includes disambiguating, using the user input indication indicating the spatial input applied at the first location on the screen, the query to uniquely identify the object that the query is referring to, obtaining the information about the object requested by the query, and providing a response to the query.

Abstract: An electronic document is provided for presentation via a graphical user interface (GUI). A first region of the electronic document includes content objects. A second region of the electronic document includes a drawing object. A determination is made, based on first characteristics associated with the content objects and second characteristics associated with the drawing object, that the drawing object corresponds to the content objects. A mapping is generated between the content objects and the drawing object. A modification to the content objects in the first region of the electronic document is identified. In response to the modification to the content objects, a presentation of the drawing object in the second region of the electronic document is modified in view of the generated mapping.

Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.