Abstract: The present disclosure provides computer-implemented methods, systems, and devices for enabling frictionless transactions at a merchant location using audio communication. A central hub device receives transaction notification data describing a transaction with a user computing device. The central hub device accesses one or more location determination signals to estimate a location of the user computing device with the merchant location. The central hub device transmits transaction data to the estimated location of the user computing device using audio-based communications, the transaction data including an audio key that, when detected by the user computing device, causes the user computing device to automatically activate an application for providing payment data. The central hub device receiving transaction payment data from the user computing device. The central hub device executes the transaction by transmitting transaction data to a payment system.

Abstract: Systems (312) and methods (400) are provided for passively collecting context data associated with in-store shopping by a user. In this regard, one or more processors (202, 204) may receive, from each earbud in a pair of earbuds (238) worn by a user, sensor data corresponding to an orientation of each respective earbud (240, 242). Based on the received sensor data, the one or more processors (202, 204) may determine the gaze directions of the user as the user travels within a store and one or more products viewed by the user while traveling within the store by comparing, using a content map (128) of the store, the gaze directions of the user to product locations storing products, wherein the one or more products are the context data.

Abstract: Techniques and systems are disclosed that reduce latency in streaming media items. The techniques include communicating, to a media streaming service, a selection of a media item from a client device, receiving, from the media streaming service, a first portion of the media item having a first resolution and presenting, using the first portion, the media item on a presentation interface of the client device. The techniques further include receiving, from the media streaming service, a second portion of the media item having a second resolution, and presenting, responsive to an occurrence of a first threshold condition, the second portion of the media item on the presentation interface of the client device.

Abstract: Described techniques enable the use of ambisonics encoding/decoding for spatially accurate sound reproduction that is low-latency and that conserves computational and battery resources. Different sounds sources may be encoded using different ambisonics encoding orders, with higher order encoding being used to process sound from a sound source of current attention of a user, and lower order encoding being used to process other sound sources, such as background sound sources.

Abstract: A headset in the form of glasses for use in creating an augmented reality experience is implemented with a capacitive smart sensor disposed on an inside surface of an arm of the glasses. The capacitive smart sensor can be trained, using a neural network, to identify and distinguish different gestures associated with a touch event on an outside surface of the arm of the glasses. The smart sensor thus transforms the headset into a user input device without adding a touch pad.

Abstract: Techniques and apparatuses are described that implement a smart-device-based radar system capable of performing location tagging. The radar system has sufficient spatial resolution to recognize different external environments associated with different locations (e.g., recognize different rooms or different locations within a same room). Using the radar system, the smart device can achieve spatial awareness and automatically activate user-programmed applications or settings associated with the different locations. In this way, the radar system enables the smart device to provide a location-specific shortcut for various applications or settings. With the location-specific shortcut, the smart device can improve the user's experience and reduce the need to repeatedly navigate cumbersome interfaces.

Abstract: A headset in the form of glasses for use in creating an augmented reality experience is implemented with a capacitive smart sensor disposed on an inside surface of an arm of the glasses. The capacitive smart sensor can be trained, using a neural network, to identify and distinguish different gestures associated with a touch event on an outside surface of the arm of the glasses. The smart sensor thus transforms the headset into a user input device without adding a touch pad.

Abstract: Methods and systems for artificial intelligence (AI)-based document retrieval during a virtual meeting are provided herein. Discussion data based on multi-media stream(s) provided by client devices of participants of a virtual meeting is obtained. A determination is made of whether the discussion data corresponds to an information access query. In response to a determination that the discussion data corresponds to the information access query, the discussion data is provided as input to an AI model trained to identify one or more electronic documents including content that is relevant to given discussion data. An electronic document associated with at least one of the participants including content that is relevant to the given discussion data is identified based on output(s) of the AI model. At least a portion of the content of the electronic document is provided for presentation via a user interface (UI) at each client device associated with the participants.

Abstract: Techniques and systems are disclosed that perform content generation with integrated automated formatting using word processing applications that deploy large language models (LLMs). The techniques include receiving, a natural language (NL) query for a synthetic content for a document, identifying formatting rules of the document, and generating an augmented query that includes a representation of at least a portion of the NL query and a representation of the one or more formatting rules of the document. The techniques further include providing the augmented query to an LLM and updating the document with the synthetic content generated by the LLM in response to the augmented query.

Abstract: Techniques include providing a user with a set of loudspeakers on a sphere and playing back sound from the set of loudspeakers one at a time. For each loudspeaker, the user points in a direction at which the user perceives the sound. The HRTF corresponding to a new direction based on the perceived direction is used instead, or the original HRTF at the perceived direction is used. In some implementations, the new direction is obtained from the perceived direction via a barycentric mapping. In some implementations, a difference between the new direction and the perceived direction is equal to a difference between the perceived direction and the original direction.

Abstract: Methods and systems for time marking of media items at a platform using machine learning are provided herein. A media item to be provided to users of a platform is identified. The media item includes two or more content segments. An indication of the identified media item is provided as input to a machine learning model. The machine learning model is trained using to predict, for a given media item, content segments of the given media item depicting an event of interest to the one or more users. One or more outputs of the machine learning model are obtained. The one or more obtained outputs include event data identifying each content segment of the media item and an indication of a level of confidence that each respective content segment depicts an event of interest. In response to determining that at least one content segment is associated with a level of confidence that satisfies a level of confidence criterion, the at least one content segment is associated with a bookmark for a timeline of the media item.

Abstract: Various arrangements for performing radar-based measurement of vital signs. Waveform data may be received then filtered of data indicative of static objects to obtain motion-indicative waveform data. The motion-indicative waveform data may be analyzed to determine one or more frequencies of movement present within the motion-indicative waveform data. A spectral analysis may be performed on the motion-indicative waveform data to determine a spectral-analysis state of a monitored region. The spectral-analysis state of the monitored region may be determined to match a predefined spectral-analysis state during which vital sign monitoring is permitted. One or more vital signs of a monitored user present within the monitored region may be determined and output based on analyzing the motion-indicative waveform data.

Abstract: Methods and systems for color recommendations for overlaid text in a video are provided herein. A video for upload is received. The video includes a plurality of frames having overlaid content. Data related to the video is provided as input to a machine learning model. One or more outputs obtained from the machine learning model is used to determine a color value that improves one or more presentation characteristics of the overlaid content within the video. A color associated with the determined color value is provided to a user for the overlaid content.

Abstract: Implementations set forth herein relate to controlling invocation of an automated assistant according to whether a capacitive touch sensor array has detected a particular input that indicates a user has positioned an assistant-enabled device near their face. The capacitive touch sensor array can be part of a touch display interface of a portable computing device that provides access to an automated assistant. When the interface is positioned near the face of the user, input data from the interface can be processed to determine whether the input data indicates the display interface is near their face or whether the user is providing some other input to the display interface. When the input data indicates the user is positioning the display interface near their face or mouth, the automated assistant can be invoked in lieu of the user providing any other invocation input.

Abstract: According to an aspect, a method may include generating, by an interface-guided diffusion model, a UI-compatible output image in response to one or more prompts including user-generated text and input condition data. The input condition data includes user interface (UI) layout information about at least one UI element included in an interface of an application. The method includes providing the UI-compatible output image to the application.

Abstract: According to an aspect, a method includes receiving, by a language model, session state information, generated by a browser application, about a computer session of a user, receiving, by the language model, a user-generated query including a natural language description about a browser tab, generating, by the language model, a textual response about the browser tab using contextual data, the contextual data including the session state information, and providing the textual response on a user device.

Abstract: The present disclosure provides a mechanism to synchronously drive distributed speakers around a user based on localization outputs of ultra wideband (UWB) communication chips already existing in devices. Distances may be determined between a user device, such as a phone or wearable, and a plurality of distributed speakers or other devices. Based on an intersection point of such distances, the user's location can be identified. Such location can be used to modify how audio is played on each of the plurality of distributed speakers.

Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.

Abstract: Various arrangements for performing radar-based measurement of vital signs. Waveform data may be received then filtered of data indicative of static objects to obtain motion-indicative waveform data. The motion-indicative waveform data may be analyzed to determine one or more frequencies of movement present within the motion-indicative waveform data. A spectral analysis may be performed on the motion-indicative waveform data to determine a spectral-analysis state of a monitored region. The spectral-analysis state of the monitored region may be determined to match a predefined spectral-analysis state during which vital sign monitoring is permitted. One or more vital signs of a monitored user present within the monitored region may be determined and output based on analyzing the motion-indicative waveform data.

Abstract: Methods and systems for determining a time point to skip to within a media item using user interaction events are provided herein. A media item is provided to a user of a platform. One or more user interaction events each associated with the user skipping to a particular time point during current playback of the media item is identified. A next time point intended by the user to skip to during the current playback of the media item is determined. The determining of the next time point comprises determining a plurality of viewing data for the media item based on the one or more user interaction events during the current playback of the media item and user interaction events during prior playbacks of the media; and identifying, based on the determined plurality of viewing data, the next time point intended by the user to skip to during the current playback of the media item. A playback of the media item is caused to be skipped to the determined next time point.