Abstract: Systems and methods for three-dimensional object category modeling can utilize figure-ground neural radiance fields for unsupervised training and inference. For example, the systems and methods can include a foreground model and a background model that can generate an object output based at least in part on one or more learned embeddings. The foreground model and background model may process position data and view direction data in order to output color data and volume density data for a respective position and view direction. Moreover, the object category model may be trained to generate an object output, which may include an instance interpolation, a view synthesis, or a segmentation.

Abstract: Teacher-student learning can be used to train a keyword spotting (KWS) model using augmented training instance(s). Various implementations include aggressively augmenting (e.g., using spectral augmentation) base audio data to generate augmented audio data, where one or more portions of the base instance of audio data can be masked in the augmented instance of audio data (e.g., one or more time frames can be masked, one or more frequencies can be masked, etc.). Many implementations include processing augmented audio data using a KWS teacher model to generate a soft label, and processing the augmented audio data using a KWS student model to generate predicted output. One or more portions of the KWS student model can be updated based on a comparison of the soft label and the generated predicted output.

Abstract: Automated product identification within hosted and streamed videos is performed based on video content of a video received at an online video platform and text content associated with the video. First embeddings representative of one or more first candidate products are determined based on video content of the video, such as one or more frames selected from within the video. Second embeddings representative of one or more second candidate products are determined based on text content associated with the video, such as a title, description, or transcript of the video. A product candidate index is produced based on the second embeddings. A product identification representative of a product featured in the video is determined based on a comparison of the first embeddings against entries of the product candidate index, such as including by a nearest neighbor search responsive to the comparison. An indication of the product identification is then output at the online video platform.

Abstract: A method for determining an initial bitrate for a communication includes receiving a communication request to establish a digital communication between a first user device and a second user device associated with a plurality of features including a geographical identifier identifying a geographical location associated with the first user device, a first network type connection associated with the first user device, a second network type connection associated with the second user device, and an average bitrate for a previous digital communication of the first user device. The method includes determining, using an initial bitrate predictor model configured to receive the plurality of features as feature inputs, an initial bitrate for the digital communication between the first user device and the second user device, and establishing the digital communication between the first user device and the second user device at the determined initial bitrate.

Abstract: Techniques are described herein for improving performance of machine learning model(s) and thresholds utilized in determining whether automated assistant function(s) are to be initiated. A method includes: receiving, via one or more microphones of a client device, audio data that captures a spoken utterance of a user; processing the audio data using a machine learning model to generate a predicted output that indicates a probability of one or more hotwords being present in the audio data; determining that the predicted output satisfies a secondary threshold that is less indicative of the one or more hotwords being present in the audio data than is a primary threshold; in response to determining that the predicted output satisfies the secondary threshold, prompting the user to indicate whether or not the spoken utterance includes a hotword; receiving, from the user, a response to the prompting; and adjusting the primary threshold based on the response.

Abstract: Methods, systems, and apparatus, for providing map data that causes a user device to display a map of an area that includes a physical entity location and a access locations for the physical entity, wherein the physical entity location is indicated by an icon of a first type and each access location is indicated by an icon of a second type that is different from the icon of the first type.

Abstract: The present disclosure is directed to systems and methods of providing content. A server can generate a request for a push content item for an account identifier linked with a computing device. The server can establish a push auction for the account identifier with multiple candidate push content items. The server can determine an auction score for each candidate push content item and select a push content item therefrom based on the auction score. The server can determine a parameter for the account identifier and control delivery of the selected push content item based on a delivery control policy. The server can compare a value of the parameter with a threshold value to authorize the push content item. The server can provide the selected and authorized push content item for presentation in a push content slot via the computing device linked to the account identifier.

Abstract: A method can be performed by a browser. The method can include presenting at least a portion of a resource address; presenting a rendered webpage in a browser content window, the rendered webpage being associated with the resource address; presenting an annotation area, the annotation area being outside the browser content window; receiving, in association with a user account, an annotation in the annotation area; and storing the annotation in association with the user account and the resource address.

Abstract: A computer-implemented method for correcting one or more errors in a quantum computing system can include obtaining, by a computing system comprising one or more computing devices, a plurality of weighted detection graphs, each of the plurality of weighted detection graphs being descriptive of a plurality of error detection measurements and having a plurality of weights, each of the weights respectively determined according to an error probability. The method can include generating, by the computing system, a plurality of reweighted detection graphs based at least in part on a correlation between physical errors in the quantum computing system. The method can include correcting, by the computing system, one or more errors in a quantum computing system based at least in part on a global decoding of the plurality of reweighted detection graphs.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for generating geolocalized images are provided. The disclosed technology can access target location data. The target location data can include information associated with an environment from which a target location is within a field of view of a user device. A suitable position of the user device from which an unobstructed view of the target location is within the field of view of the user device and that satisfies one or more criteria can be determined based on the target location data. Furthermore, indications and images of the environment within the field of view of the user device can be generated. The indications can be associated with positioning the user device in the suitable position.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, modifying queries based on non-textual content. In one aspect, a method includes receiving, from a user device, a query including a plurality of terms; determining active non-textual data displayed in an application environment on the user device; determining, from the non-textual textual data, modification data for the query; generating a set of modified queries based on the query and the modification parameters; scoring the modified queries according to one or more scoring criteria; selecting one of the modified queries based on the scoring; and providing, to the user device, search results responsive to the selected modified query.

Abstract: Example aspects of the present disclosure are directed to computing systems and methods that perform whole person association with face screening and/or face hallucination. In particular, one aspect of the closure is directed to a multi-headed person and face detection model that performs both face and person detection in one model. Each of the face and person detection can find landmarks or other pose information and also a confidence score. The pose information for the face and person detections can be used to select certain face and person detections to associate together as a whole person detection, which can be referred to as an “appearance.

Abstract: A computing system and related techniques for selecting content to be automatically converted to speech and provided as an audio signal are provided. A text-to-speech request associated with a first document can be received that includes data associated with a playback position of a selector associated with a text-to-speech interface overlaid on the first document. First content associated with the first document can be determined based at least in part on the playback position, the first content including content that is displayed in the user interface at the playback position. The first document can be analyzed to identify one or more structural features associated with the first content. Speech data can be generated based on the first content and the one or more structural features.

Abstract: An email payment system and method to provide users with the ability to initiate and send payments to one more recipients via email messaging. A user interface is provided in an email client that allows a user to insert payment with the email. Payment details are collected through one or more payment modals displayed in the email client. A payment object is inserted into the body of the email and is displayed to both the sender and recipient. The payment details captured in the payment object are communicated to a payment processor. The payment processor uses electronic payment accounts associated with the corresponding sender and recipient email addresses to identify the relevant electronic payment accounts and transfer the payment between said accounts. A status of the payment transaction is tracked and displayed within the payment object of the entails residing in both the sender and recipient email client.

Abstract: A video conferencing system includes a multi-user interaction slate for the execution of applications having a state that is responsive to inputs from multiple attendees of a video conference. The video conferencing system includes a graphical user interface having video slates provided for video streams and multi-user interaction slates for the execution of code that is responsive to inputs provided at multiple client devices. The video conferencing system can determine a current state of a multi-user interaction slate in response to inputs provided by users of the client devices in association with the multi-user interaction slate. The video conferencing system can provide data for rendering the graphical user interface, including video data associated with the video slates and data indicative of the current state of the multi-user interaction slate.

Abstract: A computer-implemented method is disclosed. The method includes receiving from a remote device a search query, generating a plurality of different category-directed result sets for the search query, determining an order for the plurality of category-directed result sets based on the search query, and transmitting the plurality of category-directed result sets to the remote device, in a manner that the result sets are to be displayed in the remote device in the determined order.

Abstract: The present disclosure is generally related to systems and methods of rendering visual components on applications. At least one action-inventory can indicate to render a user interface component. A data processing system can identify a request from an input audio signal from a client device. The client device can display a first application in a foreground process. The data processing system can select an action-inventory to execute the action corresponding to the request by a second application. The data processing system can generate an action data structure using the action-inventory to provide to the second application. The data processing system can determine that an output of the second application is authorized to be presented with the first application. The data processing system can display, on the client device, a user interface component from the second application with the first application.

Abstract: Techniques for using contextual information relating to content presented by a television as part of a search query for an information search are presented. A search management component, at a given moment in time during presentation of television-related content by a communication device in or associated with a television, identifies contextual information associated with a section of the television-related content and generates a content identifier timestamp associated with the contextual information and the section of television-related content. A search component augments a search query using the contextual information to facilitate customization of a subset of search results based on the contextual information. The contextual information in the search query can facilitate disambiguating the search query or promoting a search result over another search result in the subset of search results, based on the contextual information, to facilitate customization of the subset of search results.