Abstract: The present disclosure is generally related to systems and methods of rendering visual components on applications. At least one action-inventory can indicate to render a user interface component. A data processing system can identify a request from an input audio signal from a client device. The client device can display a first application in a foreground process. The data processing system can select an action-inventory to execute the action corresponding to the request by a second application. The data processing system can generate an action data structure using the action-inventory to provide to the second application. The data processing system can determine that an output of the second application is authorized to be presented with the first application. The data processing system can display, on the client device, a user interface component from the second application with the first application.

Abstract: Techniques for using contextual information relating to content presented by a television as part of a search query for an information search are presented. A search management component, at a given moment in time during presentation of television-related content by a communication device in or associated with a television, identifies contextual information associated with a section of the television-related content and generates a content identifier timestamp associated with the contextual information and the section of television-related content. A search component augments a search query using the contextual information to facilitate customization of a subset of search results based on the contextual information. The contextual information in the search query can facilitate disambiguating the search query or promoting a search result over another search result in the subset of search results, based on the contextual information, to facilitate customization of the subset of search results.

Abstract: Implementations relate to determining a well-formed phrase to suggest to a user to submit in lieu of a not well-formed phrase. The suggestion is rendered via an interface that is provided to a client device of the user. Those implementations relate to determining that a phrase is not well-formed, identifying alternate phrases that are related to the not well-formed phrase, and scoring the alternate phrases to select one or more of the alternate phrases to render via the interface. Some of those implementations are related to identifying that the phrase is not well-formed based on occurrences of the phrase in documents that are generated by a source with the language of the phrase as the primary language of the creator.

Abstract: Hot word free adaptation, of function(s) of an automated assistant, responsive to determining, based on gaze measure(s) and/or active speech measure(s), that a user is engaging with the automated assistant. Implementations relate to techniques for mitigating false positive occurrences of and/or false negative occurrences, of hot word free adaptation, through utilization of a permissive parameter set in some situation(s) and a restrictive parameter set in other situation(s). For example, utilizing the restrictive parameter set when it is determined that a user is engaged in conversation with additional user(s). The permissive parameter set includes permissive parameter(s) that are more permissive than counterpart(s) in the restrictive parameter set.

Abstract: A navigation service determines that a first user intends to navigate to a shared destination from a first location, at a first time, and that a second user intends to navigate to the shared destination from a second location, at a second time within a threshold interval of the first time. The navigation service notifies the first user using an electronic notification that the second user intends to navigate to the shared destination, receives from the first user an electronic request to coordinate navigation to the shared destination with the second user, and in response to receiving the electronic request, provides navigation directions to the shared destination to a device associated with the first user in view of a progress of the second user toward the shared destination.

Abstract: Training and/or utilizing a single neural network model to generate, at each of a plurality of assistant turns of a dialog session between a user and an automated assistant, a corresponding automated assistant natural language response and/or a corresponding automated assistant action. For example, at a given assistant turn of a dialog session, both a corresponding natural language response and a corresponding action can be generated jointly and based directly on output generated using the single neural network model. The corresponding response and/or corresponding action can be generated based on processing, using the neural network model, dialog history and a plurality of discrete resources. For example, the neural network model can be used to generate a response and/or action on a token-by-token basis.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for identifying a set of resources in response to crawling multiple webpages that use at least one resource in the set. For each resource in the set, a system determines an age of the resource using a timestamp for the resource. The system determines a pre-fetch measure of the resource based on the age of the resource and usage information that describes use of the resource at a webpage. The system selects a first resource from the set based on the pre-fetch measure and determines whether a respective age of the selected first resource exceeds a threshold age. The system generates an index entry for a pre-fetch index. The index entry includes a command to pre-fetch the first resource based on a determination that the respective age of the first resource exceeds the threshold age.

Abstract: Techniques described herein are directed to arbitrating between multiple potentially-responsive, automated-assistant capable electronic devices to determine which should respond to the user's utterance, and/or which should defer to other electronic device(s). In various implementations, a spoken utterance of a user may be detected at a microphone of a first electronic device, a spoken utterance provided by a user. Sound(s) emitted by additional electronic device(s) may also be detected at the microphone. Each of the sound(s) may encode a timestamp corresponding to detection of the spoken utterance at a respective electronic device. Timestamp(s) may be extracted from the sound(s) and compared to a local timestamp corresponding to detection of the spoken utterance at the first electronic device. Based on the comparison, the first electronic device may either invoke an automated assistant locally or defer to one of the additional electronic devices.

Abstract: A computing system for generating predicted images along a trajectory of unseen viewpoints. The system can obtain one or more spatial observations of an environment that may be captured from one or more previous camera poses. The system can generate a three-dimensional point cloud for the environment from the one or more spatial observations and the one or more previous camera poses. The system can project the three-dimensional point cloud into two-dimensional space to form one or more guidance spatial observations. The system can process the one or more guidance spatial observations with a machine-learned spatial observation prediction model to generate one or more predicted spatial observations. The system can process the one or more predicted spatial observations and image data with a machine-learned image prediction model to generate one or more predicted images from the target camera pose. The system can output the one or more predicted images.

Abstract: Methods, systems, and apparatus for generating data describing context clusters and context cluster probabilities, wherein each context cluster includes query inputs based on the input context for each of the query inputs and the content described by each query input, and each context cluster probability indicates a probability that at a query input that belongs to the context cluster will be selected by the user, receiving, from a user device, an indication of a user event that includes data indicating a context of the user device, selecting as a selected context cluster, based on the context cluster probabilities for each of the context clusters and the context of the user device, a context cluster for selection input by the user device, and providing, to the user device, data that causes the user device to display a context cluster selection input that indicates the selected context cluster for user selection.

Abstract: Techniques are described herein for training and/or utilizing a query canonicalization system. In various implementations, a query canonicalization system can include a classification model and a canonicalization model. A classification model can be used to determine if a search query is well-formed. Additionally or alternatively, a canonicalization model can be used to determine a well-formed variant of a search query in response to determining a search query is not well-formed. In various implementations, a canonicalization model portion of a query canonicalization system can be a sequence to sequence model.

Abstract: Processor(s) of a client device can: receive sensor data that captures environmental attributes of an environment of the client device; process the sensor data using a machine learning model to generate a predicted output that dictates whether one or more currently dormant automated assistant functions are activated; making a decision as to whether to trigger the one or more currently dormant automated assistant functions; subsequent to making the decision, determining that the decision was incorrect; and in response to determining that the determination was incorrect, generating a gradient based on comparing the predicted output to ground truth output. In some implementations, the generated gradient is used, by processor(s) of the client device, to update weights of the on-device speech recognition model. In some implementations, the generated gradient is additionally or alternatively transmitted to a remote system for use in remote updating of global weights of a global speech recognition model.

Abstract: According to an aspect, a method for sharing a collaborative augmented reality (AR) environment including obtaining, by a sensor system of a first computing system, visual data representing a physical space of an AR environment, where the visual data is used to create a three-dimensional (3D) map of the physical space. The 3D map includes a coordinate space having at least one virtual object added by a user of the first computing system. The method includes broadcasting, by a transducer on the first computing system, an ultrasound signal, where the ultrasound signal includes an identifier associated with the 3D map. The identifier is configured to be detected by a second computing system to join the AR environment.

Abstract: Systems and methods for quantum random number generation are provided. In some implementations, a method can include obtaining data indicative of a quantum circuit used by the quantum random number generation system to generate a quantum entropy source for determining a random number. The quantum entropy source can include a plurality of output samples. Each output sample can be obtained by measuring an output of the quantum circuit. The method can include performing one or more simulations of the quantum circuit to obtain a simulated output distribution of the quantum circuit without access to data associated with the random number. The method can include providing data indicative of the simulated output distribution for use in a verification process for the quantum random number generation system. The verification process can determine the use of the quantum computing system in generation of the quantum entropy source.

Abstract: Systems and methods for generating augmented reality prerenderings can provide the benefit of an augmented reality rendering without requiring the use of user data. Template images can be used instead of user data to protect the user's privacy while enabling the user to see an object or product rendered onto a preferred template image or a variety of template images.

Abstract: Automated monitoring of a voice communication session, when the session is in an on hold status, to determine when the session is no longer in the on hold status. When it is determined that the session is no longer in the on hold status, user interface output is rendered that is perceptible to a calling user that initiated the session, and that indicates that the on hold status of the session has ceased. In some implementations, an audio stream of the session can be monitored to determine, based on processing of the audio stream, a candidate end of the on hold status. In response, a response solicitation signal is injected into an outgoing portion of the audio. The audio stream can be further monitored for a response (if any) to the response solicitation signal. The response (if any) can be processed to determine whether the end of the on hold status is an actual end of the on hold status.

Abstract: Techniques are described herein for determining a predicted intent of a user and displaying additional content selected based on the predicted intent of the user. A method includes: receiving information identifying a webpage that a user is visiting and a navigational path of the user in navigating to the webpage; determining a predicted intent of the user based on the information identifying the webpage that the user is visiting and the navigational path of the user in navigating to the webpage; selecting additional content based upon the predicted intent of the user; and displaying an overlay, on a portion of the webpage, that includes the additional content.