Abstract: A computing device for generating content includes one or more memories to store instructions and one or more processors to execute the instructions to perform operations, the operations including: receiving an input prompt requesting to generate content including an image with text; implementing one or more first machine-learned models configured to: determine, based on the input prompt, the text to be displayed in the image and one or more first features associated with the text, and determine one or more second features relating to generating an initial image which excludes the text; implementing one or more second machine-learned models configured to generate the initial image based on the one or more second features; and generating the content including the image with the text, based on the initial image generated via the one or more second machine-learned models and the one or more first features associated with the text.

Abstract: A method includes receiving, from an image capture device in communication with the data processing hardware, image data for an area of interest of a user. The method also includes receiving a query from the user referring to one or more objects detected within the image data and requesting a digital assistant to discern insights associated with the one or more objects referred to by the query. The method also includes processing the query and the image data to: identify, based on context data extracted from the image data, the one or more objects referred to by the query; and determine the insights associated with the identified one or more objects for the digital assistant to discern. The method also includes generating, for output from a user device associated with the user, content indicating the discerned insights associated with the identified one or more objects.

Abstract: A method includes processing, using a speech recognizer, a first portion of audio data to generate a first lattice, and generating a first partial transcription for an utterance based on the first lattice. The method includes processing, using the recognizer, a second portion of the data to generate, based on the first lattice, a second lattice representing a plurality of partial speech recognition hypotheses for the utterance and a plurality of corresponding speech recognition scores. For each particular partial speech recognition hypothesis, the method includes generating a corresponding re-ranked score based on the corresponding speech recognition score and whether the particular partial speech recognition hypothesis shares a prefix with the first partial transcription.

Abstract: Implementations relate to an automated assistant that can proactively detect and respond to a request for credentials. Characteristics of an entity requesting the credentials can be preemptively determined by the automated assistant using data that may be provided by the user or other previous visitors to a location. For example, the automated assistant can determine that the entity may expressly request certain information from a user when the user arrives at the location. Based on this determination, the automated assistant can operate to initialize an interface of a computing device of the user, when the user is determined to be at or near the location. For example, an audio interface of the computing device can be initialized to capture an audible request from a person who views credentials before granting access to a feature of the location.

Abstract: Generating text suggestions based on context can leverage sources associated with the context to generate more accurate and informed text suggestions. For example, the context can be a user situation, such as the user is attending a meeting. Obtaining text from sources associated with the user situation can generate a corpus of text that can be leveraged for generating the context-based text suggestions.

Abstract: Implementations relate to an automated assistant that can proactively detect and respond to a request for credentials. Characteristics of an entity requesting the credentials can be preemptively determined by the automated assistant using data that may be provided by the user or other previous visitors to a location. For example, the automated assistant can determine that the entity may expressly request certain information from a user when the user arrives at the location. Based on this determination, the automated assistant can operate to initialize an interface of a computing device of the user, when the user is determined to be at or near the location. For example, an audio interface of the computing device can be initialized to capture an audible request from a person who views credentials before granting access to a feature of the location.

Abstract: A method includes processing, using a speech recognizer, a first portion of audio data to generate a first lattice, and generating a first partial transcription for an utterance based on the first lattice. The method includes processing, using the recognizer, a second portion of the data to generate, based on the first lattice, a second lattice representing a plurality of partial speech recognition hypotheses for the utterance and a plurality of corresponding speech recognition scores. For each particular partial speech recognition hypothesis, the method includes generating a corresponding re-ranked score based on the corresponding speech recognition score and whether the particular partial speech recognition hypothesis shares a prefix with the first partial transcription.

Abstract: An example method includes presenting an item of third-party video content via a user interface, wherein the item of third-party video content is presented prior to presenting an item of primary content or is presented to interrupt the presenting of the item of primary content; providing a user-selectable option associated with an interactive summary of the third-party video content; receiving an indication that the user of the user device has selected the user-selectable option associated with the interactive summary of the third-party video content; and based on receiving the indication that the user of the user device has selected the user-selectable option associated with the interactive summary of the third-party video content: (i) ceasing, by the user device, presentation of the third-party video content, (ii) providing, by the user device, an interactive summary of the third-party video content, and (iii) presenting the item of primary content.

Abstract: Implementations relate to an automated assistant that can proactively detect and respond to a request for credentials. Characteristics of an entity requesting the credentials can be preemptively determined by the automated assistant using data that may be provided by the user or other previous visitors to a location. For example, the automated assistant can determine that the entity may expressly request certain information from a user when the user arrives at the location. Based on this determination, the automated assistant can operate to initialize an interface of a computing device of the user, when the user is determined to be at or near the location. For example, an audio interface of the computing device can be initialized to capture an audible request from a person who views credentials before granting access to a feature of the location.

Abstract: A method includes receiving image data for a plurality of objects of interest of a user, and receiving a query from the user referring to the plurality of objects and requesting a digital assistant to a discern color matching insight associated with the plurality of objects referred to by the query. The method includes processing the query and the image data to: identify, for each particular object of the plurality of objects referred to by the query, one or more corresponding colors of the particular object; and determine, based on the corresponding colors, the color matching insight associated with the plurality objects for the digital assistant to discern. The method includes generating, for output from a user device associated with the user, content indicating the discerned color matching insight associated with the plurality of objects.

Abstract: A method includes receiving, from an image capture device in communication with the data processing hardware, image data for an area of interest of a user. The method also includes receiving a query from the user referring to one or more objects detected within the image data and requesting a digital assistant to discern insights associated with the one or more objects referred to by the query. The method also includes processing the query and the image data to: identify, based on context data extracted from the image data, the one or more objects referred to by the query; and determine the insights associated with the identified one or more objects for the digital assistant to discern. The method also includes generating, for output from a user device associated with the user, content indicating the discerned insights associated with the identified one or more objects.

Abstract: Generating text suggestions based on context can leverage sources associated with the context to generate more accurate and informed text suggestions. For example, the context can be a user situation, such as the user is attending a meeting. Obtaining text from sources associated with the user situation can generate a corpus of text that can be leveraged for generating the context-based text suggestions.

Abstract: A method, computer program product, and computing system for determining an initial meeting location for a meeting previously-scheduled to be attended by a plurality of attendees at a defined meeting time. A current attendee location is determined for each of the plurality of attendees proximate the defined meeting time, thus defining a plurality of attendee locations. The initial meeting location and one or more of the plurality of attendee locations are compared to determine if the initial meeting location could be changed. If the initial meeting location could be changed, at least one alternative meeting location is suggested.