Abstract: The present disclosure is generally related to a data processing system to validate vehicular functions in a voice activated computer network environment. The data processing system can improve the efficiency of the network by discarding action data structures and requests that invalid prior to their transmission across the network. The system can invalidate requests by comparing attributes of a vehicular state to attributes of a request state.

Abstract: Implementations set forth herein relate to providing suggestions for application services using tree data structures provided by various application sources. A native data structure, created by an assistant application or other related application, can be present in a local memory and, depending on the status of this native data structure, can be utilized to generate deep links to be rendered within the search interface. Selection of a particular deep link can initialize particular operations and/or routines at one or more client or remote applications. When the native structure is unavailable, or does not satisfy certain criteria, other actions can be initiated for fetching data from remote sources or utilizing other locally available application data structures. In some implementations, graphical user interface elements indicating operation statuses can be rendered based on the available data structure(s), thereby aiding in selecting certain services across multiple applications.

Abstract: Systems and methods for dynamically inserting content into webpages. A computing device can receive an information resource. The computing device can receive a content item for insertion at one of the candidate content insertion locations of the information resource. The computing device can identify candidate content insertion locations for insertion of the content item based on locations of one or more elements on the information resource. The computing device can monitor for a scroll event on the information resource. The computing device can identify a portion of the information resource to be displayed within the viewport of the application subsequent to processing the event. The computing device can determine that one of the candidate insertion locations is within or below the viewport. The computing device can set a content slot at the determined content insertion location. The computing device can insert, at the content slot, the content item.

Abstract: The systems and methods of the present disclosure generally relate to a data processing system that can identify and surface alternative requests when presented with ambiguous, unclear, or other requests to which a data processing system may not be able to respond. The data processing system can improve the efficiency of network transmissions to reduce network bandwidth usage and processor utilization by selecting alternative requests that are responsive to the intent of the original request.

Abstract: Implementations set forth herein relate to an automated assistant that can solicit other devices for data that can assist with user authentication. User authentication can be streamlined for certain requests by removing a requirement that all authentication be performed at a single device and/or by a single application. For instance, the automated assistant can rely on data from other devices, which can indicate a degree to which a user is predicted to be present at a location of an assistant-enabled device. The automated assistant can process this data to make a determination regarding whether the user should be authenticated in response to an assistant input and/or pre-emptively before the user provides an assistant input. In some implementations, the automated assistant can perform one or more factors of authentication and utilize the data to verify the user in lieu of performing one or more other factors of authentication.

Abstract: The present disclosure is generally directed to methods, apparatus, and computer-readable media (transitory and non-transitory) for learning to automatically navigate interactive web documents and/or websites. More particularly, various approaches are presented for training various deep Q network (DQN) agents to perform various tasks associated with reinforcement learning, including hierarchical reinforcement learning, in challenging web navigation environments with sparse rewards and large state and action spaces. These agents include a web navigation agent that can use learned value function(s) to automatically navigate through interactive web documents, as well as a training agent, referred to herein as a “meta-trainer,” that can be trained to generate synthetic training examples. Some approaches described herein may be implemented when expert demonstrations are available. Other approaches described herein may be implemented when expert demonstrations are not available.

Abstract: Methods, systems, and apparatuses, including computer programs encoded on computer-readable media, for providing network activity performance data in a content infrastructure. Instructions stored in the system or apparatus, when executed by processors, cause the processors to: identify a content item provided by a content provider device; calculate a set of keyword scores for the set of keywords, each keyword score calculated to measure a relationship between a semantic word cluster of the keyword and a semantic word cluster of an other content for which the content item was previously selected; determine an effect that a particular keyword of the set of keywords has on the online content selection process based on the set of keyword scores; generate a report indicating the effect that the particular keyword has on the online content selection process; and provide, via a network, the report to a client device.

Abstract: Embodiments of the disclosure generally relate to a dialog system allowing for automatically reactivating a speech acquiring mode after the dialog system delivers a response to a user request. The reactivation parameters, such as a delay, depend on a number of predetermined factors and conversation scenarios. The embodiments further provide for a method of operating of the dialog system. An exemplary method comprises the steps of: activating a speech acquiring mode, receiving a first input of a user, deactivating the speech acquiring mode, obtaining a first response associated with the first input, delivering the first response to the user, determining that a conversation mode is activated, and, based on the determination, automatically re-activating the speech acquiring mode within a first predetermined time period after delivery of the first response to the user.

Abstract: In general, in one aspect, a method includes compiling user interaction statistics for a set of content items displayed in association with a first target media document having a non-textual portion, at least some of the content items associated with one or more keywords, based on the interaction statistics, associating the first target media document with at least some of the keywords associated with the content items, and based on a common attribute of the first target media document and a second target media document having a non-textual portion, associating the second target media document with at least some of the keywords assigned to the first target media document. Other aspects include corresponding systems, apparatus, and computer programs stored on computer storage devices.

Abstract: Voice-based interaction with video content being presented by a media player application is enhanced through the use of an automated assistant capable of identifying when a spoken utterance by a user is a request to playback a specific scene in the video content. A query identified in a spoken utterance may be used to access stored scene metadata associated with video content being presented in the vicinity of the user to identify one or more locations in the video content that correspond to the query, such that a media control command may be issued to the media player application to cause the media player application to seek to a particular location in the video content that satisfies the query.

Abstract: A head mounted display (HMD) device and method of manufacturing the same. The HMD includes a frame housing a micro-display to project display light, a lightguide configured to receive the display light from the micro-display, and a corrective layer having a world-side surface coupled to the eye-side surface of the lightguide. The lightguide is further configured to have a world-side surface with a radius of curvature based on an ophthalmic corrective prescription and an eye-side surface having an outcoupler feature formed thereon such that the coupled lightguide and corrective layer form a lens configured to fit within the frame.

Abstract: This document describes systems and techniques that may be used to aggregate information about open parking spots from various different parking providers or organizations.

Abstract: A computing device includes a pixelated electronic display having a substrate and a plurality of pixels arranged thereon. The plurality of pixels includes, at least, a first portion of pixels and a second portion of pixels. The second portion of pixels has a gradually varying pixel aperture size. The computing device also includes at least one sensor positioned under the pixelated electronic display and adjacent to the second portion of pixels having the gradually varying pixel aperture size and at least one processor communicatively coupled to the at least one sensor for controlling the computing device.

Abstract: The present disclosure is directed to generating animated images for presentation by a dynamic keyboard interface. In particular, the methods and systems of the present disclosure can: receive data describing advertisement content, and data describing a first context in which to present the advertisement content; generate data describing a first animated image including at least a portion of the advertisement content; determine a second context in which to present the advertisement content; generate data describing a second animated image including at least a portion of the advertisement content; and communicate, to one or more user devices on which one or more applications are executed, data indicating a plurality of different animated images for presentation by a dynamic keyboard interface in association with the one or more applications, the plurality of different animated images comprising the first animated image and the second animated image.

Abstract: Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for modifying queries in a discourse context. In one aspect, a method includes determining whether a query received from a user device subsequent to information provided to a user device and that defines a discourse context belongs to the discourse context. If the query belongs to the discourse context, the query is modified to take into account attributes of the discourse context.

Abstract: Updating cumulative distribution functions (CDFs) during arithmetic encoding can be a challenge because the final element of the CDF should remain fixed during the update calculations. If the probabilities were floating-point numbers, this would not be too much of a challenge; nevertheless, the probabilities and hence the CDFs are represented as integers to take advantage of infinite-precision arithmetic. Some of these difficulties may be alleviated by introducing a “mixing” CDF along with the active CDF being updated; the mixing CDF provides nonlocal context for updating the CDF due to the introduction of a particular symbol in the encoding. Improved techniques of performing arithmetic encoding include updating the CDF using two, one-dimensional mixing CDF arrays: a symbol-dependent array and a symbol-dependent array. The symbol-dependent array is a sub array of a larger, fixed array such that the sub array selected depends on the symbol being used.

Abstract: As part of a dialog session between a user and an automated assistant, implementations can receive a stream of audio data that captures a spoken utterance including an assistant query, determine, based on processing the stream of audio data, a set of assistant outputs that are each predicted to be responsive to the assistant query, process, using large language model (LLM) output(s), the assistant outputs and context of the dialog session to generate a set of modified assistant outputs, and cause given modified assistant output, from among the set of modified assistant outputs, to be provided for presentation to the user in response to the spoken utterance. In some implementations, the LLM output(s) can be generated in an offline manner for subsequent use in an online manner. In additional or alternative implementations, the LLM output(s) can be generated in an online manner when the spoken utterance is received.

Abstract: The present disclosure is generally related to systems and methods of interfacing among multiple applications in a networked computer environment. A data processing system can access a navigation application to retrieve point locations within a reference frame corresponding to a geographic region displayed in a viewport of the navigation application. Each point location can have an identifier. The data processing system can parse an input audio signal to identify a request and a referential word. The data processing system can identify a point location within the reference frame based on the referential word parsed from the input audio signal and the identifier for the point location. The data processing system can generate an action data structure including the point location identified. The data processing system can transmit the action data structure to the navigation application to initiate a navigation guidance process using the point location.

Abstract: Implementations are described herein for recommending actions based on entity or entity type. In various implementations, a partial free-form natural language input may be received from a user at an input component of a computing device. The partial free-form natural language input may identify an entity without identifying a responsive action and may be directed by the user to an automated assistant that operates at least in part on the computing device. The partial free-form natural language input may be analyzed to identify the entity. Based on the identified entity, a plurality or superset of candidate responsive actions may be identified, filtered, and/or ranked based on one or more signals. The automated assistant may then provide output that recommends one or more of the candidate responsive actions based on the ranking and/or filtering.