Abstract: Implementations described herein relate to various techniques for biasing interpretations of spoken utterances that are received in a vehicular environment. For example, implementations can receive a spoken utterance that includes a query from a user of a vehicle and obtain a corresponding vehicle sensor data instance generated by vehicle sensor(s) of the vehicle. Some implementations can determine to execute a search over only a first corpus of data, but not a second corpus of data, to obtain a given response to the query based on various criteria, including at least the query, the corresponding vehicle sensor data instance, a corresponding timestamp associated with the corresponding vehicle sensor data instance, and/or a corresponding duration of time the user has been associated with the vehicle. Additional, or alternative, implementations can execute a search over both the first and second corpora of data, and obtain the given response based on the criteria.

Abstract: Implementations described herein are directed to leveraging odor sensor(s) of client device(s) in responding to user request(s) and/or in generating notification(s). Processor(s) of a given client device can receive a request to identify an odor in an environment of the given client device, process an odor data instance generated by the odor sensor(s) of the given client device, identify the odor based on processing the odor data instance, generate a response that identifies the odor and/or a source of the odor, and cause the response to the request to be rendered via the given client device. Processor(s) of the given client device can additionally, or alternatively, establish baseline odor(s) in the environment and generate a notification when an odor is detected that does not correspond to the baseline odor(s) and/or exclude the baseline odor(s) in generating the response to the request.

Abstract: Provided are methods, systems, devices, and tangible non-transitory computer readable media for providing data including vehicle map service data. The disclosed technology can perform operations including receiving vehicle map service data from a plurality of service systems that include a plurality of client systems associated with a vehicle. The vehicle map service data can include information associated with a geographic area. A local map of the geographic area within a predetermined distance of the vehicle can be generated based on the vehicle map service data. Portions of the local map to which each client system is subscribed can be determined for each client system of the plurality of client systems. Additionally, the portions of the local map to which each client system is subscribed can be sent to a respective client system of the plurality of client systems.

Abstract: A system includes a head-mounted display (HMD) device configured to project digital images to a user's eye and a viewing device. The viewing device includes an optical relay unit having a world-facing surface and an eye-facing surface and a holder coupled to the optical relay unit and configured to support the HMD device near the world-facing surface. The optical relay unit is configured to transmit light projected by the HMD device to an eye-facing aperture disposed at the eye-facing surface of the optical relay. The system shifts an eyebox of the HMD by receiving light projected from an optical combiner of the HMD, transmitting the light through the optical relay unit of the viewing device to the eye-facing aperture of the optical relay unit, and outputting the light from the eye-facing aperture such that the light is focused at an eyebox in which a user's eye is located.

Abstract: Systems and methods of automatically extracting summaries of video content are described herein. A data processing system can access, from a video database, a first video content element including a first plurality of frame. The data processing system can select an intervallic subset of the first plurality of frames of the first video content element. The data processing system can calculate, for each of a plurality of further subsets comprising a predetermined number of frames from the intervallic subset, a score for the further subset. The data processing system can identify, from the plurality of further subsets, a further subset having a highest score. The data processing system can select a portion of the first video content element comprising the frames of the further subset having the highest score. The data processing system can generate a second video content element comprising the selected portion of the first video content element.

Abstract: The present disclosure provides computing systems in which respective quorums of computing nodes securely manage respective secrets associated with cryptographic ledgers according to threshold secret sharing schemes. In particular, membership in the quorums can be changed dynamically and unpredictability to improve security of the quorums against adversarial attacks in which adversaries attempt to compromise or gain control of the computing nodes. More specifically, by changing membership in the quorum dynamically and unpredictability, the ability of the adversary to control at any given time a threshold number of the current members of the quorum and gain access to the secret is dramatically reduced.

Abstract: An operator selects an application on a first user computing device to request a data transfer with a second user computing device. The first user computing device broadcasts an audio token comprising data. The first user computing device activates a microphone component, successively cycles through available audio configurations, applies each selected audio configuration to received audio token data, determines a signal score for each applied audio configuration, and transmits processed audio token data and signal scores to an account management system. The account management system also receives processed audio token data from multiple other computing devices of the same model as the first user computing device. The account management system selects a default audio configuration for the model based on the determined signal scores. The account management system transmits instructions to known computing devices of the model to apply the default audio configuration to future reception of audio token data.

Abstract: At least one aspect of the present disclosure is directed to systems and methods of converting static content items into interactive content items. A data processing system can identify a first content item. The data processing system can divide, in accordance with a partition template, the visual content of the first content item into a plurality of segments. The partition template can define a number of segments to be formed from the visual content. The data processing system can generate a second script. The second script can assign each segment into a position. The script can enable movement of each segment within the frame. The script can determine that the segments are moved to a target position. The script can perform an action to provide information related to the visual content. The data processing system can provide the second content item to a client device.

Abstract: The present disclosure is generally directed to methods, apparatus, and computer-readable media (transitory and non-transitory) for learning to automatically navigate interactive web documents and/or websites. More particularly, various approaches are presented for training various deep Q network (DQN) agents to perform various tasks associated with reinforcement learning, including hierarchical reinforcement learning, in challenging web navigation environments with sparse rewards and large state and action spaces. These agents include a web navigation agent that can use learned value function(s) to automatically navigate through interactive web documents, as well as a training agent, referred to herein as a “meta-trainer,” that can be trained to generate synthetic training examples. Some approaches described herein may be implemented when expert demonstrations are available. Other approaches described herein may be implemented when expert demonstrations are not available.

Abstract: To present a navigation directions preview, a server device receives a request for navigation directions from a starting location to a destination location and generates a set of navigation directions in response to the request. The set of navigation directions includes a set of route segments for traversing from the starting location to the destination location. The server device selects a subset of the route segments based on characteristics of each route segment in the set of route segments. For each selected route segment, the server device provides a preview of the route segment to be displayed on a client device. The preview of the route segment includes panoramic street level imagery depicting the route segment.

Abstract: At least selectively utilizing a large language model (LLM) in generating a natural language (NL) based summary to be rendered in response to a query. In some implementations, in generating the NL based summary additional content is processed using the LLM. The additional content is in addition to query content of the query itself and, in generating the NL based summary, can be processed using the LLM and along with the query content—or even independent of the query content. Processing the additional content can, for example, mitigate occurrences of the NL based summary including inaccuracies and/or can mitigate occurrences of the NL based summary being over-specified and/or under-specified.

Abstract: The present disclosure is generally related to a data processing system to coordinate parallel processing of audio queries across multiple devices. A data processing system can receive an audio input signal detected the display device and parse the audio input signal to identify an entity. The data processing system can transmit a query command to the display device to cause a multimedia content application to perform a search for the entity. The data processing system can access at least one of an address database and a multimedia content provider to identify a reference address for the entity. The data processing system can provide the reference address for the entity to cause the display device to present a content selection interface. The content selection interface can include an element for the reference address, prior to completion of the search for the entity performed by the multimedia content application.

Abstract: Implementations relate to determining multilingual content to render at an interface in response to a user submitted query. Those implementations further relate to determining a first language response and a second language response to a query that is submitted to an automated assistant. Some of those implementations relate to determining multilingual content that includes a response to the query in both the first and second languages. Other implementations relate to determining multilingual content that includes a query suggestion in the first language and a query suggestion in a second language. Some of those implementations relate to pre-fetching results for the query suggestions prior to rendering the multilingual content.

Abstract: Implementations described herein relate to determining how to fulfill a spoken utterance based on a user that provided the spoken utterance. For example, implementations can receive a spoken utterance from a user, determine a set of fulfillment actions for the spoken utterance, and determine whether the user that provided the spoken utterance corresponds to a first user or a second user. Further, and in response to determining that the user corresponds to the first user, implementations can select a subset of first fulfillment action(s) from the set, and cause the subset of first fulfillment action(s) to be implemented to satisfy the spoken utterance. Moreover, and in response to determining that the user corresponds to the second user, implementations can select a subset of distinct, second fulfillment action(s) from the set, and cause the subset of second fulfillment action(s) to be implemented to satisfy the spoken utterance.

Abstract: Implementations set forth herein relate to an automated assistant that can provide suggestions for a user to interact with the automated assistant to control applications while in a vehicle. The suggestions can be provided to encourage hands-free interactions with the applications, by suggesting an assistant input that invokes the automated assistant to operate as an interface between the user and the applications. Assistant suggestions can be based on a context of a user and/or a context of the vehicle, such as content of a display interface of a device that the user is accessing while in the vehicle. For instance, the automated assistant can determine that an action that the user has employed an application to perform can be initialized more safely and/or in less time by utilizing a particular assistant input. This particular assistant input can then be rendered at an interface of a vehicle computing device.

Abstract: This specification is generally directed to techniques for automatically transitioning applications—especially those that enable exchange of messages between users—into and/or out of a private state based on a variety of signals associated with the messages and/or the participants themselves. In various implementations, an ongoing message exchange thread between two or more participants operating two or more respective message exchange clients may be examined. Based at least in part on the examining, a likelihood may be determined that message(s) directed by one of the participants to another of the participants as part of the ongoing message exchange thread would be deemed private by at least a given participant of the two or more participants. A determination may be made of whether the determined likelihood satisfies one or more thresholds, and in response, one or more of the message exchange clients may be transitioned into a private state.

Abstract: A method for intra-prediction of a current block includes selecting peripheral pixels of the current block, where the peripheral pixels are used to generate a prediction block for the current block; for each prediction pixel of the prediction block, performing steps including selecting two respective pixels of the peripheral pixels; and calculating the prediction pixel by interpolating at least the two respective pixels; and coding a residual block corresponding to a difference between the current block and the prediction block.

Abstract: Implementations are set forth herein for creating an order of execution for actions that were requested by a user, via a spoken utterance to an automated assistant. The order of execution for the requested actions can be based on how each requested action can, or is predicted to, affect other requested actions. In some implementations, an order of execution for a series of actions can be determined based on an output of a machine learning model, such as a model that has been trained according to supervised learning. A particular order of execution can be selected to mitigate waste of processing, memory, and network resources—at least relative to other possible orders of execution. Using interaction data that characterizes past performances of automated assistants, certain orders of execution can be adapted over time, thereby allowing the automated assistant to learn from past interactions with one or more users.

Abstract: Systems and methods for optionally restricting the rendering of particular content items. An example method comprising: receiving a plurality of content rendering options supported by a client device; determining a content item to be rendered, the content item being associated with a restriction attribute; selecting a content rendering option supported by the client device in view of the restriction attribute; generating a token comprising data associated with the selected content rendering option and the content item; receiving a client request from the client device, wherein the client request is associated with the content item and indicates a chosen content rendering option; comparing the data of the token with the chosen content rendering option indicated by the client request to determine a match; and granting the client device access to perform the chosen content rendering option on the content item based on the outcome of the determination of the match.

Abstract: A method for forming an electrode is provided. The method includes removing portion(s) of a removable protective film to produce a removable protective film element having a first defined shape; positioning the removable protective film element on a first portion of a cover glass such that the first portion has the first defined shape; defining a second portion of the cover glass based at least in part on positioning the removable protective film element on the first portion, the second portion having a second defined shape; depositing a metal material on the second portion and/or the removable protective film element; removing portion(s) of the metal material to form electrode(s) on the second portion; and/or removing the removable protective film element from the first portion to produce the electrode(s) formed on the cover glass such that the cover glass and/or the electrode(s) have defined attribute(s).