Abstract: Methods, systems, and media for object grouping and manipulation in immersive environments are provided. In some embodiments, a method can include: displaying a plurality of virtual objects in an immersive environment; generating a group virtual object that includes a first virtual object and a second virtual object, the group virtual object including a handle interface element for interacting with the group virtual object and a selectable indicator associated with the first virtual object and the second virtual object; displaying the group virtual object along with the handle interface element and the selectable indicator in the immersive environment; and in response to detecting a selection of the selectable indicator, displaying a user interface for interacting with the group virtual object.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for collaboratively training an interaction prediction machine learning model using a plurality of user devices in a manner that respects user privacy. In one aspect, the machine learning model is configured to process an input comprising: (i) a search query, and (ii) a data element, to generate an output which characterizes a likelihood that a given user would interact with the data element if the data element were presented to the given user on a webpage identified by a search result responsive to the search query.

Abstract: Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.

Abstract: Implementations are described herein for predicting symbolic transformation templates to automate source code transformations. In various implementations, pair(s) of predecessor and successor source code snippets may be processed using a symbolic transformation template prediction (STTP) model to predict a symbolic transformation template that includes a predecessor portion that matches the predecessor source code snippet(s) of the pair(s) and a successor portion that matches the successor source code snippet(s) of the pair(s). At least one additional predecessor source code snippet may be identified that matches the predecessor portion of the predicted symbolic transformation template. Placeholders of the predecessor portion of the predicted symbolic transformation template may be bound to one or more tokens of the at least one additional predecessor source code snippet to create binding(s).

Abstract: This document describes systems and techniques that may be used to aggregate information about open parking spots from various different parking providers or organizations.

Abstract: As part of a dialog session between a user and an automated assistant, implementations can receive a stream of audio data that captures a spoken utterance including an assistant query, determine, based on processing the stream of audio data, a set of assistant outputs that are each predicted to be responsive to the assistant query, process, using large language model (LLM) output(s), the assistant outputs and context of the dialog session to generate a set of modified assistant outputs, and cause given modified assistant output, from among the set of modified assistant outputs, to be provided for presentation to the user in response to the spoken utterance. In some implementations, the LLM output(s) can be generated in an offline manner for subsequent use in an online manner. In additional or alternative implementations, the LLM output(s) can be generated in an online manner when the spoken utterance is received.

Abstract: Implementations are described herein for analyzing existing graphical user interfaces (“GUIs”) to facilitate automatic interaction with those GUIs, e.g., by automated assistants or via other user interfaces, with minimal effort from the hosts of those GUIs. For example, in various implementations, a user intent to interact with a particular GUI may be determined based at least in part on a free-form natural language input. Based on the user intent, a target visual cue to be located in the GUI may be identified, and object recognition processing may be performed on a screenshot of the GUI to determine a location of a detected instance of the target visual cue in the screenshot. Based on the location of the detected instance of the target visual cue, an interactive element of the GUI may be identified and automatically populate with data determined from the user intent.

Abstract: Real-time micro-profile generating using a dynamic tree structure is provided. A system receives a first voice query. The system generates, from historical searches related to the first voice query, a first pivot point in a tree structure for the first voice query having child nodes. The system outputs an audio prompt to request selection of one of the child nodes. The system receives, responsive to the audio prompt, a voice input with a selection of a first child node. The system generates, from historical searches related to the first child node, a second pivot point in the tree structure including grandchild nodes. The system determines, based on a resource reduction policy, to generate a checkpoint to reduce additional child node generation. The system builds, based on a response to the checkpoint, a micro-profile for the electronic account identifier with the tree structure.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for modifying queries in a discourse context. In one aspect, a method includes determining whether a query received from a user device subsequent to information provided to a user device and that defines a discourse context belongs to the discourse context. If the query belongs to the discourse context, the query is modified to take into account attributes of the discourse context.

Abstract: The present disclosure provides systems and methods for low-latency provision of content. The method includes receiving one or more signals indicating a current location of a client device; before receiving an input query from a map application of the client device, retrieving characteristics of the client device; and generating a set of identifications, the set of identifications including the current location of the client device, and the characteristics of the client device. The method further includes determining that a query prediction exceeds a threshold; responsive to the determination that the query prediction exceeds the threshold, selecting a link to a geographic location of an entity that is associated with the query prediction; and, responsive to a selection of a map application on the client device by a user, transmitting the selected link to the client device before receiving a query from the user of the client device.

Abstract: Implementations set forth herein relate to an automated assistant that can render selectable suggestion(s) at a display interface of computerized glasses, and can adapt the suggestions according to changes to a gaze direction of the user and/or other further inputs from the user. The selectable suggestion(s) can be initially rendered based on contextual data that may be associated with a user who is directing their gaze into an environment that includes different environmental features. Certain environmental features can be identified by the automated assistant as being predicted to be of interest to the user and—when a user expresses interest in a particular feature—the selectable suggestions can be adapted. Interest of the user in the particular environmental feature can be expressed by redirecting their gaze towards the particular feature and/or providing further input relevant to the particular feature.

Abstract: Transform modes are derived for inter-predicted blocks using side information. A prediction residual is generated for a current video block using a reference frame. Side information associated with one or both of the current video block or the reference frame is identified. A trained transform is determined from amongst multiple trained transforms based on the side information, in which each of the trained transforms is determined using individual side information types and combinations of the individual side information types and the side information represents values of one of the individual side information types or one of the combinations of the individual side information types. The prediction residual is transformed according to the trained transform, and data associated with the transformed prediction residual and the side information are encoded to a bitstream.

Abstract: Systems and methods for detecting improper presentation of content items by applications executing on client devices. A method can include: (i) receiving content requests from a plurality of client devices, wherein each of the content requests is generated by an application executing on a respective client device of the plurality of client devices; (ii) transmitting to each client device of the plurality of client devices, responsive to a content request from the client device, a content package including at least a content item and an interaction confirmation script; (iii) determining a location parameter associated with the interaction confirmation script; (iv) determining a performance metric of the content item; and (v) determining whether the application receives inadvertent clicks at the content item based on the performance metric and the location parameter.

Abstract: In accordance with some implementations, a method for measuring viewership of media content is disclosed. The method is performed on a client system. The client system obtains identification information for individuals who have agreed to participate in a media viewership totals measurement study, detects a first user of the client system, determines media content being presented in proximity to the first user, automatically determines if the first user is an individual who has agreed to participate in the media viewership totals measurement study; and generates viewership data according to the determination.

Abstract: A content management system server can obtain a protocol based data transmission via a computer network from a script that executes at the publisher device server, and can obtain search result content items from an index of electronic documents that include snippets of text extracted from the search result content items and that include hypertext links to the search result content items. The system can extract feature vectors and document identifiers of the search result content items, and can determine information retrieval scores of search result content items. Based on the network identifier, location probabilities of device locations can be ranked and compared to thresholds. The system can determine a confidence threshold representing a minimum degree of certainty of the geographical location of the devices and can select content for protocol based transmission accordingly.

Abstract: Utilization of user interface inputs, from remote client devices, in controlling robot(s) in an environment. Implementations relate to generating training instances based on object manipulation parameters, defined by instances of user interface input(s), and training machine learning model(s) to predict the object manipulation parameter(s). Those implementations can subsequently utilize the trained machine learning model(s) to reduce a quantity of instances that input(s) from remote client device(s) are solicited in performing a given set of robotic manipulations and/or to reduce the extent of input(s) from remote client device(s) in performing a given set of robotic operations. Implementations are additionally or alternatively related to mitigating idle time of robot(s) through the utilization of vision data that captures object(s), to be manipulated by a robot, prior to the object(s) being transported to a robot workspace within which the robot can reach and manipulate the object.

Abstract: Methods, systems, devices, and tangible non-transitory computer readable media for generating a route through a geographic area are provided. The disclosed technology can generate an unoccupied cell map. The unoccupied cell map can include cells that are associated with unoccupied portions of a geographic area that are not associated with light detection and ranging (LiDAR) returns. Further, route request data that is associated with a request for a route from a starting location to one or more destination locations within the geographic area can be received. Based on the route request data, the unoccupied cell map can be accessed. A route, based on the unoccupied cell map, can then be generated. Furthermore, the route can include the unoccupied cells between a starting location and one or more destination locations within the geographic area. Indications associated with the route can then be generated.

Abstract: Generating expanded responses that guide continuance of a human-to computer dialog that is facilitated by a client device and that is between at least one user and an automated assistant. The expanded responses are generated by the automated assistant in response to user interface input provided by the user via the client device, and are caused to be rendered to the user via the client device, as a response, by the automated assistant, to the user interface input of the user. An expanded response is generated based on at least one entity of interest determined based on the user interface input, and is generated to incorporate content related to one or more additional entities that are related to the entity of interest, but that are not explicitly referenced by the user interface input.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.

Abstract: Game decisions are coordinated using a semantic natural language processing (NLP) machine learning (ML) algorithm, which is stored in a memory in some cases. In response to a game event, a processor records a text string that represents the game event in a text log that includes a sequence of text strings that represent game events that have transpired during a portion of the game. The processor also generates, using the semantic NLP ML algorithm, scores for labeled actions or content based on the text log and a curve that represents a target player experience as a function of progress through the game. The processor further serves one or more of the labeled actions or content that is selected based on the scores. The labeled actions or content are served to a display associated with the processor.