Abstract: Systems, methods, and apparatus for dynamically partitioning items in a list into one or more subsets in a manner tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions, etc. A list can be partitioned into subsets in part based on a currently modality of a multimodal device, one or more list attributes indicating additional information about the list, etc.

Abstract: A method for automatically populating an ecommerce cart is disclosed. The method includes receiving a request to add a product item to a shopping cart of an ecommerce shopping environment. The method includes adding the product item to the shopping cart. The method includes updating, responsive to adding the product item, a shopping cart status. The method includes determining a failure of the shopping cart status to satisfy a purchasing criteria associated with the ecommerce shopping environment. The method includes selecting, responsive to determining the failure, an additional product item based on information associated with an user account. The method includes adding the additional product item to the shopping cart.

Abstract: Decoding a current block of a current frame includes selecting a first reference frame for forward inter prediction of the current frame; selecting a second reference frame for backward inter prediction of the current frame; generating an optical flow reference frame portion for inter prediction of the current block by performing an optical flow estimation using the first reference frame and the second reference frame, where the optical flow estimation produces a respective motion field for pixels of the current block; and performing a prediction process for the current block using the optical flow reference frame portion by: using a motion vector used to encode the current block to identify a reference block; adjusting boundaries of the reference block using a subpixel interpolation filter length; and identifying blocks encompassing pixels within the adjusted boundaries of the reference block.

Abstract: A system to improve real-time generation of a graphical user interface for overlapping electronic content is described. The system retrieves, responsive to a search request input into a computing device and received via a computer network, places of interest from a places of interest database, and content items from a content item database. The system selects, based on a heuristic technique, a content item as a match for a place of interest. The system combines the content item with the place of interest to prevent a first marker of the content item from obscuring a second marker of the place of interest. The system renders, for display on the graphical user interface via the computing device, a single marker for the content item and the place of interest combined to prevent the first marker of the content item from obscuring the second marker of the place of interest.

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

Abstract: Systems and methods are provided for sharing a screen from a mobile device. For example, a method includes receiving, at a second mobile device, an image of a screen captured from a first mobile device and determining whether to trigger an automated action. The method may also include displaying, responsive to not triggering the automated action, annotation data generated for the image with the image on a display of the second mobile device, the annotation data including at least one visual cue corresponding to content in the image relevant to a user of the second mobile device. The method may further include, responsive to triggering the automated action, determining that a mobile application associated with the image is installed on the second mobile device and replaying user input actions received with the image on the second mobile device starting from a reference screen associated with the mobile application.

Abstract: Systems and methods for detecting improper presentation of content items by applications executing on client devices. A method can include receiving a content package including a first content item, a second content item and an interaction confirmation script, the interaction confirmation script configured to execute within an application and cause the application to detect, responsive to the first content item presented, a first interaction event with the first content item; present, upon detecting the first interaction event on the first content item, the second content item; detect a second interaction event with the second content item; transmit, upon detecting the second interaction event, a confirmation of the first interaction event; and transmit a request to access an information resource linked to the second content item. The method can further include presenting the information resource responsive to the second interaction event on the second content item.

Abstract: A computer implemented method for displaying shoppable advertisements based on search query including receiving the search query from a user; retrieving an image comprising plurality of purchasable products related to the search query from a database; calculating a product relevance score for each of the plurality of products within each image based the search query; ranking each of the plurality products based on the product relevance score; selecting a subset of products based on the ranking; displaying the image comprising the plurality of products; and displaying the shoppable advertisements for the selected subset of products on a user device.

Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for expedited indexing of content is presented. Submitted content is received via a user interface, where the submitted content is copy-and-pasted content from an entity claiming authorship of the content. A link identifying an Internet address hosting the submitted is also received. Responsive to determining the submitted content is new relative to known content, the submitted content is indexed without visiting the Internet address.

Abstract: Optical assemblies for use in virtual and augmented reality environments are described. The optical assemblies may include lenses, filter stacks, cameras, and image projecting devices. For example, the optical assemblies may include at least one lens, a first filter stack between the at least one lens and an image projecting device, a second filter stack between the first filter stack and the image projecting device, and a camera configured to capture images of an infrared reflection of light through the at least one lens.

Abstract: The present disclosure provides an improved training methodology that enables supervised contrastive learning to be simultaneously performed across multiple positive and negative training examples. In particular, example aspects of the present disclosure are directed to an improved, supervised version of the batch contrastive loss, which has been shown to be very effective at learning powerful representations in the self-supervised setting. Thus, the proposed techniques adapt contrastive learning to the fully supervised setting and also enable learning to occur simultaneously across multiple positive examples.

Abstract: The present disclosure is directed to systems and methods for providing improved tools (e.g., user interfaces) that can be used for managing access permissions to cloud or other network resources. In general, the systems and methods include providing a user interface that can function in at least two modes which together can provide an improved user experience for intuitively and effectively developing code. As an example, the two interface modes can include a builder mode in which the user interface includes one or more interactive elements that enable a user to modularly build a set of computer-readable code that controls access permissions to one or more computing resources and an editor mode in which the user interface allows the user to directly edit the set of computer-readable code.

Abstract: The present disclosure provides systems and methods that use and/or generate image files according to a novel microvideo image format. For example, a microvideo can be a file that contains both a still image and a brief video. The microvideo can include multiple tracks, such as, for example, a separate video track, audio track, and/or one or more metadata tracks. As one example track, the microvideo can include a motion data track that stores motion data that can be used (e.g., at file runtime) to stabilize the video frames. A microvideo generation system included in an image capture device can determine a trimming of the video on-the-fly as the image capture device captures the microvideo.

Abstract: In an aspect, a method includes receiving lists of entities, each list (i) having an associated score, (ii) being associated with a respective context fact, and (iii) ranking a subset of the entities, and for each of the lists of entities, generating, for each entity on the list, a data structure that references (i) the entity, (ii) the context fact associated with the list, (iii) the rank of the entity for the context fact, and (iv) the score for the list. The method can also include receiving data identifying a particular entity, selecting a particular data structure that references the particular entity, and providing, for output, data indicating (i) the context fact associated with the particular data structure that references the particular entity, and (ii) the rank of the entity for the context fact associated with the particular data structure that references the particular entity.

Abstract: Embodiments retrieve a set of search results that have been previously identified as having at least one associated date or location. A timeline or map is displayed that visually represents the distribution of the dates or locations within the results. The timeline is displayed with a histogram graph corresponding to the number of dates in the search results at points along the timeline. The map is displayed with markers at the locations corresponding to the locations in the search results. The user can navigate the result set using the displayed timeline or map.

Abstract: A method of providing navigation directions includes receiving, at a user terminal, a query spoken by a user, wherein the query spoken by the user includes a speech utterance indicating (i) a category of business, (ii) a name of the business, and (iii) a location at which or near which the business is disposed; identifying, by processing hardware, the business based on the speech utterance; and providing navigation directions to the business via the user terminal.

Abstract: A first user, who is currently online, is associated with a meeting spot. A plurality of other users that have selected the meeting spot and are online is identified. Information about these other users is sent to a client device associated with the first user. Information for a second user of the plurality of other users is received from the client device associated with the first user. A third user is identified who is online and associated with the first and second users. Online communication is facilitated between the client devices associated with the first and second users and a client device associated with the third user responsive to a request from the client device associated with the first user to the client device associated with the third user to be introduced by the third user to the second user, while the second user has still selected the meeting spot.

Abstract: The present disclosure provides systems and methods for calibration-free instant motion tracking useful, for example, for rending virtual content in augmented reality settings. In particular, a computing system can iteratively augment image frames that depict a scene to insert virtual content at an anchor region within the scene, including situations in which the anchor region moves relative to the scene. To do so, the computing system can estimate, for each of a number of sequential image frames: a rotation of an image capture system that captures the image frames; and a translation of the anchor region relative to an image capture system, thereby providing sufficient information to determine where and at what orientation to render the virtual content within the image frame.