Abstract: The present disclosure is generally related to systems and methods of rendering visual components on applications. At least one action-inventory can indicate to render a user interface component. A data processing system can identify a request from an input audio signal from a client device. The client device can display a first application in a foreground process. The data processing system can select an action-inventory to execute the action corresponding to the request by a second application. The data processing system can generate an action data structure using the action-inventory to provide to the second application. The data processing system can determine that an output of the second application is authorized to be presented with the first application. The data processing system can display, on the client device, a user interface component from the second application with the first application.

Abstract: Implementing and applying an adaptive and self-training CAPTCHA (“Completely Automated Public Turing test to tell Computers and Humans Apart”) assistant that distinguishes between a computer-generated communication (e.g., speech and/or typed) and communication that originates from a human. The CAPTCHA assistant utilizes a generative adversarial network that is self-training and includes a generator to generate synthetic answers and a discriminator to distinguish between human answers and synthetic answers. The trained discriminator is applied to potentially malicious remote entities, which are provided challenge phrases. Answers from the remote entities are provided to the discriminator to predict whether the answer originated from a human or was computer-generated.

Abstract: Methods and apparatus are described herein emulating, by one or more servers on behalf of a mobile computing device, a cloud-based virtual machine. The cloud-based virtual machine may include a virtualized hardware component that provides, as virtual hardware input for a software application executing on the cloud-based virtual machine, either “genuine” virtual hardware input or “simulated” virtual hardware input. Genuine virtual hardware input may be based on an actual hardware signal received from a hardware component of the mobile computing device that corresponds to the virtualized hardware component. Simulated virtual hardware input may be generated independently of any hardware signal associated with the hardware component. Output of the software application may be interactively streamed to the mobile computing device.

Abstract: Techniques described herein relate to facilitating end-to-end multilingual communications with automated assistants. In various implementations, speech recognition output may be generated based on voice input in a first language. A first language intent may be identified based on the speech recognition output and fulfilled in order to generate a first natural language output candidate in the first language. At least part of the speech recognition output may be translated to a second language to generate an at least partial translation, which may then be used to identify a second language intent that is fulfilled to generate a second natural language output candidate in the second language. Scores may be determined for the first and second natural language output candidates, and based on the scores, a natural language output may be selected for presentation.

Abstract: Embodiments of the disclosure generally relate to a dialog system allowing for automatically reactivating a speech acquiring mode after the dialog system delivers a response to a user request. The reactivation parameters, such as a delay, depend on a number of predetermined factors and conversation scenarios. The embodiments further provide for a method of operating of the dialog system. An exemplary method comprises the steps of: activating a speech acquiring mode, receiving a first input of a user, deactivating the speech acquiring mode, obtaining a first response associated with the first input, delivering the first response to the user, determining that a conversation mode is activated, and, based on the determination, automatically re-activating the speech acquiring mode within a first predetermined time period after delivery of the first response to the user.

Abstract: According to an aspect, a system includes a battery configured to be charged by a power source, a charging circuit coupled to the battery, and a battery charging manager configured to communicate with the charging circuit to control a charging of the battery by the power source. The battery charging manager obtains a charge pattern including an end charge time corresponding to a time when the battery is estimated to be disconnected from the power source. The battery charging manager controls the charging circuit to charge, over a first charging period, the battery to a temporary charge level, maintain, over a relaxation period, a battery charge level between the temporary charge level and a maintenance charge level, and charge, over a second charging period after the relaxation period, the battery to a maximum battery charge level before the end charge time.

Abstract: Systems and methods of the present disclosure relate generally to a data processing system that identifies possibly manipulated or fraudulent digital components in a computer network environment. The data processing system can improve the efficiency and effectiveness of data packet (or other protocol based) transmission over one or more computer networks by, for example, preventing or reducing the number of manipulated or fraudulent digital component transmissions.

Abstract: Provided are systems and methods for contrastive learning of visual representations. In particular, the present disclosure provides systems and methods that leverage particular data augmentation schemes and a learnable nonlinear transformation between the representation and the contrastive loss to provide improved visual representations. In contrast to certain existing techniques, the contrastive self-supervised learning algorithms described herein do not require specialized architectures or a memory bank. Some example implementations of the proposed approaches can be referred to as a simple framework for contrastive learning of representations or “SimCLR.” Further example aspects are described below and provide the following benefits and insights.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-storage medium, for using a search engine implemented on a user device to identify topics or tasks associated with native application content. The method may include actions of receiving a set of data that is generated by the native application and that includes (i) native application content, and (ii) context information associated with the native application content, indexing the data on the user device, and then identifying one or more tasks based on the indexed data.

Abstract: Embodiments of a system method and computer program product for selecting an advertisement and presenting it to a user are described. Products and services offered by various merchants are read using a merchant specific catalog and stored in a common format. Categories for such products and services are normalized and virtual categories are created using various product attributes. Visual creatives, termed as ad-templates are created to control the visual and interactive aspects of the ad, including ad-size, color, as well as product attributes that are displayed in the ad. Ad-templates may be constrained to specific products or product categories. A learning algorithm uses an adaptive sampling process to sample various products, product categories and ad-templates independently for different learning units such as individual users, groups of users determined by some demographics, individual web pages and groups of web pages grouped using various similarity criteria.

Abstract: To dynamically restyle map features related to a navigation route on a digital map, a server device and/or a client device selectively applies different visual styles to certain map features to emphasize and de-emphasize navigation routes or other logically linked sets of map features. For example, the server device instructs the client device to visually emphasize the road segments included in the navigation route, de-emphasize road segments not in the navigation route, and leave the remaining features at the default (standard) level of detail. The client device then re-renders the map features accordingly.

Abstract: Methods and apparatus related to identifying a video for completing a task and determining a plurality of video segments of the identified video based on one or more attributes of the task. A task and a plurality of how-to videos related to the task may be identified. A how-to video may be selected and a plurality of video segments of the selected how-to video may be determined. One or more video segments may be associated with one or more task attributes that relate to performing the task. The selected video may be provided to a user and segmented, indexed, and/or annotated based on the associated video segments. In some implementations a given object utilized in performing the task may be identified and one or more video segments corresponding to the given object may be identified and/or provided to the user.

Abstract: Methods and systems for providing a user with content relevant to a location of interest to the user, when the user is determined to be at or near the location, are presented. The user's interest in the location may be determined based on queries about the location received from the user prior to the user arriving at the location. The queries received from the user about the location are used to build a location recommendation model, which generates personalized content relevant to the location and to one or more interest verticals identified for the user. The location recommendation model is built using a location recommendation engine that collects data about the user, the queried location, one or more associations between the user, the queried location, and/or one or more other users, as well as various other information related to the user's interests and the queried location.

Abstract: Techniques are described herein for determining an information gain score for one or more documents of interest to the user and present information from the documents based on the information gain score. An information gain score for a given document is indicative of additional information that is included in the document beyond information contained in documents that were previously viewed by the user. In some implementations, the information gain score may be determined for one or more documents by applying data from the documents across a machine learning model to generate an information gain score. Based on the information gain scores of a set of documents, the documents can be provided to the user in a manner that reflects the likely information gain that can be attained by the user if the user were to view the documents.

Abstract: A position of a cursor may be detected within an augmented reality (AR) display of a physical space captured by a camera. A snapping range of a snap-select function of the cursor may be dynamically changed in response to the position of the cursor. Accordingly, a user may place or hold a camera in a location to view an associated AR display, and may easily and precisely execute a snap-select function to select a desired AR object, even when the AR display includes AR objects that are of different sizes, or are different distances from the camera.

Abstract: An endorsement application can allow a user to endorse a product on a social network website when the product is purchased at a physical merchant point of sale terminal. Users of social network websites have been given the opportunity to endorse products that they have located or purchased online, but purchasers of products in person have not had that opportunity. The endorsement application can operate on a user's mobile device and can recognize a product purchased through near field or other communication using the mobile device. The application can isolate the product identification and product marketing data supplied by the point of sale terminal or other source and offer the user the opportunity to endorse the product on a social network website. If the user endorses the product, the application sends the endorsement to the user's account on the social network website for display to the user's community.

Abstract: A computer-implemented method for optimizing the placement of previously selected breaks in a media item is provided herein. Embodiments of the method include steps of identifying a break in a media item, the break being associated with a first break point at a first time during playback of the media item. The method may also include steps of dynamically adjusting the placement of the breaks within the media item based on the performance of the media item.

Abstract: A method including receiving, at a first computing system from a second computing system, a first key and encrypted online interaction data, receiving, at the first computing system from a third computing system, a second key and encrypted offline action data encoding data indicating one or more offline actions, receiving, at the first computing system from the third computing system, executable code comprising a third key, and executing, by the first computing system, the executable code. The executable code causing the first computing system to decrypt the encrypted online interaction data and the encrypted offline action data using the first key, the second key, and the third key, correlate one or more of the offline actions in the offline action data to one or more online interactions in the online interaction data, and generate aggregate data indicating a number of offline actions correlated to the online interactions.

Abstract: Systems and methods for prefetching content items for display by applications executed on computing devices are provided. The method can include transmitting a first request for content to display within an environment of the application, the first request for content including a first parameter to be used to determine a first content item for display; storing in an associated memory element, the first parameter; transmitting a follow-on request for content including the first parameter of the first request for content; receiving a follow-on content item responsive to the follow-on request for content; storing the follow-on content item in a local cache structure specific to the application; transmitting a second request for content; retrieving, in response to the second request, the follow-on content item from the local cache structure; and displaying, in response to the second request, the follow-on content item within the environment of the application on the computing device.