Abstract: Providing at least one contextually relevant suggestion to one or more users of an ongoing message exchange thread between the users. The suggestion is provided for presentation to the user(s) via user interface output device(s) of computing device(s) of the user(s). The suggestion indicates a query that can be submitted to an automated assistant to cause the automated assistant to incorporate, into the message exchange thread, content that is responsive to the query. In some implementations, the suggestion is a selectable suggestion and content that is responsive to the query is incorporated into the message exchange thread in response to user interface input that is directed to the selectable suggestion. In some implementations, the suggestion is determined based on one or more messages that have already been communicated between users of the message exchange thread.

Abstract: A messaging application may automatically analyze content of one or more messages and/or user information to automatically provide suggestions to a user within a messaging application. The suggestions may automatically incorporate particular non-messaging functionality into the messaging application. The automatic suggestions may suggest one or more appropriate responses to be selected by a user to respond in the messaging application, and/or may automatically send one or more appropriate responses on behalf of a user.

Abstract: A system and method for identifying an entity from a message exchange thread and generating a suggestion that is directed to the entity, such as a suggestion for a user to take an action on the entity. A suggestion application receives at least one electronic message from a message exchange thread, identifies an entity that can be actionable from the electronic message, determines contextual indicators of the entity, determines whether the entity is actionable based on the contextual indicators, and responsive to the entity being actionable, provides a suggestion that is directed to the entity to a participant(s) of the message exchange thread.

Abstract: Providing at least one contextually relevant suggestion to one or more users of an ongoing message exchange thread between the users. The suggestion is provided for presentation to the user(s) via user interface output device(s) of computing device(s) of the user(s). The suggestion indicates a query that can be submitted to an automated assistant to cause the automated assistant to incorporate, into the message exchange thread, content that is responsive to the query. In some implementations, the suggestion is a selectable suggestion and content that is responsive to the query is incorporated into the message exchange thread in response to user interface input that is directed to the selectable suggestion. In some implementations, the suggestion is determined based on one or more messages that have already been communicated between users of the message exchange thread.

Abstract: Providing at least one contextually relevant suggestion to one or more users of an ongoing message exchange thread between the users. The suggestion is provided for presentation to the user(s) via user interface output device(s) of computing device(s) of the user(s). The suggestion indicates a query that can be submitted to an automated assistant to cause the automated assistant to incorporate, into the message exchange thread, content that is responsive to the query. In some implementations, the suggestion is a selectable suggestion and content that is responsive to the query is incorporated into the message exchange thread in response to user interface input that is directed to the selectable suggestion. In some implementations, the suggestion is determined based on one or more messages that have already been communicated between users of the message exchange thread.

Abstract: A messaging application may automatically analyze content of one or more messages and/or user information to automatically provide suggestions to a user within a messaging application. The suggestions may automatically incorporate particular non-messaging functionality into the messaging application. The automatic suggestions may suggest one or more appropriate responses to be selected by a user to respond in the messaging application, and/or may automatically send one or more appropriate responses on behalf of a user.

Abstract: Systems, methods and computer readable media for bot interaction are described. For example, some implementations can include a computer-executed method including providing a messaging application, on a first computing device associated with a first user, to enable communication between the first user and at least one other user. The method can also include detecting, at the messaging application, a user request, and programmatically determining that an operation in response to the user request requires sharing of data associated with the first user.

Abstract: A messaging application may automatically analyze content of one or more messages and/or user information to automatically provide suggestions to a user within a messaging application. The suggestions may automatically incorporate particular non-messaging functionality into the messaging application. The automatic suggestions may suggest one or more appropriate responses to be selected by a user to respond in the messaging application, and/or may automatically send one or more appropriate responses on behalf of a user.

Abstract: A system and method for identifying an entity from a message exchange thread and generating a suggestion that is directed to the entity, such as a suggestion for a user to take an action on the entity. A suggestion application receives at least one electronic message from a message exchange thread, identifies an entity that can be actionable from the electronic message, determines contextual indicators of the entity, determines whether the entity is actionable based on the contextual indicators, and responsive to the entity being actionable, provides a suggestion that is directed to the entity to a participant(s) of the message exchange thread.

Abstract: A system and method for identifying an entity from a message exchange thread and generating a suggestion that is directed to the entity, such as a suggestion for a user to take an action on the entity. A suggestion application receives at least one electronic message from a message exchange thread, identifies an entity that can be actionable from the electronic message, determines contextual indicators of the entity, determines whether the entity is actionable based on the contextual indicators, and responsive to the entity being actionable, provides a suggestion that is directed to the entity to a participant(s) of the message exchange thread.

Abstract: Systems, methods and computer readable media for bot interaction are described. For example, some implementations can include a computer-executed method including providing a messaging application, on a first computing device associated with a first user, to enable communication between the first user and at least one other user. The method can also include detecting, at the messaging application, a user request, and programmatically determining that an operation in response to the user request requires sharing of data associated with the first user.

Abstract: Providing at least one contextually relevant suggestion to one or more users of an ongoing message exchange thread between the users. The suggestion is provided for presentation to the user(s) via user interface output device(s) of computing device(s) of the user(s). The suggestion indicates a query that can be submitted to an automated assistant to cause the automated assistant to incorporate, into the message exchange thread, content that is responsive to the query. In some implementations, the suggestion is a selectable suggestion and content that is responsive to the query is incorporated into the message exchange thread in response to user interface input that is directed to the selectable suggestion. In some implementations, the suggestion is determined based on one or more messages that have already been communicated between users of the message exchange thread.

Abstract: A messaging application may automatically analyze content of one or more messages and/or user information to automatically provide suggestions to a user within a messaging application. The suggestions may automatically incorporate particular non-messaging functionality into the messaging application. The automatic suggestions may suggest one or more appropriate responses to be selected by a user to respond in the messaging application, and/or may automatically send one or more appropriate responses on behalf of a user.

Abstract: A system and method for identifying an entity from a message exchange thread and generating a suggestion that is directed to the entity, such as a suggestion for a user to take an action on the entity. A suggestion application receives at least one electronic message from a message exchange thread, identifies an entity that can be actionable from the electronic message, determines contextual indicators of the entity, determines whether the entity is actionable based on the contextual indicators, and responsive to the entity being actionable, provides a suggestion that is directed to the entity to a participant(s) of the message exchange thread.

Abstract: A method of presenting to a user a subset of digital goods that may be executed by a computing device is disclosed, where the subset of applications is selected from a plurality of digital goods available in an online marketplace for such digital goods. The method includes ranking the digital goods based on at least one signal, statistically sampling the ranked digital goods based on their rankings, where higher-ranked digital goods are favored over lower-ranked digital goods in the statistical sampling, and presenting the statistically sampled digital goods in the online marketplace to the user in an order based on the statistical sampling, where at least one lower-ranked digital good is presented before a higher-ranked digital good.

Abstract: Methods, systems, and apparatus, for refining log file join data. In one aspect, a method includes receiving first join data defining first joins of records in a first log file to records in a second log file. Each first join of a record in the first log file to a record in the second log file is based on an association of the first identifier of the record in the first log file to the second identifier of the record in the second log file. Associations of the first identifiers to the second identifiers in the first join data that meet a confidence threshold are stored in a mapping of first identifiers to second identifiers as a mapped association. For each mapped association, records that include the first identifier from the first log file are associated with records that include the second identifier from the second log file.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for evaluating statistical significance using placebo actions. One method includes receiving exposure data and control data describing exposed and control subjects and determining a test statistic for each of a plurality of subject actions including a desired action and a plurality of placebo actions. The test statistic for an action corresponds to an estimated effect that exposure to the treatment has on a likelihood that a subject will take the action. The method further includes comparing the test statistic for the desired action to the test statistics for the plurality of placebo actions, and determining whether the test statistic for the desired action is statistically significant according to the comparison. Another method includes automatically identifying placebo actions using a taxonomy that classifies subject actions or treatments, and determining test statistics for the placebo actions.

Abstract: Various technologies and techniques are disclosed for automatically generating native images for a virtual machine environment. A virtual machine environment is provided where application libraries are distributed in an intermediate language format and then compiled at a later point in time. An automatic native generation service is provided that monitors the application libraries and generates a native image for a particular one or more of the application libraries when the service determines that native generation is appropriate. Invalid native images are automatically detected and re-generated. If a load attempt for a particular native image is unsuccessful, then the native image is determined to be invalid. The particular native image is then re-generated automatically.

Abstract: Systems, methods and computer program products for determining lost opportunities resulting from changes to advertising spending are described. To assist advertisers in evaluating and allocating a proper budget to advertising, an analyzer can be used to develop an analytical model that gathers data pertaining to the incremental value of search advertising. (e.g., the true cost of the additional click lost or gained), which can be presented to the advertisers when changes have been made/proposed to the advertiser's advertising spending. The analyzer can detect large changes in advertising spending, and indicate (e.g., by prediction) how many total clicks were lost or gained as a result of the change in advertising spending to allow the advertisers to visualize the impact to changes in advertising spending, and determine when to decrease advertising budget on ads that yield low return-on-investment or to increase advertising budget to maximize the effectiveness of an active ad campaign.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for evaluating statistical significance using placebo actions. One method includes receiving exposure data and control data describing exposed and control subjects and determining a test statistic for each of a plurality of subject actions including a desired action and a plurality of placebo actions. The test statistic for an action corresponds to an estimated effect that exposure to the treatment has on a likelihood that a subject will take the action. The method further includes comparing the test statistic for the desired action to the test statistics for the plurality of placebo actions, and determining whether the test statistic for the desired action is statistically significant according to the comparison. Another method includes automatically identifying placebo actions using a taxonomy that classifies subject actions or treatments, and determining test statistics for the placebo actions.