Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

Abstract: Systems, methods, and apparatus for using a multimodal response in the dynamic generation of client device output that is tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions etc. A multimodal response can include a core message to be rendered for all interaction types as well as one or more modality dependent components to provide a user with additional information.

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; selecting, based on the utterance, an agent from a plurality of agents, wherein the plurality of agents includes one or more first party agents and a plurality of third-party agents; responsive to determining that the selected agent comprises a first party agent, selecting a reserved voice from a plurality of voices; and outputting synthesized audio data using the selected voice to satisfy the utterance.

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; selecting, based on the utterance, an agent from a plurality of agents, wherein the plurality of agents includes one or more first party agents and a plurality of third-party agents; responsive to determining that the selected agent comprises a first party agent, selecting a reserved voice from a plurality of voices; and outputting synthesized audio data using the selected voice to satisfy the utterance.

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

Abstract: Systems and methods of providing composite search results are disclosed. A search query may be received by a general purpose search engine of a first website from a user. At least one general purpose search result may be determined based on the search query using the general purpose search engine. The at least one general purpose search result may be based on a search of multiple websites. Item listing information of an item listed for sale on a second website may be determined based on the search query. The at least one general purpose search result and the item listing information may be caused to be displayed concurrently on the first website to the user. The user may be enabled to interact with the second website regarding the item by interacting with the item listing information displayed on the first website.

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed; determining a capability level of a first party (1P) agent to perform the task; determining capability levels of respective third party (3P) agents of a plurality of 3P agents to perform the task; responsive to determining that the capability level of the 1P agent does not satisfy a threshold capability level, that a capability level of a particular 3P agent of the plurality of 3P agents is a greatest of the determined capability levels, and that the capability level of the particular 3P agent satisfies the threshold capability level, selecting the particular 3P agent to perform the task; and performing one or more actions determined by the selected agent to perform the task.

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; selecting, based on the utterance, an agent from a plurality of agents, wherein the plurality of agents includes one or more first party agents and a plurality of third-party agents; responsive to determining that the selected agent comprises a first party agent, selecting a reserved voice from a plurality of voices; and outputting synthesized audio data using the selected voice to satisfy the utterance.

Abstract: An example method includes receiving, by one or more processors, a representation of an utterance spoken at a computing device; identifying, by a first computational agent from a plurality of computational agents and based on the utterance, a multi-element task to be performed, wherein the plurality of computational agents includes one or more first party computational agents and a plurality of third-party computational agents; and performing, by the first computational agent, a first sub-set of elements of the multi-element task, wherein performing the first sub-set of elements comprises selecting a second computational agent from the plurality of computational agents to perform a second sub-set of elements of the multi-element task.

Abstract: Systems and methods of providing composite search results are disclosed. A system may receive input via a user interface of a device accessing a first website, and determine item listing information of an item listed for sale on a second website based on the received input, with the second website being different from the first website. The system may cause the item listing information to be displayed on the first website on the device via the user interface, and enable the device to interact with the second website, via the user interface, regarding the item listed for sale by interacting with the item listing information being displayed on the first website.

Abstract: Systems and methods of providing composite search results are disclosed. A system may receive input via a user interface of a device accessing a first website, and determine item listing information of an item listed for sale on a second website based on the received input, with the second website being different from the first website. The system may cause the item listing information to be displayed on the first website on the device via the user interface, and enable the device to interact with the second website, via the user interface, regarding the item listed for sale by interacting with the item listing information being displayed on the first website.

Abstract: Systems and methods of providing composite search results are disclosed. A search query may be received by a general purpose search engine of a first website from a user. At least one general purpose search result may be determined based on the search query using the general purpose search engine. The at least one general purpose search result may be based on a search of multiple websites. Item listing information of an item listed for sale on a second website may be determined based on the search query. The at least one general purpose search result and the item listing information may be caused to be displayed concurrently on the first website to the user. The user may be enabled to interact with the second website regarding the item by interacting with the item listing information displayed on the first website.

Abstract: A user may request a recommendation for an item from other users. Other users may respond to the request by recommending for or against items. Users may up-vote or down-vote the recommendations or responses of other users. The recommendations of the other users may be used to identify items and provide one or more recommendations to the requesting user. The original question and the responses may form a conversation thread. The recommendations may be inserted into the thread as responses, may be presented alongside the thread, or may be presented at the end of the thread. The recommendations may be based on one or more attributes of the user. The weight of the recommendations provided by other users may vary.

Abstract: A system and method of providing tunable generation of advertisements are disclosed. In some embodiments, a target advertisement goal for a website is received. The target advertisement goal comprises a first goal for a first type of advertisement and a second goal for a second type of advertisement. Advertisements to display on the website are determined based on the target advertisement goal. The advertisements are caused to be displayed on the website. In some embodiments, the first type of advertisement is an advertisement for merchandise offered for sale on the website, and the second type of advertisement is an advertisement for merchandise offered for sale on a different website.

Abstract: Systems and methods of providing composite search results are disclosed. A search query may be received by a general purpose search engine of a first website from a user. At least one general purpose search result may be determined based on the search query using the general purpose search engine. The at least one general purpose search result may be based on a search of multiple websites. Item listing information of an item listed for sale on a second website may be determined based on the search query. The at least one general purpose search result and the item listing information may be caused to be displayed concurrently on the first website to the user. The user may be enabled to interact with the second website regarding the item by interacting with the item listing information displayed on the first website.