Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving an utterance including a user request, determining, based on the user request, a domain associated with the user request, determining, based on the domain, a first subsequent user action and a second subsequent user action, determining, based on the domain, a first parameter for the first subsequent user action and a second parameter for the second subsequent user action, in accordance with a determination that a first score associated with the first subsequent user action is higher than a score associated with the second subsequent user action, selecting the first subsequent user action as a suggested subsequent user action, and providing the suggested subsequent user action.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving an utterance including a user request, determining, based on the user request, a domain associated with the user request, determining, based on the domain, a first subsequent user action and a second subsequent user action, determining, based on the domain, a first parameter for the first subsequent user action and a second parameter for the second subsequent user action, in accordance with a determination that a first score associated with the first subsequent user action is higher than a score associated with the second subsequent user action, selecting the first subsequent user action as a suggested subsequent user action, and providing the suggested subsequent user action.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving an utterance including a user request, determining, based on the user request, a domain associated with the user request, determining, based on the domain, a first subsequent user action and a second subsequent user action, determining, based on the domain, a first parameter for the first subsequent user action and a second parameter for the second subsequent user action, in accordance with a determination that a first score associated with the first subsequent user action is higher than a score associated with the second subsequent user action, selecting the first subsequent user action as a suggested subsequent user action, and providing the suggested subsequent user action.

Abstract: Systems and processes for optimizing dialogue policy decisions for digital assistants using implicit feedback are provided. In an example process, a user utterance is received. Based on a text representation of the user utterance, one or more user intents corresponding to the user utterance are determined. A policy action is selected from a plurality of candidate policy actions based on a belief state for the one or more user intents and a policy model. The policy action is performed, including outputting results of the policy action for presentation. A success score for the policy action is determined based on whether one or more predetermined types of implicit user feedback are detected after performing the policy action. A set of parameter values of the policy model is modified using the determined success score.

Abstract: Systems and processes for optimizing dialogue policy decisions for digital assistants using implicit feedback are provided. In an example process, a user utterance is received. Based on a text representation of the user utterance, one or more user intents corresponding to the user utterance are determined. A policy action is selected from a plurality of candidate policy actions based on a belief state for the one or more user intents and a policy model. The policy action is performed, including outputting results of the policy action for presentation. A success score for the policy action is determined based on whether one or more predetermined types of implicit user feedback are detected after performing the policy action. A set of parameter values of the policy model is modified using the determined success score.