Abstract: Systems and processes for operating an intelligent automated assistant are provided. For example, an electronic device can provide an output in an audio, visual, or mixed mode. In one example process, an output mode is selected, and, in response to determining that an output is to be provided to a user, an output data structure is obtained. The output data structure includes pattern components sorted into output groups. At least one pattern component from at least one output group is selected based on the output mode and provided in the output to the user.

Abstract: An example process includes: receiving, by a digital assistant operating on an electronic device, a natural language input; determining whether the natural language input corresponds to a predetermined type of domain; and in accordance with a determination that the natural language input corresponds to the predetermined type of domain: selecting a first digital assistant response mode from a plurality of digital assistant response modes, where each digital assistant response mode of the plurality of digital assistant response modes corresponds to a respective plurality of domains; and causing a first response to the natural language input to be provided according to the first digital assistant response mode, including: causing a first type of audio output to be provided; and causing a first type of response affordance to be displayed.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: An example process includes: while displaying a user interface different from a digital assistant user interface, receiving a user input; in accordance with a determination that the user input satisfies a criterion for initiating a digital assistant: displaying, over the user interface, the digital assistant user interface, the digital assistant user interface including: a digital assistant indicator displayed at a first portion of the display; and a response affordance displayed at a second portion of the display, where: a portion of the user interface remains visible at a third portion of the display; and the third portion is between the first portion and the second portion.

Abstract: An example process includes: while displaying a user interface different from a digital assistant user interface, receiving a user input, in accordance with a determination that the user input satisfies a criterion for initiating a digital assistant: displaying, over the user interface, the digital assistant user interface, the digital assistant user interface including: a digital assistant indicator displayed at a first portion of the display; and a response affordance displayed at a second portion of the display, where: a portion of the user interface remains visible at a third portion of the display; and the third portion is between the first portion and the second portion.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.