Abstract: Systems and processes for operating an intelligent automated assistant are provided. In some embodiments, after providing an initial output with information on a particular topic, an output including updated information on the topic is provided in response to an input interacting with a digital assistant. In some embodiments, based on contextual data including visual context data, an action is identified and proactively performed.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one example process, a spoken user input, including at least a spoken message and an identity of an intended recipient, is received. After storing the spoken message and the recipient identity, if a user becomes proximate to a first electronic device and the identity of the user is determined to match the recipient identity, the spoken message is provided to the user at the first electronic device.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In some embodiments, contextual data is obtained and used to select a set of keywords (e.g., words or phrases) for voice control of an electronic device. When a speech input is received by the electronic device, a determination is made whether the speech input includes any of the selected keywords. If the speech input does include a selected keyword, an action is performed in response.

Abstract: Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both managed and control the home automation devices.

Abstract: Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both manage and control the home automation devices.

Abstract: This relates generally to intelligent automated assistants and, more specifically, to provide real-time social intelligence. An example method includes while providing one or more outputs to a user of the electronic device, determining whether the user is in an engaged state based on: detecting a human in a near-field scene of the user, determining that the user is gazing at the human, and detecting a speech input from at least one of the user or the human while the user is gazing at the human. In response to determining that the user is in the engaged state, foregoing providing the one or more outputs to the user while the user is in the engaged state.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one embodiment, data is received from a motion sensor, for instance, recording the motion of a user as the user utters a spoken input. A determination is made whether a portion of the motion data matches reference data for a set of one or more words (e.g., a word or phrase). If so, a task associated with the one or more words is initiated in response.

Abstract: The present disclosure generally relates to assigning tasks to various user inputs, and detecting and responding to user inputs. In some embodiments, the present disclosure relates to assigning tasks to various user inputs received on a back surface of a device, and detecting and responding to user inputs on the back surface of the device.