Abstract: Systems and processes for operating an intelligent automated assistant are provided. In some embodiments, contextual data is obtained and used to select a set of keywords (e.g., words or phrases) for voice control of an electronic device. When a speech input is received by the electronic device, a determination is made whether the speech input includes any of the selected keywords. If the speech input does include a selected keyword, an action is performed in response.

Abstract: Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both managed and control the home automation devices.

Abstract: Systems and processes for operating an intelligent automated digital assistant on an electronic device are provided. In particular, this paper describes how the intelligent automated digital assistant can be leveraged with other types of commands to control a household having multiple home automation devices. A portable electronic device is used to provide a user an extended reality environment within which the user can both manage and control the home automation devices.

Abstract: This relates generally to intelligent automated assistants and, more specifically, to provide real-time social intelligence. An example method includes while providing one or more outputs to a user of the electronic device, determining whether the user is in an engaged state based on: detecting a human in a near-field scene of the user, determining that the user is gazing at the human, and detecting a speech input from at least one of the user or the human while the user is gazing at the human. In response to determining that the user is in the engaged state, foregoing providing the one or more outputs to the user while the user is in the engaged state.

Abstract: Systems and processes for operating an intelligent automated assistant are provided. In one embodiment, data is received from a motion sensor, for instance, recording the motion of a user as the user utters a spoken input. A determination is made whether a portion of the motion data matches reference data for a set of one or more words (e.g., a word or phrase). If so, a task associated with the one or more words is initiated in response.

Abstract: The present disclosure generally relates to assigning tasks to various user inputs, and detecting and responding to user inputs. In some embodiments, the present disclosure relates to assigning tasks to various user inputs received on a back surface of a device, and detecting and responding to user inputs on the back surface of the device.