Abstract: Some examples of the disclosure are directed to systems and methods for performing one or more actions in response to detecting a product in a physical environment. For example, performing the one or more actions include presenting one or more virtual elements in an environment. For example, performing the one or more actions include storing information associated with the product. In some examples, the one or more actions are performed in accordance with one or more criteria being satisfied. For example, the one or more criteria include a criterion that is satisfied when one or more indications of user interest in the product are detected. In some examples, one or more virtual elements are presented in an environment indicating a location of a product within a region of the physical environment. The methods of the disclosure are optionally performed at an electronic device including a head-mounted display.

Abstract: A method includes displaying a user interface (UI) including a first UI element that is associated with a first UI operation and a second UI element that is associated with a second UI operation. The method includes, in response to detecting a first gaze input directed to one of the first UI element and the second UI element, displaying a visual indicator at a fixed location that is separate from the first UI element and the second UI element. The method includes, in response to detecting, via the eye tracker, a second gaze input directed to the visual indicator: performing the first UI operation in response to the first gaze input being directed to the first UI element, and performing the second UI operation in response to the first gaze input being directed to the second UI element.

Abstract: Some examples of the disclosure are directed to systems and methods for receiving and presenting notifications based on environmental context, and more particularly to receiving and presenting notifications while in different levels of busyness on an extended reality device. In some examples, the electronic device receives a notification while at a first level of busyness. In some examples, the electronic device determines the importance of the notification based on previous user interactions with the notification's sender and/or based on the contents of the notification. In some examples, the electronic device presents an indication of the notification when the importance of the notification is greater than the importance threshold at the first level of busyness.

Abstract: This relates generally to intelligent automated assistants and, more specifically, to provide intelligent device selections by the intelligent automated assistants for performing requested actions. An example method includes, at an electronic device receiving a user request from a user, identifying the user, a domain type of the user request, and one or more electronic devices available for handling the user request; retrieving one or more historical interactions involving at least one of the identified user, the domain type, and the one or more electronic devices, generating metadata based on the one or more historical interactions, location information of the one or more electronic devices, and context information associated with the one or more electronic devices; identifying a delivery device by interpreting the metadata using a preference model; and transmitting a response command to the delivery device for providing the result output.

Abstract: Some examples of the disclosure are directed to systems and methods for performing one or more actions in response to detecting a product in a physical environment. For example, performing the one or more actions include presenting one or more virtual elements in an environment. For example, performing the one or more actions include storing information associated with the product. In some examples, the one or more actions are performed in accordance with one or more criteria being satisfied. For example, the one or more criteria include a criterion that is satisfied when one or more indications of user interest in the product are detected. In some examples, one or more virtual elements are presented in an environment indicating a location of a product within a region of the physical environment. The methods of the disclosure are optionally performed at an electronic device including a head-mounted display.

Abstract: An electronic device may be used to control an external electronic device. Camera images may be used to determine a location of a display associated with the external electronic device relative to the electronic device. Camera images may also be used to identify a gaze direction of the user and gesture inputs from a user. The gaze direction and the location of the display relative to the electronic device may be used to determine a location on the display that is targeted by the user's gaze. The electronic device may transmit the identified gesture input and/or the determined location on the display that is targeted by the user's gaze to the external electronic device to control the external electronic device.

Abstract: Embodiments described herein provide a network system to enable content playback on multiple devices. An electronic device can receive information associated with media playback request and resolve a media item and intended playback device for the media request based on a set of available media items and player devices. The device can then transmit, via the data interface, a request to play the media item at the player device via a secure device to device communication system.

Abstract: This relates to intelligent automated assistants and, more specifically, to intelligent context sharing and task performance among a collection of devices with intelligent automated assistant capabilities. An example method includes, at a first electronic device participating in a context-sharing group associated with a first location: receiving a user voice input; receiving, from a context collector, an aggregate context of the context-sharing group; providing at least a portion of the aggregate context and data corresponding to the user voice input to a remote device; receiving, from the remote device, a command to perform one or more tasks and a device identifier corresponding to a second electronic device; and transmitting the command to the second electronic device based on the device identifier, wherein the command causes the second electronic device to perform the one or more tasks.

Abstract: This relates to intelligent automated assistants and, more specifically, to intelligent context sharing and task performance among a collection of devices with intelligent automated assistant capabilities. An example method includes, at a first electronic device participating in a context-sharing group associated with a first location: receiving a user voice input; receiving, from a context collector, an aggregate context of the context-sharing group; providing at least a portion of the aggregate context and data corresponding to the user voice input to a remote device; receiving, from the remote device, a command to perform one or more tasks and a device identifier corresponding to a second electronic device; and transmitting the command to the second electronic device based on the device identifier, wherein the command causes the second electronic device to perform the one or more tasks.

Abstract: Embodiments described herein provide a network system to enable content playback on multiple devices. An electronic device can receive information associated with media playback request and resolve a media item and intended playback device for the media request based on a set of available media items and player devices. The device can then transmit, via the data interface, a request to play the media item at the player device via a secure device to device communication system.

Abstract: Some examples of the disclosure are directed to systems and methods for performing one or more actions in response to detecting a product in a physical environment. For example, performing the one or more actions include presenting one or more virtual elements in an environment. For example, performing the one or more actions include storing information associated with the product. In some examples, the one or more actions are performed in accordance with one or more criteria being satisfied. For example, the one or more criteria include a criterion that is satisfied when one or more indications of user interest in the product are detected. In some examples, one or more virtual elements are presented in an environment indicating a location of a product within a region of the physical environment. The methods of the disclosure are optionally performed at an electronic device including a head-mounted display.

Abstract: A method includes displaying a user interface (UI) including a first UI element that is associated with a first UI operation and a second UI element that is associated with a second UI operation. The method includes, in response to detecting a first gaze input directed to one of the first UI element and the second UI element, displaying a visual indicator at a fixed location that is separate from the first UI element and the second UI element. The method includes, in response to detecting, via the eye tracker, a second gaze input directed to the visual indicator: performing the first UI operation in response to the first gaze input being directed to the first UI element, and performing the second UI operation in response to the first gaze input being directed to the second UI element.

Abstract: This relates generally to systems and methods of presenting extended reality environments and, more particularly, to displaying notifications while operating in different modes while presenting an extended reality environment. In some situations, the electronic device detects an event that satisfies one or more first criteria including a criterion that is satisfied when detecting an interaction with a person using at least an optical sensor. In some examples, in response to detecting the event, the electronic device transitions from a first mode to a second mode. In some examples, the electronic device receives a notification while operating in the second mode. In some examples, if one or more second criteria are satisfied, then the electronic device does not present the notification while in the second mode.

Abstract: A device implementing a system for sharing a voice profile includes a processor configured to receive a request to share a first voice profile corresponding to a first user account associated with a first device, with a second device associated with a second user account, the second device being voice-enabled, the first voice profile being stored on a first data store associated with the first user account. The processor is further configured to update a second data store associated with the second user account to include a reference to the first voice profile stored on the first data store, and to send, to the second device, a notification that the second data store has been updated to include the reference to the first voice profile.

Abstract: An example method includes, at an electronic device: receiving an indication of a notification; in accordance with receiving the indication of the notification: obtaining one or more data streams from one or more sensors; determining, based on the one or more data streams, whether a user associated with the electronic device is speaking; and in accordance with a determination that the user is not speaking: causing an output associated with the notification to be provided.

Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

Abstract: The present disclosure generally relates to using voice interaction to access call functionality of a companion device. In an example process, a user utterance is received. Based on the user utterance and contextual information, the process causes a server to determine a user intent corresponding to the user utterance. The contextual information is based on a signal received from the companion device. In accordance with the user intent corresponding to an actionable intent of answering the incoming call, a command is received. Based on the command, instructions are provided to the companion device, which cause the companion device to answer the incoming call and provide audio data of the answered incoming call. Audio is outputted according to the audio data of the answered incoming call.

Abstract: Systems and processes for providing a virtual assistant service are provided. In accordance with one or more examples, a method includes receiving, from an accessory device communicatively coupled to the first electronic device, a representation of a speech input representing a user request. The method further includes detecting a second electronic device and transmitting, from the first electronic device, a representation of the user request and data associated with the detected second electronic device to a third electronic device. The method further includes receiving, from the third electronic device, a determination of whether a task is to be performed by the second electronic device in accordance with the user request; and in accordance with a determination that a task is to be performed by the second electronic device, requesting the second electronic device to performed the task in accordance with the user request.

Abstract: This relates to intelligent automated assistants and, more specifically, to intelligent context sharing and task performance among a collection of devices with intelligent automated assistant capabilities. An example method includes, at a first electronic device participating in a context-sharing group associated with a first location: receiving a user voice input; receiving, from a context collector, an aggregate context of the context-sharing group; providing at least a portion of the aggregate context and data corresponding to the user voice input to a remote device; receiving, from the remote device, a command to perform one or more tasks and a device identifier corresponding to a second electronic device; and transmitting the command to the second electronic device based on the device identifier, wherein the command causes the second electronic device to perform the one or more tasks.

Abstract: This relates to intelligent automated assistants and, more specifically, to intelligent context sharing and task performance among a collection of devices with intelligent automated assistant capabilities. An example method includes, at a first electronic device participating in a context-sharing group associated with a first location: receiving a user voice input; receiving, from a context collector, an aggregate context of the context-sharing group; providing at least a portion of the aggregate context and data corresponding to the user voice input to a remote device; receiving, from the remote device, a command to perform one or more tasks and a device identifier corresponding to a second electronic device; and transmitting the command to the second electronic device based on the device identifier, wherein the command causes the second electronic device to perform the one or more tasks.