Abstract: One exemplary implementation provides an improved user experience on a device by using physiological data to initiate a user interaction for the user experience based on an identified interest or intention of a user. For example, a sensor may obtain physiological data (e.g., pupil diameter) of a user during a user experience in which content is displayed on a display. The physiological data varies over time during the user experience and a pattern is detected. The detected pattern is used to identify an interest of the user in the content or an intention of the user regarding the content. The user interaction is then initiated based on the identified interest or the identified intention.

Abstract: Some examples of the disclosure are directed to systems and methods for selectively displaying an image of a portion of a physical environment of an electronic device with enhanced visibility. In some examples, the image is displayed overlaid on a portion of a view of the physical environment. In some examples, the electronic device displays the image in accordance with one or more first criteria being satisfied. In some examples, the electronic device forgoes displaying the image in accordance with the one or more criteria not being satisfied.

Abstract: In one implementation, a method of changing a state of an object is performed at a device including an image sensor, one or more processors, and non-transitory memory. The method includes receiving a vocal command. The method includes obtaining, using the image sensor, an image of a physical environment. The method includes detecting, in the image of the physical environment, an object based on a visual model of the object stored in the non-transitory memory in association with an object identifier of the object. The method includes generating, based on the vocal command and detection of the object, an instruction including the object identifier of the object. The method includes effectuating the instruction to change a state of the object.

Abstract: One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described.

Abstract: Some examples of the disclosure are directed to systems and methods for locking the presentation of content in a three-dimensional environment. For example, a first electronic device presents content in a world-locked orientation in a three-dimensional environment in accordance with a determination that a second electronic detects one or more characteristics of the first electronic device or of a user of the first electronic device. For example, the second electronic device is in communication with the first electronic device. Some examples of the disclosure are further directed to systems and methods for performing one or more operations on a first electronic device in response to detecting, via one or more input devices of a second electronic device, one or more portions of a user.

Abstract: Some examples of the disclosure are directed to systems and methods for presenting virtual representations of participants of a communication session in a three-dimensional environment. In some examples, while a first electronic device presents a representation of a user oriented toward a first target location of a set of target locations associated with the communication session, the first electronic device receives an indication of a change of pose of a second electronic device associated with the user. In some examples, in response to receiving the indication, in accordance with a determination that the change of pose of the second electronic device includes rotation about a first axis that satisfies one or more first criteria, the first electronic device presents the representation of the user oriented toward a second target location, different from the first target location, of the set of target locations.

Abstract: In some examples, a first electronic device is in communication with multiple displays while also interfacing with two external cameras, each capturing distinct viewpoints. In some examples, the first external camera captures first image data concurrently with the second external camera capturing second image data, with both contributing to generating spatial image data. In some examples, the first electronic device obtains the spatial image data from both external cameras or generates the spatial image data based on the first image data and the second image data. In some examples, when one or more first criteria are met, the first electronic device renders the spatial image data on one or more displays.

Abstract: In some examples, a first electronic device is in communication with multiple displays while also interfacing with two external cameras, each capturing distinct viewpoints. In some examples, the first external camera captures first image data concurrently with the second external camera capturing second image data, with both contributing to generating spatial image data. In some examples, the first electronic device obtains the spatial image data from both external cameras or generates the spatial image data based on the first image data and the second image data. In some examples, when one or more first criteria are met, the first electronic device renders the spatial image data on one or more displays.

Abstract: An electronic device, such as a head-mounted device, communicates with one or more input devices, including a first camera with a first lens and a second camera with a second lens. In some examples, the electronic device detects a gaze of a user directed at an object within the three-dimensional environment and extracts data corresponding to the object based on images captured with the first lens. In response to extracting the data, in accordance with a determination that one or more criteria are satisfied, including a criterion that is satisfied when the data has a quality metric below a quality metric threshold, the electronic device extracts the data based on images captured with the second lens, and in accordance with a determination that the one or more criteria are not satisfied, the electronic device forgoes extracting the data based on the images captured with the second lens.

Abstract: In some examples, an electronic device in communication with one or more input devices detects an input and a gaze direction of a user of the electronic device. In some examples, in response to the input, the electronic device captures one or more images. In some examples, using the detected gaze direction and a portion of the input, the electronic device identifies a subset of at least a first image from the captured images. If certain criteria are satisfied, the electronic device performs an operation using processing circuitry based on processing the input, the captured images, and the identified subset of the first image.

Abstract: Disclosed herein are example processes for providing digital assistant responses using three-dimensional audio effects.

Abstract: Some examples of the disclosure are directed to systems and methods for transferring presentation of content between a first electronic device and a second electronic device of a computing system. In some examples, while first content is presented on the first electronic device in a three-dimensional environment, the computing system detects, via one or more input devices of the second electronic device, a first input. In some examples, accordance with a determination that the first input satisfies one or more first criteria, the computing system transfers presentation of the first content from the first electronic device to the second electronic device. In some examples, transferring the presentation of first content from the first electronic device to the second electronic device includes ceasing to present the first content on the first electronic device and presenting the first content on the second electronic device.

Abstract: Aspects of the subject technology relate to gaze-based control of an electronic device. The gaze-based control can include enabling an option to provide user authorization when it is determined that the user has viewed and/or read text associated with a request for the user authorization. The gaze-based control can also include modifying a user interface or a user interface element based on user views and/or reads. The gaze-based control can be based on determining whether a user has viewed and/or read an electronic document and/or a physical document.

Abstract: This relates generally to systems and methods for changing tinting levels of one or more displays, and more particularly to changing tinting levels of one or more displays of an electronic device based on the satisfaction of one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the tinting level from the first tinting level to the second tinting level. Changing the tinting level and the presentation of the content allows a user to seamlessly see and/or focus on different objects in the physical environment without having to manually change the tint of the display and/or without having to manually change the presentation of the content presented on the display.

Abstract: In one implementation, a method for improving comfortability of virtual content. The method includes: while detecting a first head pose, presenting virtual content in a first presentation mode at a first location; and in response to detecting a change from the first head pose to a second head pose: in accordance with a determination that the difference between the first and second head poses indicates a motion that satisfies a first motion criterion, presenting the virtual content in a second presentation mode while moving the virtual content away from the first location towards a second location that is the first set of offset values relative to the second head pose; and in accordance with a determination that the difference between the first and second head poses indicates a motion that satisfies a second motion criterion different from the first motion criterion, changing an appearance of the virtual content.

Abstract: In one implementation, a method of localizing a device is performed at a device including one or more processors and non-transitory memory. The method includes obtaining an estimate of a pose of the device in an environment. The method includes obtaining an environmental model of the environment including a spatial feature in the environment defined by a first spatial feature location. The method includes determining a second spatial feature location of the spatial feature based on the estimate of the pose of the device. The method includes determining an updated estimate of the pose of the device based on the first spatial feature location and the second spatial feature location.

Abstract: Some examples of the disclosure are directed to systems and methods for selectively displaying an image of a portion of a physical environment of an electronic device with enhanced visibility. In some examples, the image is displayed overlaid on a portion of a view of the physical environment. In some examples, the electronic device displays the image in accordance with one or more first criteria being satisfied. In some examples, the electronic device forgoes displaying the image in accordance with the one or more criteria not being satisfied.

Abstract: Aspects of the subject technology relate to gaze-based control of an electronic device. The gaze-based control can include enabling an option to provide user authorization when it is determined that the user has viewed and/or read text associated with a request for the user authorization. The gaze-based control can also include modifying a user interface or a user interface element based on user views and/or reads. The gaze-based control can be based on determining whether a user has viewed and/or read an electronic document and/or a physical document.

Abstract: This relates generally to systems and methods for changing tinting levels of one or more displays, and more particularly to changing tinting levels of one or more displays of an electronic device based on the satisfaction of one or more criteria. In some examples, an electronic device (e.g., an HMD) presents content in a first manner including a first tint. In some examples, in response to determining that one or more criteria are satisfied, the electronic device presents the content in a second manner and changes the tinting level from the first tinting level to the second tinting level. Changing the tinting level and the presentation of the content allows a user to seamlessly see and/or focus on different objects in the physical environment without having to manually change the tint of the display and/or without having to manually change the presentation of the content presented on the display.

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.