Abstract: Some examples of the disclosure are directed to systems and methods for dynamic input behaviors. In some examples, an electronic device can automatically adjust an input detected at an intelligent input device to accomplish user intent even when the input is already assigned to another action. In some examples, a scroll input can be dampened based on direction of gaze. For example, the electronic device can reduce the scroll speed of an interface element based on detecting that the gaze of the user is searching for a specific item. In some examples, a scroll input can perform different actions based on a speed of the scroll input. In some examples, the electronic device can display context-driven indications of actions that can be performed when gaze is detected at the indications. The indications and their corresponding operations can change based on context.

Abstract: In some examples, a first electronic device is in communication with multiple displays while also interfacing with two external cameras, each capturing distinct viewpoints. In some examples, the first external camera captures first image data concurrently with the second external camera capturing second image data, with both contributing to generating spatial image data. In some examples, the first electronic device obtains the spatial image data from both external cameras or generates the spatial image data based on the first image data and the second image data. In some examples, when one or more first criteria are met, the first electronic device renders the spatial image data on one or more displays.

Abstract: Disclosed herein are example processes for providing digital assistant responses using three-dimensional audio effects.

Abstract: In one implementation, a method of localizing a device is performed at a device including one or more processors and non-transitory memory. The method includes obtaining an estimate of a pose of the device in an environment. The method includes obtaining an environmental model of the environment including a spatial feature in the environment defined by a first spatial feature location. The method includes determining a second spatial feature location of the spatial feature based on the estimate of the pose of the device. The method includes determining an updated estimate of the pose of the device based on the first spatial feature location and the second spatial feature location.

Abstract: Electronic devices provide extended reality experiences. In some embodiments, a media capture user interface is displayed, including a capture guide. In some embodiments, gaze information is used for targeting. In some embodiments, a virtual object is manipulated.

Abstract: Electronic devices provide extended reality experiences. In some embodiments, a media capture user interface is displayed, including a capture guide. In some embodiments, gaze information is used for targeting. In some embodiments, a virtual object is manipulated.

Abstract: A method includes, while presenting a representation of a physical environment of the device, obtaining contextual data that indicates a characteristic of the physical environment, the device or a user of the device, and obtaining an indication of historical content associated with the device. The method includes determining, based on the characteristic indicated by the contextual data and the historical content, a user interest value that indicates a user interest level in the physical environment. The method includes storing an image captured by an image sensor in response to the user interest value being greater than a threshold interest value.

Abstract: In one implementation, a method of localizing a device is performed at a device including one or more processors and non-transitory memory. The method includes obtaining an estimate of a pose of the device in an environment. The method includes obtaining an environmental model of the environment including a spatial feature in the environment defined by a first spatial feature location. The method includes determining a second spatial feature location of the spatial feature based on the estimate of the pose of the device. The method includes determining an updated estimate of the pose of the device based on the first spatial feature location and the second spatial feature location.

Abstract: A method includes, while presenting a representation of a physical environment of the device, obtaining contextual data that indicates a characteristic of the physical environment, the device or a user of the device, and obtaining an indication of historical content associated with the device. The method includes determining, based on the characteristic indicated by the contextual data and the historical content, a user interest value that indicates a user interest level in the physical environment. The method includes storing an image captured by an image sensor in response to the user interest value being greater than a threshold interest value.

Abstract: Embodiments disclosed herein are directed to devices, systems, and methods for presenting a magnified view in an extended reality environment. Specifically, a magnified view includes a zoom reticle that is presented at a display location of a display. The zoom reticle includes magnified content that includes a magnified portion of a user's field of view. For example, the magnified content may be generated from image data selected from a corresponding portion of a field of view of a camera. The position of the zoom reticle on the display, as well as the portion of the field of view that is magnified, may vary in different circumstances such as described herein.

Abstract: Various multilayer handling techniques for head-mounted display devices may smooth motion of a viewing area that results from head movement, may restrict the viewing area to a defined display boundary, and may variously apply different motion criteria to the content and the viewing area of the head-mounted display devices. This may shift the content and the viewing area of the head-mounted display devices differently, which may in turn cause the content presentation to appear less shaky than if the content were fully head-locked, resulting in a more pleasant and usable viewing experience.

Abstract: Videos are presented in an extended reality environment in a spatially aware manner such that a position of each frame of the video in the extended reality environment is based on one or more of a position, orientation, and field of view of a camera that captured the video.

Abstract: Electronic devices provide extended reality experiences. In some embodiments, a media capture user interface is displayed, including a capture guide. In some embodiments, gaze information is used for targeting. In some embodiments, a virtual object is manipulated.

Abstract: One or more sound components are identified, isolated, and processed such that they are relocated to a different location in a sound field of spatial audio content. The one or more sounds may be voices, and in particular voices of a predetermined user.

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Abstract: A method includes, while presenting a representation of a physical environment of the device, obtaining contextual data that indicates a characteristic of the physical environment, the device or a user of the device, and obtaining an indication of historical content associated with the device. The method includes determining, based on the characteristic indicated by the contextual data and the historical content, a user interest value that indicates a user interest level in the physical environment. The method includes storing an image captured by an image sensor in response to the user interest value being greater than a threshold interest value.

Abstract: In one implementation, a method of localizing a device is performed at a device including one or more processors and non-transitory memory. The method includes obtaining an estimate of a pose of the device in an environment. The method includes obtaining an environmental model of the environment including a spatial feature in the environment defined by a first spatial feature location. The method includes determining a second spatial feature location of the spatial feature based on the estimate of the pose of the device. The method includes determining an updated estimate of the pose of the device based on the first spatial feature location and the second spatial feature location.