Abstract: One or more techniques for managing virtual objects between one or more displays are described. In accordance with some embodiments, exemplary techniques for displaying a virtual object are described.

Abstract: Some examples of the disclosure are directed to systems and methods for moving virtual objects in three-dimensional environments in accordance with detected movement of the electronic device. In some examples, the electronic device detects movement according to a first or second movement pattern described in more detail herein. In some examples, in response to detecting the first movement pattern, the electronic device applies a first correction factor to movement of a virtual object in the environment. In some examples, in response to detecting the first movement pattern, the electronic device applies a first correction factor to movement of a virtual object in the environment.

Abstract: Some examples of the disclosure are directed to systems and methods for transitioning an object between orientations in a three-dimensional environment. In some examples, an electronic device presents a three-dimensional environment including a virtual object that is displayed in a first orientation in the three-dimensional environment. While displaying the three-dimensional environment, the electronic device detects movement of a viewpoint of a user of the electronic device. In response to detecting the movement of the viewpoint, the electronic device moves the virtual object based on the movement of the viewpoint. In accordance with a determination that the movement of the viewpoint exceeds a threshold movement, the electronic device displays the virtual object in a second orientation in the three-dimensional environment.

Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

Abstract: Some examples of the disclosure are directed to systems and methods for minimizing display of an object from a maximized state to a minimized state in a three-dimensional environment. In some examples, an electronic device presents a computer-generated environment that includes a virtual object displayed in a maximized state in the three-dimensional environment. While displaying the three-dimensional environment, the electronic device detects that a first event has occurred. In response to detecting that the first event has occurred, in accordance with a determination that the first event satisfies one or more criteria, the electronic device displays the virtual object in a minimized state in the three-dimensional environment from a viewpoint of a user of the electronic device. In accordance with a determination that the first event does not satisfy the one or more criteria, the electronic device maintains display of the virtual object in the maximized state from the viewpoint.

Abstract: Some examples of the disclosure are directed to systems and methods for locking the presentation of content in a three-dimensional environment. For example, a first electronic device presents content in a world-locked orientation in a three-dimensional environment in accordance with a determination that a second electronic detects one or more characteristics of the first electronic device or of a user of the first electronic device. For example, the second electronic device is in communication with the first electronic device. Some examples of the disclosure are further directed to systems and methods for performing one or more operations on a first electronic device in response to detecting, via one or more input devices of a second electronic device, one or more portions of a user.

Abstract: An electronic device may display a user interface that includes content that is vertically scrollable in the user interface. The electronic device may vertically scroll the content in the user interface in accordance with yaw movement of a head of a user of the electronic device. An electronic device may display a user interface of an application. The electronic device may display a plurality of user interface elements in response to detecting a first input corresponding to a request to display the plurality of user interface elements, where the first input includes a first head rotation of a head of a user of the electronic device about a first axis associated with the head of the user. The plurality of user interface elements may be scrollable in response to a second head rotation of a second input that is different from the first input.

Abstract: Some examples of the disclosure are directed to a method performed at an electronic device configured to track a first vector indicative of an orientation of the electronic device. In some examples, the electronic device tracks a second vector indicative of a predicted motion path of the electronic device. In some examples, the device detects a difference between the first vector and the second vector. In some examples, and in accordance with a determination that one or more first criteria are satisfied, the electronic device determines the difference as a head rotation input and performs an action in accordance with the head rotation input.

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes displaying, on the display, a first user interface (UI) element that is associated with a first selection region and a second selection region. The method includes, while displaying the first UI element, determining, based on eye tracking data, that a targeting criterion is satisfied with respect to the first selection region or the second selection region. The eye tracking data is associated with one or more eyes of a user of the electronic device. The method includes, while displaying the first UI element, selecting the first UI element based at least in part on determining that the targeting criterion is satisfied.

Abstract: A head-mounted device may include one or more sensors that obtain sensor data for a physical environment around the head-mounted device. One or more sensors such as cameras and depth sensors may be used to generate a scene understanding data set for the physical environment. The scene understanding data set may be associated with a position of the head-mounted device. While the head-mounted device is at the position associated with the scene understanding data set, the scene understanding data set may be referenced using only motion data to mitigate power consumption.

Abstract: This relates to gaze-based input systems and methods for reducing unintended gaze input(s) in a three-dimensional environment. In some examples, an electronic device presents a three-dimensional environment that includes affordances for triggering events in a foveal region of the user interface, and one or more indicators that provide visual feedback on the execution or progress of the triggered events in a perifoveal region of the user interface. Displaying an indicator in the perifoveal region that provides visual feedback concurrently with the user's gaze upon affordances in the foveal region can provide a confirmation or refutation of the user's intended gaze inputs through a visual detection of changes to the appearance of the indicator (e.g., movement of the indicator, changes to the shape/boundaries/graphics of the indicator, or changes to the color and/or brightness of the indicator).

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Abstract: A head-mounted device may be used to control one or more external electronic devices. Gaze input and camera images may be used to determine a point of gaze relative to a display for an external electronic device. The external electronic device may receive information regarding the user's gaze input from the head-mounted device and may highlight one out of multiple user interface elements that is targeted by the gaze input. The head-mounted device may receive input such as keystroke information from an accessory device and relay the input to an external electronic device that is being viewed. The head-mounted device may receive a display configuration request, determine layout information for displays in the physical environment of the head-mounted device, and transmit the layout information to an external device associated with the displays.

Abstract: In some embodiments, the present disclosure includes techniques and user interfaces for interacting with graphical user interfaces using gaze. In some embodiments, the present disclosure includes techniques and user interfaces for repositioning virtual objects. In some embodiments, the present disclosure includes techniques and user interfaces for transitioning modes of a camera capture user interface.

Abstract: A method includes displaying a plurality of visual elements. The method includes determining, based on respective characteristic values of the plurality of visual elements, an expected gaze target that indicates a first display region where a user of the device intends to gaze while the plurality of visual elements is being displayed. The method includes obtaining, via the image sensor, an image that includes a set of pixels corresponding to a pupil of the user of the device. The method includes determining, by a gaze tracker, based on the set of pixels corresponding to the pupil, a measured gaze target that indicates a second display region where the user is measuredly gazing. The method includes adjusting a calibration parameter of the gaze tracker based on a difference between the first display region indicated by the expected gaze target and the second display region indicated by the measured gaze target.

Abstract: Various implementations disclosed herein include devices, systems, and methods for using a gaze vector and head pose information to effectuate a user interaction with a virtual object. In some implementations, a device includes a sensor for sensing a head pose of a user, a display, one or more processors, and a memory. In various implementations, a method includes displaying a set of virtual objects. Based on a gaze vector, it is determined that a gaze of the user is directed to a first virtual object of the set of virtual objects. A head pose value corresponding to the head pose of the user is obtained. An action relative to the first virtual object is performed based on the head pose value satisfying a head pose criterion.

Abstract: In accordance with some embodiments, exemplary processes for changing (e.g., non-linearly) the size of a virtual object are described.

Abstract: A method includes displaying a plurality of visual elements. The method includes determining, based on respective characteristic values of the plurality of visual elements, an expected gaze target that indicates a first display region where a user of the device intends to gaze while the plurality of visual elements is being displayed. The method includes obtaining, via the image sensor, an image that includes a set of pixels corresponding to a pupil of the user of the device. The method includes determining, by a gaze tracker, based on the set of pixels corresponding to the pupil, a measured gaze target that indicates a second display region where the user is measuredly gazing. The method includes adjusting a calibration parameter of the gaze tracker based on a difference between the first display region indicated by the expected gaze target and the second display region indicated by the measured gaze target.

Abstract: Various implementations disclosed herein include devices, systems, and methods for modifying display of virtual content. In some implementations, the method is performed by an electronic device including a non-transitory memory, one or more processors, a display, an eye tracker and a movement sensor. In some implementations, the method includes displaying, via the display, virtual content. In some implementations, the method includes detecting, via the eye tracker, a movement of a gaze in a first direction. In some implementations, the method includes detecting, via the movement sensor, a movement of a head in a second direction while detecting the movement of the gaze in the first direction. In some implementations, the method includes, in accordance with a determination that the movement of the gaze in the first direction and the movement of the head in the second direction are corresponding opposing movements, modifying a display characteristic of the virtual content.

Abstract: In accordance with some embodiments, exemplary processes for changing (e.g., non-linearly) the size of a virtual object are described.