Abstract: The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.

Abstract: In one implementation, a method for dynamically determining view distance of virtual content presented within a generated presentation region is disclosed. The method includes obtaining a first dimension associated with a physical environment; and detecting a request to cause presentation of virtual content. In response to detecting the request, the method also includes obtaining a second dimension associated with the virtual content; determining a view distance based at least in part on the first and second dimensions; and generating generate a presentation region for the virtual content based at least in part on the view distance. The method further includes presenting the virtual content within the presentation region.

Abstract: In accordance with various implementations, a method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes determining an engagement score associated with an object that is visible at the display. The engagement score characterizes a level of user engagement with respect to the object. The method includes, in response to determining that the engagement score satisfies an engagement criterion, determining an ambience vector associated with the object and presenting content based on the ambience vector. The ambience vector represents a target ambient environment.

Abstract: User interfaces for health applications are described. In some embodiments, user interfaces for health applications include an animated user-interactive graphical user interface object for launching an application. In some embodiments, user interfaces for health applications include virtual objects with a characteristic that changes.

Abstract: A method includes obtaining a virtual object that is animatable. The method includes determining that an animation of the virtual object is a function of a value obtained from a first application programming interface (API) of a plurality of APIs available at the device. The method includes displaying the animation of the virtual object in accordance with the value obtained from the first API.

Abstract: A computer system displays a representation of a user poses in a three-dimensional environment in response to movement of the current viewpoint of the user. The computer system displays different representations of movement of a virtual representation of a user based on the type of the virtual representation. The computer system reduces a visual prominence of virtual representations while changing a spatial arrangement of a virtual object shared in a communication session. The computer system displays different visual feedback while moving a virtual object in accordance with the virtual object being shared or not shared in a communication session. The computer system displays visual feedback indicating audio provided by another user. The computer system displays feedback indicating participants will correspond to positions. The computer system displays a visual transition sequence when displaying a visual representation of a participant in a communication session.

Abstract: Some examples of the disclosure are directed to methods for spatial placement of avatars in a communication session. In some examples, while a first electronic device is presenting a three-dimensional environment, the first electronic device may receive an input corresponding to a request to enter a communication session with a second electronic device. In some examples, in response to receiving the input, the first electronic device may scan an environment surrounding the first electronic device. In some examples, the first electronic device may identify a placement location in the three-dimensional environment at which to display a virtual object representing a user of the second electronic device. In some examples, the first electronic device displays the virtual object representing the user of the second electronic device at the placement location in the three-dimensional environment. Some examples of the disclosure are directed to methods for spatial refinement in the communication session.

Abstract: In one implementation, a method of activating a user interface element is performed at a device including an input device, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input including a gesture, the gesture having a first phase and a second phase separated by an amount of time. The method includes, in response to receiving the user input, determining whether to activate a first user interface element in a first mode based on a determination that the amount of time is within a threshold amount of time. The method includes, based on a determination to activate the first user interface element in the first mode, displaying the content in the first content pane by updating the first content pane.

Abstract: In one implementation, a method for dynamically determining presentation and transitional regions for content delivery. The method includes obtaining a first set of characteristics associated with a physical environment; and detecting a request to cause presentation of virtual content. In response to detecting the request, the method also includes obtaining a second set of characteristics associated with the virtual content; generating a presentation region for the virtual content based at least in part on the first and second sets of characteristics; and generating a transitional region provided to at least partially surround the presentation region based at least in part on the first and second sets of characteristics. The method further includes concurrently presenting the virtual content within the presentation region and the transitional region at least partially surrounding the presentation region.

Abstract: In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.

Abstract: In some embodiments, a computer system selectively recenters virtual content to a viewpoint of a user, in the presence of physical or virtual obstacles, and/or automatically recenters one or more virtual objects in response to the display generation component changing state, selectively recenters content associated with a communication session between multiple users in response detected user input, changes the visual prominence of content included in virtual objects based on viewpoint and/or based on a detected user attention of a user, modifies visual prominence of one or more virtual objects to resolve apparent obscuring of the one or more virtual objects, modifies visual prominence based on user viewpoint relative to virtual objects, concurrently modifies visual prominence based various types of user interaction, and/or changes an amount of visual impact of an environmental effect in response to detected user input.

Abstract: In one implementation, a method of activating a user interface element is performed at a device including an input device, an eye tracker, a display, one or more processors, and non-transitory memory. The method includes displaying, on the display, a plurality of user interface elements and receiving, via the input device, a user input corresponding to an input location. The method includes determining, using the eye tracker, a gaze location. The method includes, in response to determining that the input location is at least a threshold distance from the gaze location, activating a first user interface element at the gaze location and, in response to determining that it is not, activating a second user interface element at the input location.

Abstract: An electronic device displays a widget dashboard user interface in a three-dimensional environment, displays a representation of a physical tool to as guidance for indicating a location of the physical tool relative to a location associated with video feed, displays suggestions for changing a pose of a camera to a predetermined pose based on image data detected while the camera previously had the predetermined pose, displays a live camera feed and image data and scrubs through the image data in accordance with changes to a pose of the camera relative to a physical object, displays live stereoscopic camera feed with special effects, detects and responds to inputs for virtually annotating portions of objects, and/or displays models of objects and detects and responds to input for rotating and/or viewing the model from different depth positions within the model.

Abstract: An electronic device displays a widget dashboard user interface in a three-dimensional environment, displays a representation of a physical tool to as guidance for indicating a location of the physical tool relative to a location associated with video feed, displays suggestions for changing a pose of a camera to a predetermined pose based on image data detected while the camera previously had the predetermined pose, displays a live camera feed and image data and scrubs through the image data in accordance with changes to a pose of the camera relative to a physical object, displays live stereoscopic camera feed with special effects, detects and responds to inputs for virtually annotating portions of objects, and/or displays models of objects and detects and responds to input for rotating and/or viewing the model from different depth positions within the model.

Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.

Abstract: The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.

Abstract: Generating a 3D representation of a subject includes obtaining image data of a subject, obtaining tracking data for the subject based on the image data, and determining, for a particular frame of the image data, a velocity of the subject in the image data. A transparency treatment is applied to a portion of the virtual representation in accordance with the determined velocity. The portion of the virtual representation to which the transparency treatment is applied includes a shoulder region of the subject.

Abstract: Some examples of the disclosure are directed to systems and methods for displaying virtual presentations associated with a theater application in an augmented or fully-immersive three-dimensional environment. In one or more examples of the disclosure, the systems and methods include receiving a request to join a virtual presentation, and in response to receiving the request to join the virtual presentation, displaying a virtual presentation in a three-dimensional environment. The theater presentation is displayed in a manner that facilitates efficient communication between one or more presenter and one or more audience members who are part of the virtual presentation.

Abstract: The present disclosure generally relates to techniques and user interfaces for controlling and displaying representations of user in environments, such as during a live communication session and/or a live collaboration session.

Abstract: Various implementations disclosed herein include devices, systems, and methods that create a 3D video that includes determining first adjustments (e.g., first transforms) to video frames (e.g., one or more RGB images and depth images per frame) to align content in a coordinate system to remove the effects of capturing camera motion. Various implementations disclosed herein include devices, systems, and methods that playback a 3D video and includes determining second adjustments (e.g., second transforms) to remove the effects of movement of a viewing electronic device relative to a viewing environment during playback of the 3D video. Some implementations distinguish static content and moving content of the video frames to playback only moving objects or facilitate concurrent playback of multiple spatially related 3D videos. The 3D video may include images, audio, or 3D video of a video-capture-device user.