Abstract: In some implementations, a device includes one or more sensors, one or more processors and a non-transitory memory. In some implementations, a method includes determining that a first portion of a physical environment is associated with a first saliency value and a second portion of the physical environment is associated with a second saliency value that is different from the first saliency value. In some implementations, the method includes obtaining, via the one or more sensors, environmental data corresponding to the physical environment. In some implementations, the method includes generating, based on the environmental data, a model of the physical environment by modeling the first portion with a first set of modeling features that is a function of the first saliency value and modeling the second portion with a second set of modeling features that is a function of the second saliency value.

Abstract: A first device includes a display, an input device, a non-transitory memory and one or more processors coupled with the display, the input device and the non-transitory memory. In some implementations, a method includes detecting, via the input device, an input that corresponds to a request to generate a path for an entity to follow while a sequence of images is to be captured. In some implementations, the method includes generating the path for the entity based on the request. In some implementations, the method includes triggering a second device that is associated with the entity to overlay a virtual indicator indicative of the path on a pass-through of a physical environment. In some implementations, the virtual indicator guides the entity along the path while the sequence of images is captured.

Abstract: Various implementations disclosed herein include devices, systems, and methods for displaying a visual indicator for capturing images. In some implementations, a device includes a display, an environmental sensor, a non-transitory memory, and one or more processors coupled with the display, the environmental sensor and the non-transitory memory. In various implementations, a method includes obtaining a request to capture a sequence of images depicting a subject. The sequence of images is to be captured while an image sensor is being moved along a path with a predefined shape. The method includes determining a dimension of the path. The method includes overlaying, on a pass-through of the physical environment, a virtual indicator that indicates the path with the dimension and the predefined shape. The virtual indicator guides a user of the device along the path while capturing the sequence of the images with the image sensor.

Abstract: Various implementations disclosed herein include devices, systems, and methods for selecting a point-of-view (POV) for displaying an environment. In some implementations, a device includes a display, one or more processors, and a non-transitory memory. In some implementations, a method includes obtaining a request to display a graphical environment. The graphical environment is associated with a set of saliency values corresponding to respective portions of the graphical environment. A POV for displaying the graphical environment is selected based on the set of saliency values. The graphical environment is displayed from the selected POV on the display.

Abstract: In various implementations, a method includes obtaining a first virtual object kit that corresponds to a first virtual object type. In various implementations, the method includes obtaining a second virtual object kit corresponding to a second virtual object type that is different from the first virtual object type. In various implementations, the method includes merging the first virtual object kit and the second virtual object kit in order to form a third virtual object kit. In some implementations, the third virtual object kit includes a set of virtual object templates of a third virtual object type that is different from the first virtual object type and the second virtual object type. In some implementations, the third virtual object kit includes a plurality of groups of components associated with respective portions of a virtual object.

Abstract: Various implementations use object information to facilitate a communication session. Some implementations create a dense reconstruction (e.g., a point cloud or triangular mesh) of a physical environment, for example, using light intensity images and depth sensor data. A less data-intensive object information is also created to represent the physical environment for more efficient storage, editing, sharing, and use. In some implementations, the object information includes object attribute and location information. In some implementations, a 2D floorplan or other 2D representation provides object locations and metadata (e.g., object type, texture, heights, dimensions, etc.) provide object attributes. The object location and attribute information may be used, during a communication session, to generate a 3D graphical environment that is representative of the physical environment.

Abstract: In one implementation, a method is disclosed for providing visual coherency between virtual objects and a physical environment. The method includes obtaining, at an electronic device, first content depicting a physical surface in the physical environment using an image sensor of the electronic device. An extrinsic property exhibited by the physical surface is determined based on the first content using a visual coherency model. Second content representing a virtual object is generated based on the extrinsic property to present on a display.

Abstract: In various implementations, a method includes obtaining a first virtual object kit that corresponds to a first virtual object type. In various implementations, the method includes obtaining a second virtual object kit corresponding to a second virtual object type that is different from the first virtual object type. In various implementations, the method includes merging the first virtual object kit and the second virtual object kit in order to form a third virtual object kit. In some implementations, the third virtual object kit includes a set of virtual object templates of a third virtual object type that is different from the first virtual object type and the second virtual object type. In some implementations, the third virtual object kit includes a plurality of groups of components associated with respective portions of a virtual object.

Abstract: In one implementation, a method is disclosed for providing visual coherency between virtual objects and a physical environment. The method includes obtaining, at an electronic device, first content depicting a physical surface in the physical environment using an image sensor of the electronic device. An extrinsic property exhibited by the physical surface is determined based on the first content using a visual coherency model. Second content representing a virtual object is generated based on the extrinsic property to present on a display.

Abstract: A system of editing and rendering an on-screen image, by:storing 3D data of an object; storing a 2D image of surroundings of the object; and displaying a 2D image of the object concurrently with the 2D image of the surroundings of the object; editing the 3D image of the object; and rendering the edited 3D image of the object. Optionally, editing the image includes: editing the image in a 2D viewer; editing the image by interactive ray tracing when it is not possible to edit the edit the image in a 2D viewer; and editing the image by a hardware accelerated offline render path when it is not desirable to edit the image by interactive ray tracing.