Abstract: In some implementations, a method of generating a third person view of a computer-generated reality (CGR) environment is performed at a device including non-transitory memory and one or more processors coupled with the non-transitory memory. The method includes: obtaining a first viewing vector associated with a first user within a CGR environment; determining a first viewing frustum for the first user within the CGR environment based on the first viewing vector associated with the first user and one or more depth attributes; generating a representation of the first viewing frustum; and displaying, via the display device, a third person view of the CGR environment including an avatar of the first user and the representation of the first viewing frustum adjacent to the avatar of the first user.

Abstract: In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.

Abstract: An augmented-reality device is used with a surveying system to guide a base station, such as a total station, during relock after loss of line of sight with a surveying instrument, such as a surveying pole with a reflective prism. A position of the surveying instrument in relation to the augmented-reality device is calculated while an object in the environment blocks line of sight from the base station to the surveying instrument. A position of the surveying instrument in relation to the environment is calculated based on the position of the surveying instrument in relation to the augmented-reality device. The position of the surveying instrument in relation to the environment is used by the base station to point toward to the surveying instrument.

Abstract: A computer system displays an alert at a first position relative to the three-dimensional environment, the alert at least partially overlapping a first object in a first view. The first position has a respective spatial relationship to the user. The computer system detects movement of the user from a first viewpoint to a second viewpoint. At the second viewpoint, the computer system, in accordance with a determination that the alert is a first type of alert, displays the alert at a second position in the three-dimensional environment, the second position having the respective spatial relationship to the user and in accordance with a determination that the alert is a second type of alert, displays the three-dimensional environment from the second viewpoint without displaying the alert with the respective spatial relationship to the user.

Abstract: An image processing system configured to obtain a mesh representation of a scene, wherein the mesh representation comprises a plurality of polygons defined by respective vertices associated with an in-plane position, the in-plane position being in a plane comprising a first dimension and a second dimension, and the vertices having an associated vertex depth value in a third dimension different from the first dimension and the second dimension. The image processing system comprises an in-plane position estimation network configured to process image data representative of an image of the scene to estimate the in-plane positions associated with respective vertices of the mesh representation. The image processing system further comprises a depth estimation engine configured to process the in-plane positions and the image data to estimate the associated vertex depth values for the respective vertices of the mesh representation.

Abstract: Techniques for performing shader operations are provided. The techniques include, performing pixel shading at a shading rate defined by pixel shader variable rate shading (“VRS”) data, and updating the pixel VRS data that indicates one or more shading rates for one or more tiles based on whether the tiles of the one or more tiles include triangle edges or do not include triangle edges, to generate updated VRS data.

Abstract: A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

Abstract: The invention relates to two computer implemented methods providing virtual fitting room functionality to a human. The two computer implemented methods allow for a simple and efficient garment selection process by the human.

Abstract: A computing device is configured to obtain gridline information for a three-dimensional drawing file and generate a two-dimensional view of the three-dimensional drawing file that includes (1) at least one gridline corresponding to the obtained gridline information, (2) at least one intersection between two meshes, and (3) initial dimensioning information involving (a) the at least one gridline and (b) at least one of the two meshes. Based on a user request to adjust a perspective of the two-dimensional view, the computing device adjusts the perspective of the two-dimensional view and thereby generates an updated two-dimensional view that includes updated dimensioning information corresponding to one or more meshes displayed in the updated two-dimensional view.

Abstract: In one or more implementations, third-party content may include one or more objects and may include one or more visual effects related to the one or more objects. Augmented reality content may be generated that applies the one or more visual effects to additional object shown in a field of view of a camera. The third-party content may correspond to one or more products that are available for purchase via a client application.

Abstract: An information processing system includes an estimation unit that, when map information indicating a map of an environment around a first device in a real space is updated, estimates a position of the first device, based on observation information obtained by observing the environment around the first device and the map information after update, an identification unit that identifies a position of a virtual camera provided in a virtual space associated with the real space, based on the position of the first device estimated by the estimation unit, and a video generation unit that generates a video of the virtual space corresponding to an imaging range of the camera at the position identified by the identification unit.

Abstract: The subject technology receives information for a product. The subject technology generates a 3D model file of the product in a first format. The subject technology converts the 3D model file to a 3D object file in a second format. The subject technology associates the 3D object file to the product in a product catalog service. The subject technology publishes an augmented reality (AR) content generator corresponding to the product.

Abstract: A mobile device includes a display, a camera to capture an image of a space in which an image device can be installed, a user interface, and a controller. The controller can identify a plane from the image captured by the camera, control the display so as to display a grid on a virtual plane corresponding to the plane, adjust the grid based on an input of a user received via the user interface, and control the display so as to display, on the grid, the virtual image of the image device.

Abstract: Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Abstract: Disclosed are systems and methods that detect segments of video, such as HDR video, that include content, such as edges and details in dark scenes, that cannot be presented on some displays. Output models for different display types, such as edge-lit LCD, backlit LCD, etc., may be created and used to process video with respect to those different display types to determine if segments of the video cannot be presented on the display type at the pixel brightness values indicated in the video. In some implementations, HDR video may also or alternatively be compared to SDR video to determine segments of the video that are of interest, especially in low light scenes.

Abstract: Human behavioural characteristics in an augmented reality session having a product under development are detected. The characteristics are transformed into performance metrics that together with identified product features define metrics for each feature. A smartphone (110), a system and a method for a virtual object on the augmented reality are disclosed. The user (230) examines the new design or product in the augmented reality environment, for example, where features of the design are presented in a relatable context or in a familiar environment. The user (230) may control the virtual object on the augmented reality view by a display device, for example, by a smartphone.

Abstract: Hardware tessellation units include a sub-division logic block that comprises hardware logic arranged to perform a sub-division of a patch into two (or more) sub-patches. The hardware tessellation units also include a decision logic block that is configured to determine whether a patch is to be sub-divided or not and one or more hardware elements that control the order in which tessellation occurs. In various examples, this hardware element is a patch stack that operates a first-in-last-out scheme and in other examples, there are one or more selection logic blocks that are configured to receive patch data for more than one patch or sub-patch and output the patch data for a selected one of the received patches or sub-patches.

Abstract: A method of generating identifiers (IDs) for primitives and optionally vertices during tessellation. The IDs include a binary sequence of bits that represents the sub-division steps taken during the tessellation process and so encodes the way in which tessellation has been performed. Such an ID may subsequently be used to generate a random primitive or vertex and hence recalculate vertex data for that primitive or vertex.

Abstract: An information processing apparatus according to one embodiment of the present disclosure obtains image capturing information including information representing a position and an orientation of an image capturing device and movement information representing specific movement of the image capturing device; and generates viewpoint information representing a position of a virtual viewpoint and a view direction from the virtual viewpoint for generating a virtual viewpoint video based on the obtained image capturing information and the obtained movement information in a case where a captured image obtained by the image capturing device and the virtual viewpoint video generated based on a plurality of images are switched.

Abstract: A method for generating a virtual tablet at a comfortable position relative to a user's hand in an extended reality environment.