Abstract: Systems and methods for generating an image of an automobile can include generating an artificial surface for a 3D model of the automobile, blending the artificial surface with a real world surface, and generating the image of the automobile using a blended surface. The image can have a number of different blended surfaces (e.g., a cleaner floor, shadows for the automobile, reflections for the automobile). The images can be used to create a 360 degree display of the automobile where the blended surface is displayed.

Abstract: The medical image processing device includes a processor, in which the processor acquires a medical image obtained by imaging a subject with an endoscope, identifies a tumor region and a non-tumor region from the medical image, generates a demarcation line that is a boundary between the tumor region and the non-tumor region, generates a virtual incision line at a position separated from the demarcation line by a designated distance, and performs control for superimposing the demarcation line and the virtual incision line on the medical image to be displayed.

Abstract: An augmented reality (“AR”) device applies smooth correction methods to correct the location of the virtual objects presented to a user. The AR device may apply an angular threshold to determine whether a virtual object can be moved from an original location to a target location. An angular threshold is a maximum angle by which a line from the AR device to the virtual object can change within a timestep. Similarly, the AR device may apply a motion threshold, which is a maximum on the distance that a virtual object's location can be corrected based on the motion of the virtual object. Furthermore, the AR device may apply a pixel threshold to the correction of the virtual object's location. A pixel threshold is a maximum on the distance that a pixel projection of the virtual object can change based on the virtual object's change in location.

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, one or more environmental sensors, and a display. The method includes determining a first positional value associated with a physical agent based on environmental data from the one or more environmental sensors. The method includes determining that a portion of computer-generated content satisfies an occlusion criterion with respect to a corresponding portion of the physical agent, based on the first positional value. The method includes, in response to determining that the occlusion criterion is satisfied and determining that the physical agent satisfies a movement criterion or a pose criterion, generating a mesh associated with the physical agent based on the first positional value, and displaying the mesh on the display.

Abstract: Imaging devices, systems, and methods for analyzing an image taken by an imaging system are described herein. An example method includes: receiving a bank image from the imaging device pursuant to one of a plurality of banks of imaging parameters; rendering the bank image in an image display; receiving an indication of a region of interest (ROI) in the image display associated with a user-selected tool; determining whether the user-selected tool is set to use the bank image, an output of a parent tool, or an output of the user-selected tool; and generating, in the image display, at least a portion of a display image in the ROI representative of: (i) the bank image, (ii) the output of the parent tool, or (iii) the output of the user-selected tool; wherein the portion of the display image is associated with the user-selected region.

Abstract: An augmented-reality device is used with a surveying system to guide a base station, such as a total station, during relock after loss of line of sight with a surveying instrument, such as a surveying pole with a reflective prism. A position of the surveying instrument in relation to the augmented-reality device is calculated while an object in the environment blocks line of sight from the base station to the surveying instrument. A position of the surveying instrument in relation to the environment is calculated based on the position of the surveying instrument in relation to the augmented-reality device. The position of the surveying instrument in relation to the environment is used by the base station to point toward to the surveying instrument.

Abstract: A computer system displays an alert at a first position relative to the three-dimensional environment, the alert at least partially overlapping a first object in a first view. The first position has a respective spatial relationship to the user. The computer system detects movement of the user from a first viewpoint to a second viewpoint. At the second viewpoint, the computer system, in accordance with a determination that the alert is a first type of alert, displays the alert at a second position in the three-dimensional environment, the second position having the respective spatial relationship to the user and in accordance with a determination that the alert is a second type of alert, displays the three-dimensional environment from the second viewpoint without displaying the alert with the respective spatial relationship to the user.

Abstract: In some implementations, a method of generating a third person view of a computer-generated reality (CGR) environment is performed at a device including non-transitory memory and one or more processors coupled with the non-transitory memory. The method includes: obtaining a first viewing vector associated with a first user within a CGR environment; determining a first viewing frustum for the first user within the CGR environment based on the first viewing vector associated with the first user and one or more depth attributes; generating a representation of the first viewing frustum; and displaying, via the display device, a third person view of the CGR environment including an avatar of the first user and the representation of the first viewing frustum adjacent to the avatar of the first user.

Abstract: In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.

Abstract: An image processing system configured to obtain a mesh representation of a scene, wherein the mesh representation comprises a plurality of polygons defined by respective vertices associated with an in-plane position, the in-plane position being in a plane comprising a first dimension and a second dimension, and the vertices having an associated vertex depth value in a third dimension different from the first dimension and the second dimension. The image processing system comprises an in-plane position estimation network configured to process image data representative of an image of the scene to estimate the in-plane positions associated with respective vertices of the mesh representation. The image processing system further comprises a depth estimation engine configured to process the in-plane positions and the image data to estimate the associated vertex depth values for the respective vertices of the mesh representation.

Abstract: A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

Abstract: Techniques for performing shader operations are provided. The techniques include, performing pixel shading at a shading rate defined by pixel shader variable rate shading (“VRS”) data, and updating the pixel VRS data that indicates one or more shading rates for one or more tiles based on whether the tiles of the one or more tiles include triangle edges or do not include triangle edges, to generate updated VRS data.

Abstract: The invention relates to two computer implemented methods providing virtual fitting room functionality to a human. The two computer implemented methods allow for a simple and efficient garment selection process by the human.

Abstract: A computing device is configured to obtain gridline information for a three-dimensional drawing file and generate a two-dimensional view of the three-dimensional drawing file that includes (1) at least one gridline corresponding to the obtained gridline information, (2) at least one intersection between two meshes, and (3) initial dimensioning information involving (a) the at least one gridline and (b) at least one of the two meshes. Based on a user request to adjust a perspective of the two-dimensional view, the computing device adjusts the perspective of the two-dimensional view and thereby generates an updated two-dimensional view that includes updated dimensioning information corresponding to one or more meshes displayed in the updated two-dimensional view.

Abstract: In one or more implementations, third-party content may include one or more objects and may include one or more visual effects related to the one or more objects. Augmented reality content may be generated that applies the one or more visual effects to additional object shown in a field of view of a camera. The third-party content may correspond to one or more products that are available for purchase via a client application.

Abstract: The subject technology receives information for a product. The subject technology generates a 3D model file of the product in a first format. The subject technology converts the 3D model file to a 3D object file in a second format. The subject technology associates the 3D object file to the product in a product catalog service. The subject technology publishes an augmented reality (AR) content generator corresponding to the product.

Abstract: An information processing system includes an estimation unit that, when map information indicating a map of an environment around a first device in a real space is updated, estimates a position of the first device, based on observation information obtained by observing the environment around the first device and the map information after update, an identification unit that identifies a position of a virtual camera provided in a virtual space associated with the real space, based on the position of the first device estimated by the estimation unit, and a video generation unit that generates a video of the virtual space corresponding to an imaging range of the camera at the position identified by the identification unit.

Abstract: A mobile device includes a display, a camera to capture an image of a space in which an image device can be installed, a user interface, and a controller. The controller can identify a plane from the image captured by the camera, control the display so as to display a grid on a virtual plane corresponding to the plane, adjust the grid based on an input of a user received via the user interface, and control the display so as to display, on the grid, the virtual image of the image device.

Abstract: Embodiments of the disclosure provide methods and systems for multi-modality joint analysis of a plurality of vascular images. The exemplary system may include a communication interface configured to receive the plurality of vascular images acquired using a plurality of imaging modalities. The system may further include at least one processor, configured to extract a plurality of vessel models for a vessel of interest from the plurality of vascular images. The plurality of vessel models are associated with the plurality of imaging modalities, respectively. The at least one processor is also configured to fuse the plurality of vessel models associated with the plurality of imaging modalities to generate a fused model for the vessel of interest. The at least one processor is further configured to provide a diagnostic analysis result based on the fused model of the vessel of interest.

Abstract: Human behavioural characteristics in an augmented reality session having a product under development are detected. The characteristics are transformed into performance metrics that together with identified product features define metrics for each feature. A smartphone (110), a system and a method for a virtual object on the augmented reality are disclosed. The user (230) examines the new design or product in the augmented reality environment, for example, where features of the design are presented in a relatable context or in a familiar environment. The user (230) may control the virtual object on the augmented reality view by a display device, for example, by a smartphone.