Abstract: A system aligns a 3D model of an environment with image frames of the environment and generates a visualization interface that displays a portion of the 3D model and a corresponding image frame. The system receives LIDAR data collected in the environment and generates a 3D model based on the LIDAR data. For each image frame, the system aligns the image frame with the 3D model. After aligning the image frames with the 3D model, when the system presents a portion of the 3D model in an interface, it also presents an image frame that corresponds to the portion of the 3D model.

Abstract: Systems and methods are described for extended reality environment interaction. An extended reality environment including an object is generated for display, and an eye motion is detected. Based on the detecting, it is determined whether the object is in a field of view for at least a predetermined period of time, and in response to determining that the object is in the field of view for at least the predetermined period of time, one or more items related to the object are generated for display in the extended virtual reality environment.

Abstract: An information processing apparatus includes a controller (100) that performs: control of displaying information in augmented reality in a preparation mode in which a real object is disposed, the information that supports disposition of the real object on the basis of prerecorded information about the real object with which a virtual object has an interaction; and control of recording disposition result information of the real object in a disposition result information database referred to in a normal mode in which the virtual object that has the interaction with the disposed real object is displayed.

Abstract: Disclosed is an augmented reality training system, which includes a manipulation platform, an augmented reality stereo microscopic assembly, an instrument tracking module and a simulation generation module. The augmented reality stereo microscopic assembly is configured for camera-based capture of real stereo videos and for optical transmission of augmented reality images into the user's eyes. The instrument tracking module uses top and bottom digital cameras to track a marker on an upper portion of an instrument manipulated on a surgical phantom and to track a lower portion of the instrument. The simulation generation module can generate and display augmented reality images that merge the real stereo videos and virtual images for simulation of actions of the instrument in interaction with a training program executed in a processor of the simulation generation module.

Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.

Abstract: Methods, devices, and computer readable media for control of user interface windows in a virtual reality environment. The method includes displaying a window in a viewable area of a virtual reality environment on a display of a head mountable device (HMD), the viewable area determined based on orientation of the HMD. The method further includes receiving a request to lock a position of the window in the viewable area and locking the position of the window in the viewable area in response to the lock request. The position of the window is fixed in the viewable area relative to the orientation of the HMD, when locked, regardless of the orientation of the HMD.

Abstract: An example computing system is configured to extract gridline information from a two-dimensional drawing file and determine, for the gridline information, first coordinate information that is based on a first datum. The computing system converts the first coordinate information into second coordinate information that is based on a second datum, where the second coordinate information is used by a three-dimensional drawing file. The computing system is also configured to receive a request to generate a two-dimensional view of the three-dimensional drawing file, where the two-dimensional view includes an intersection of two meshes within the three-dimensional drawing file. The computing device generates the two-dimensional view of the three-dimensional drawing file and adds, to the generated two-dimensional view, (i) at least one gridline corresponding to the gridline information and (ii) dimensioning information involving the at least one gridline and at least one of the two meshes.

Abstract: In some embodiments, the disclosed subject matter involves a head worn device (HWD) for viewing augmented reality, or virtual images. A projector coupled to the HWD may use a microelectromechanical systems projector and project onto a holographic lens of the HWD. Images may be projected into an eyebox area that is deemed comfortable to the user, the eyebox area located in one of a plurality of vertically adjacent recording zones. The recording zone for projection may be selected by the user, or be automatically selected based on configuration parameters of the HWD. Horizontal correction of the eyebox may be included. In an embodiment, multiple horizontal images are displayed in the selected recording zone, in different wavelengths. Another embodiment adjusts horizontal shift of the projected image based on user inputs. Other embodiments are described and claimed.

Abstract: Implementations of blender hardware perform both domain shading and blending and whilst some vertices may not require blending, all vertices require domain shading. The blender hardware includes a cache and/or a content addressable memory and these data structures are used to reduce duplicate domain shading operations.

Abstract: Relating to an the integrated rendering method for various extended reality modes and a device having thereof, loading an XR-scene content including at least one virtual object content representing an extended reality image from a storage and representing a virtual object included in the extended reality image; inputting a selection, from a user, of any one extended reality mode among a plurality of extended reality modes including a virtual reality mode and an augmented reality mode; and maintaining or converting a property of each of a plurality of rendering options for at least one virtual object content according to the selected extended reality mode, and rendering at least one virtual object content having the maintained or converted property. Therefore, a virtual reality image and an augmented reality image can be generate from one XR-scene content.

Abstract: Hardware tessellation units include a sub-division logic block that comprises hardware logic arranged to perform a sub-division of a patch into two (or more) sub-patches. The hardware tessellation units also include a decision logic block that is configured to determine whether a patch is to be sub-divided or not and one or more hardware elements that control the order in which tessellation occurs. In various examples, this hardware element is a patch stack that operates a first-in-last-out scheme and in other examples, there are one or more selection logic blocks that are configured to receive patch data for more than one patch or sub-patch and output the patch data for a selected one of the received patches or sub-patches.

Abstract: A user interface apparatus for a vehicle includes: an interface unit; a display unit configured to project an augmented reality (AR) graphic object onto a screen; at least one processor; and a computer-readable medium coupled to the at least one processor having stored thereon instructions which, when executed by the at least one processor, causes the at least one processor to perform operations including: acquiring, through the interface unit, front view image information and vehicle motion information; based on the front view image information, generating the AR graphic object; and based on the vehicle motion information, warping the AR graphic object.

Abstract: An estimator (111) estimates whether an object is on the line of sight of the user. When a first object is estimated as being on the line of sight of the user continuously for a first threshold time, set for the user, or longer, a displayer (112) displays a second object in the field of view of the user. The second object expresses information about the first object. When the second object is estimated as not being on the line of sight of the user continuously for a second threshold time, set for the user, or longer, a remover (113) removes the second object from the field of view of the user. A corrector (114) corrects the first threshold time according to the length of viewing time that the second object is estimated as being on the line of sight of the user. Here, the first threshold time is set for the user.

Abstract: In one embodiment, a method of intermingling stereoscopic and conforming virtual content to a bounded surface is performed at a device that includes one or more processors, non-transitory memory, and one or more displays. The method includes displaying a bounded surface within a native user computer-generated reality (CGR) environment, wherein the bounded surface is displayed based on a first set of world coordinates characterizing the native user CGR environment. The method further includes displaying a first stereoscopic virtual object within a perimeter of a first side of the bounded surface, wherein the first stereoscopic virtual object is displayed in accordance with a second set of world coordinates that is different from the first set of world coordinates characterizing the native user CGR environment.

Abstract: Examples of the disclosure describe systems and methods for presenting virtual content on a wearable head device. In some embodiments, a state of a wearable head device is determined by minimizing a total error based on a reduced weight associated with a reprojection error. A view reflecting the determined state of the wearable head device is presented via a display of the wearable head device. In some embodiments, a wearable head device calculates a first preintegration term and second preintegration term based on the image data received via a sensor of the wearable head device and the inertial data received via a first IMU and a second IMU of the wearable head device. The wearable head device estimates a position of the device based on the first and second preintegration terms, and the wearable head device presents the virtual content based on the position of the device.

Abstract: Methods and systems for the remote delivery of professional services, using augmented reality (AR), are disclosed. In embodiments, a user scans or acquires a physical marker, such as an optical code or radio beacon. The physical marker provides information to the user's device to allow it to connect to a server. The physical marker may also provide contextual data, possibly in conjunction with contextual data from the user's device. The server then provides a list of professionals on the basis of the contextual data. The user selects a professional, and the server initiates a video session between a user device and a professional device, where the professional can superimpose one or more AR objects on the video, to be displayed on the user device.

Abstract: Various implementations disclosed herein include devices, systems, and methods that dynamically-size zones used in foveated rendering of content that includes text. In some implementations, this involves adjusting the size of a first zone, e.g., a foveated gaze zone (FGZ), based on the apparent size of text from a viewpoint. For example, a FGZ may be increased or decreased in width, height, diameter, or other size attribute based on determining an angle subtended by one or more individual glyphs of the text from the viewpoint. Various implementations disclosed herein include devices, systems, and methods that select a text-rendering algorithm based on a relationship between (a) the rendering resolution of a portion of an image corresponding to a part of a glyph and (b) the size that the part of the glyph will occupy in the image.

Abstract: A method of generating identifiers (IDs) for primitives and optionally vertices during tessellation. The IDs include a binary sequence of bits that represents the sub-division steps taken during the tessellation process and so encodes the way in which tessellation has been performed. Such an ID may subsequently be used to generate a random primitive or vertex and hence recalculate vertex data for that primitive or vertex.

Abstract: A method, including acquiring initial signals from selected positions in a heart, computing respective initial local values of a signal propagation metric at the selected positions, and interpolating the initial local values between the selected positions to compute initial interpolated values of the signal propagation metric at intermediate positions, between the selected positions. The method further includes acquiring subsequent signals from the positions, computing respective subsequent local values of the signal propagation metric at the selected positions, and spatially interpolating the subsequent local values of the signal propagation metric between the selected positions to compute subsequent interpolated values of the signal propagation metric at the intermediate positions.

Abstract: Unnatural display is reduced by changing the appearance of a real space. A display control apparatus includes: an information acquisition unit that acquires reliability information indicating reliability of each of element data constituting three-dimensional data of a real space; a region specification unit that specifies a region corresponding to element data of which the reliability does not meet a criterion; and a display control unit that performs display control for changing the appearance of the region specified by the region specification unit.