Abstract: An apparatus comprises a receiver (301) for receiving an image representation of a scene. A determiner (305) determines viewer poses for a viewer with respect to a viewer coordinate system. An aligner (307) aligns a scene coordinate system with the viewer coordinate system by aligning a scene reference position with a viewer reference position in the viewer coordinate system. A renderer (303) renders view images for different viewer poses in response to the image representation and the alignment of the scene coordinate system with the viewer coordinate system. An offset processor (309) determines the viewer reference position in response to an alignment viewer pose where the viewer reference position is dependent on an orientation of the alignment viewer pose and has an offset with respect to a viewer eye position for the alignment viewer pose. The offset includes an offset component in a direction opposite to a view direction of the viewer eye position.

Abstract: A method and system for providing access to and control of parameters within a scenegraph includes redefining components or nodes' semantic within a scenegraph. The set of components or nodes (depending on the scenegraph structure) are required to enable access from the Application User Interface to selected scenegraph information. In one embodiment, a user interface is generated for controlling the scenegraph parameters. In addition, constraints can be implemented that allow or disallow access to certain scenegraph parameters and restrict their range of values.

Abstract: In general, embodiments of the present invention provide methods, apparatuses, systems, computing devices, computing entities, and/or the like for performing mixed reality processing using at least one of depth-based partitioning of a point cloud capture data object, object-based partitioning of a point cloud capture data object, mapping a partitioned point cloud capture data object to detected objects of a three-dimensional scan data object, performing noise filtering on point cloud capture data objects based at least in part on geometric inferences from three-dimensional scan data objects, and performing geometrically-aware object detection using point cloud capture data objects based at least in part on geometric inferences from three-dimensional scan data objects.

Abstract: A construction visualization device generates a digital model of a structure for construction in a physical space. Notably, the digital model includes at least one model marker and the physical space includes at least one physical marker. The device also determines a viewing orientation of the digital model for display relative to the physical space based on the at least one model marker and the at least one physical marker. In addition, the device identifies a model position of a model part that corresponds to a physical position of a physical part of the structure, and displays at least a portion of the digital model based on the viewing orientation to indicate the model position of the model part.

Abstract: The present disclosure relates to the field of image analysis, in particular, it relates to a method for generating a virtual scene of objects. The disclosure also relates to a device comprising circuitry configured to carry out the method. The disclosure also relates to a computer program product adapted to carry out the method.

Abstract: A material data collection system allows capturing of material data. For example, the material data collection system may include digital image data for materials. The material data collection system may ensure that captured digital image data is properly aligned, so that material data may be easily recalled for later use, while maintaining the proper alignment for the captured digital image. The material data collection system may include using a capture guide, to provide cues on how to orient a mobile device used with the material data collection system.

Abstract: Embodiments herein provide techniques for signaling of priority information (e.g., priority ranking) and/or quality information in a timed metadata track associated with point cloud content. For example, embodiments include procedures for signaling of priority information and/or quality information in a timed metadata track to support viewport-dependent distribution of point cloud content, e.g., based on MPEG's International Organization for Standardization (ISO) Base Media File Format (ISOBMFF). In some embodiments, metadata samples of the timed metadata track may include priority information and/or quality information for a point cloud bounding box of a point cloud media presentation (e.g., for one or more point cloud objects in the point cloud bounding box). Other embodiments may be described and claimed.

Abstract: With the advent of augmented reality devices becoming increasingly prevalent, accessible, and cross-compatible, there is an opportunity to leverage the capabilities of such devices in order to streamline workflow and information access in number of contexts. The present invention provides an integrated, dynamic system for leveraging the capabilities of augmented reality systems in order to provide users with personalized information in a dependable, seamless, and secure manner.

Abstract: Systems and methods for generating augmented reality environments from 2D drawings are provided. The system performs a camera calibration process to determine how a camera transforms images from the real world into a 2D image plane. The system calculates a camera pose and determines an object position and an object orientation relative to a known coordinate system. The system detects and processes a 2D drawing/illustration and generates a 3D model from the 2D drawing/illustration. The system performs a rendering process, wherein the system generates an augmented reality environment which includes the 3D model superimposed on an image of the 2D drawing/illustration. The system can generate the augmented reality environment in real time, allowing the system to provide immediate feedback to the user. The images processed by the system can be from a video, from multiple image photography, etc.

Abstract: A method of displaying virtual information in a view of a real environment comprising the following steps: providing the system relative to at least one part of the real environment and providing accuracy information of the current pose, providing multiple pieces of virtual information, and assigning a respective one of the pieces of virtual information to one of different parameters indicative of different pose accuracy information, and displaying at least one of the pieces of virtual information in the view of the real environment according to the accuracy information of the current pose in relation to the assigned parameter.

Abstract: Embodiments are disclosed for emulation of graphics processing unit instructions. An example method executing an instrumented kernel using a logic circuit, the instrumented kernel including an emulation sequence; saving, in response to determination that the emulation sequence is to be executed, source data to a shared memory; setting an emulation request flag to indicate to processor circuitry separate from the logic circuit that offloaded execution of the emulation sequence is to be executed; monitoring the emulation request flag to determine whether the offloaded execution of the emulation sequence is complete; and accessing resulting data from the shared memory.

Abstract: A configuration tool adapted to configure a quality control system to monitor and/or guide an operator in a working environment through recognition of objects, events or an operational process, comprises: a volumetric sensor adapted to capture volumetric image frames of the working environment while an object, event or operational process is demonstrated; a display, coupled to the volumetric sensor and configured to live display the volumetric image frames; and a processor configured to: generate a user interface in overlay of the volumetric image frames to enable a user to define a layout zone; and automatically generate a virtual box in the layout zone when an object, event or operational process is detected during demonstration of the object, event or operational process.

Abstract: One embodiment is directed to a system for presenting views of a very large point data set, comprising: a storage system comprising data representing a point cloud comprising a very large number of associated points; a controller operatively coupled to the storage cluster and configured to automatically and deterministically organize the point data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; and a user interface through which a user may select a viewing perspective origin and vector, which may be utilized to command the controller to assemble an image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy.

Abstract: A system comprises a storage system comprising data representing a point cloud comprising a very large number of associated points; a controller operatively coupled to the storage cluster and configured to organize the data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; and a user interface through which a user may select a viewing perspective origin and vector, which may be utilized to command the controller to assemble an image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy, the plurality of data sectors being assembled such that sectors representative of points closer to the selected viewing origin have a higher octree mesh resolution than that of sectors representative of points farther away from the selected viewing origin.

Abstract: One method embodiment comprises storing data on a storage system that is representative of a point cloud comprising a very large number of associated points; organizing the data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; receiving a command from a user of a user interface to present an image based at least in part upon a selected viewing perspective origin and vector; and assembling the image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy, the plurality of data sectors being assembled such that sectors representative of points closer to the selected viewing origin have a higher octree mesh resolution than that of sectors representative of points farther away from the selected viewing origin.

Abstract: One embodiment is directed to a method for presenting views of a very large point data set, comprising: storing data on a storage system that is representative of a point cloud comprising a very large number of associated points; automatically and deterministically organizing the data into an octree hierarchy of data sectors, each of which is representative of one or more of the points at a given octree mesh resolution; receiving a command from a user of a user interface to present an image based at least in part upon a selected viewing perspective origin and vector; and assembling the image based at least in part upon the selected origin and vector, the image comprising a plurality of data sectors pulled from the octree hierarchy.

Abstract: Ray tracing systems and computer-implemented methods are described for performing intersection testing on a bundle of rays with respect to a box. Silhouette edges of the box are identified from the perspective of the bundle of rays. For each of the identified silhouette edges, components of a vector providing a bound to the bundle of rays are obtained and it is determined whether the vector passes inside or outside of the silhouette edge. Results of determining, for each of the identified silhouette edges, whether the vector passes inside or outside of the silhouette edge, are used to determine an intersection testing result for the bundle of rays with respect to the box.

Abstract: Techniques are described for operating an optical system. In some embodiments, light associated with a world object is received at the optical system. Virtual image light is projected onto an eyepiece of the optical system. A portion of a system field of view of the optical system to be at least partially dimmed is determined based on information detected by the optical system. A plurality of spatially-resolved dimming values for the portion of the system field of view may be determined based on the detected information. The detected information may include light information, gaze information, and/or image information. A dimmer of the optical system may be adjusted to reduce an intensity of light associated with the world object in the portion of the system field of view according to the plurality of dimming values.

Abstract: Techniques for providing indirect local geo-positioning using AR markers are disclosed. A first movable AR marker can be located or found by a computing device. A location of the first movable AR marker can be known and shared with the computing device. The location of the first movable AR marker can be based on distance between the first movable AR marker and a fixed AR marker. A distance to the first movable AR marker can be determined. Based on the known location of the first movable AR marker and the distance to the first movable AR marker from the computing device, an estimate of the location of the computing device can be determined without having line-of-sight (LOS) to the fixed AR marker.

Abstract: Aspects of the present disclosure are directed to a holographic calling system providing holographic calling between an artificial reality device and a mobile device having both front and back facing cameras. The user of the mobile device can position it so one of the cameras is pointed toward their face and another camera captures the user's hand not holing the mobile device. The holographic calling system can automatically determine the position of the mobile device in relation to the user's face and hand. Once the mobile device is positioned within an appropriate capture zone, the captured images of the user's face are used to create a first representation of the sending user's face, the captured images of the user's hand are used to create a second representation of the sending user's hand. Each representation is provided as output from a receiving artificial reality device, positioned relative to each other.