Abstract: A system and method for allowing a smooth transition between a public digital reality experience into a private digital reality experience. A cloud server delimitates a public digital zone where interactions with digital reality applications stored in the cloud server and corresponding digital content are viewable to all users in the public digital zone. When users access the public digital zone, the cloud server detects the users and provides digital content from the digital reality to the users via digital reality devices. Upon reaching predetermined levels of interaction, users may access a personal digital reality view, whereby a smooth transition from a public to a personal digital reality experience takes place, prompting a specific portion of computing power from the cloud server to be dedicated to the specific user to enable personal interactions with the digital content. Users may also invite other users to engage in a multi-user private streaming.

Abstract: Systems, apparatuses, and methods for executing a shader core instruction to invoke depth culling are disclosed. A shader core executes an instruction to invoke a culling function on a depth culling unit for one or more entities prior to completing a corresponding draw call. The shader core provides a mode and coordinates to the depth culling unit as a result of executing the instruction. The depth culling unit implements the culling function to access a live depth buffer to determine whether one or more primitives corresponding to the entities are occluded. The culling unit returns indication(s) to the shader core regarding the result(s) of processing the one or more primitives. For example, if the results indicate a primitive is occluded, the shader core cancels the draw call for the primitive.

Abstract: A method and system for rendering object detection graphics on image frames is disclosed. The method includes receiving an object detection information for an image frame. The object detection information includes bounding box data and a class label data associated with an object in the image frame. The method further includes determining a first value for each pixel in a first set of pixels associated with a bounding box for the object and determining a second value for each pixel in a second set of pixels associated with a class label for the object. The method includes modifying values for each of the first set of pixels based on the associated first value to render the bounding box on the image frame and modifying values for each of the second set of pixels based on the associated second value to render the class label on the image frame.

Abstract: A method and apparatus for simulating clothes receive a user setting for an area in which shirring is to be expressed in a two-dimensional (2D) pattern of clothes modeled with a mesh including a plurality of polygons, obtain a first line and a second line parallel to the first line from the area based on the user setting, generate inner lines that are perpendicular to at least one of the first line and the second line of the area between the first line and the second line and that have regular intervals, align polygons included in the area of the 2D pattern based on the inner lines, and perform a draping simulation of three-dimensional (3D) clothes corresponding to the 2D pattern in which the shirring is expressed by the aligned polygons.

Abstract: An intelligent material completeness detection and configuration method based on digital twin and augmented reality (AR) includes: constructing a digital twin model base and knowledge base of an incomplete material; importing the digital twin model base and knowledge base of the incomplete material respectively into a model database and a knowledge database in a digital twin system database; sending materials to be detected into a vision-based material completeness detection platform, sorting out an incomplete material, acquiring corresponding data, and importing the data into an incomplete material information database; performing, based on an AR device, perception and reconstruction of incomplete material configuration; matching a configuration plan of the incomplete material in a digital twin relational database, and performing a virtual-real fusion in the AR device; and allowing, a worker to rapidly and accurately find a location and problem type of the incomplete material and configuration the incomplete

Abstract: Devices, systems, and methods are provided for use in interpreting, converting, generating, embedding, presenting, storing and otherwise using mini-banner content. For at least one embodiment, a mini-banner content system may include a secondary content system element which executes non-transient computer executable instructions to configure: a content interpreter to interpret secondary content, identify aspect information, and output the aspect information; a content converter, which when receiving aspect information at least one of retrieves a first element corresponding to the aspect information and/or generates a second element corresponding to the aspect information, and generates a mini-banner content element based upon results of the retrieving operation and/or the generating operation.

Abstract: Techniques for performing ray tracing operations are provided. The techniques include receiving a request to determine whether a ray intersects any primitive of a set of primitives, evaluating the ray against non-leaf nodes of a bounding volume hierarchy to determine whether to eliminate portions of the bounding volume hierarchy from consideration, evaluating the ray against at least one early-termination node not eliminated from consideration, and determining whether to terminate traversal of the bounding volume hierarchy early and to identify that the ray hits a primitive, based on the result of the evaluation of the ray against the at least one early-termination node.

Abstract: A visualization system creates a first time axis associated with a start time of a first process and a second time axis associated with an end time of the first process or a start time of a second process subsequent to the first process such that a perpendicular line to the first time axis extends from a time point on the first time axis and intersects the second time axis at a time point thereon, the time point on the second time axis being after the lapse of a time period since the time point on the first time axis, the time period being determined from a planned value of a processing period of the first process or a planned value of the start time of the second process. The visualization system disposes the time axes associated with respective processes and a line segment, and displays them on a display apparatus.

Abstract: Disclosed techniques relate to primitive testing associated with ray intersection processing for ray tracing. In some embodiments, shader circuitry executes a first SIMD group that includes a ray intersect instruction for a set of rays. Ray intersect circuitry traverses, in response to the ray intersect instruction, multiple nodes in a spatially organized acceleration data structure (ADS). In response to reaching a node of the ADS that indicates one or more primitives, the apparatus forms a second SIMD group that executes one or more instructions to determine whether a set of rays that have reached the node intersect the one or more primitives. The shader circuitry may execute the first SIMD group to shade one or more primitives that are indicated as intersected based on results of execution of the second SIMD group. Thus, disclosed techniques may use both dedicated ray intersect circuitry and dynamically formed SIMD groups executed by shader processors to detect ray intersection.

Abstract: Described is an intelligent real-time multiplayer content management and data analytics system for AR-based social platforms. The data management system described herein manages AR content and multiple user interactions with the AR content. Additionally, a new multiplayer multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user-generated content, other user-generated content, real-time user interactively generated content, or some combination. The flexible content structure allows for a highly customizable AR social experience to maximize the system performance and user experience.

Abstract: A system and method for content creation via interactive layers is provided. Parameters for an artifact are received. A mutable general object on which to build the artifact is maintained and includes a plurality of n-dimensional data units. Layers of data for the artifact are generated via different generators. Each layer of the artifact represents a set of characteristics based on arrangements of the data units. Each layer is generated by obtaining data about an arrangement of the data units for that layer, from one or more layers of the artifact prior to that data layer, and creating the layer to mutate the data units based on the data from one or more prior data layers and the received parameters. The artifact is formed by stacking the layers via the mutable general object. Each data layer is stored with the generator for that layer as a string of characters.

Abstract: In one embodiment, the system may receive a serialized data stream generated by serializing data chunks including data from a video stream and contextual data streams associated with the video stream. The contextual data streams may include a first computed data stream and a sensor data stream. The system may extract the video data stream and one or more contextual data streams from the serialized data stream. The system may generate a second computed data stream based on the sensor data stream in the extracted contextual data streams. The system may compare the second computed data stream to the first computed data stream extracted from the serialized data stream to select a computed data stream based on one or more pre-determined criteria. The system may render an artificial reality effect for display with the extracted video data stream based at least in part on the selected computed data stream.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine geometry information for each of a plurality of primitives associated with a viewpoint in a scene. The apparatus can also calculate at least one of surface information and disocclusion information based on the geometry information for each of the plurality of primitives, where the surface information and the disocclusion information may be associated with a volumetric grid based on a viewing area corresponding to the viewpoint. Also, the apparatus can calculate visibility information for each of the plurality of primitives based on at least one of the surface information and the disocclusion information, where the visibility information may be associated with the volumetric grid. The apparatus can also determine whether each of the plurality of primitives is visible based on the visibility information for each of the plurality of primitives.

Abstract: Techniques are provided for one or more three-dimensional models representing one or more objects. For example, an input image including one or more objects can be obtained. From the input image, a location field can be generated for each object of the one or more objects. A location field descriptor can be determined for each object of the one or more objects, and a location field descriptor for an object of the one or more objects can be compared to a plurality of location field descriptors for a plurality of three-dimensional models. A three-dimensional model can be selected from the plurality of three-dimensional models for each object of the one or more objects. A three-dimensional model can be selected for the object based on comparing a location field descriptor for the object to the plurality of location field descriptors for the plurality of three-dimensional models.

Abstract: Hierarchical acceleration structures to be used for intersection testing in a ray tracing system are generated. Nodes of the hierarchical acceleration structure represent regions in a scene, and are linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure defining the regions represented by a plurality of the nodes of the hierarchical acceleration structure. At least one node of the hierarchical acceleration structure is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from said stored data. Ray tracing systems and computer-implemented methods perform intersection testing in the ray tracing system in which, based on conditions in the ray tracing system, a determination is made as to whether testing of one or more rays for intersection with a region represented by a particular node of a sub-tree is to be skipped.

Abstract: Techniques associated with adaptive sampling are disclosed. In some embodiments, in response to receiving a specification of a scene to render, a sampling of each portion of the scene is determined based at least in part on the specification of the scene such that the scene is not uniformly sampled, and the scene is rendered according to the determined sampling of each portion of the scene.

Abstract: In one embodiment, a method includes determining a first time interval for rendering pixel values for a first portion of a display, where the first portion of the display is one of a plurality of portions of the display, accessing a representation of virtual objects in a virtual scene, and determining that the first time interval is insufficient for rendering pixel values for the first portion of the display based on the representation of virtual objects. The method further includes, for each of the portions of the display, determining a current viewpoint of a user, rendering, based on the current viewpoint of the user, pixel values for that portion of the display, and sending the rendered pixel values to be output by the display, where the rendered pixel values for the first portion of the display are rendered based on a simplified representation of virtual objects in the virtual scene.

Abstract: A method is disclosed, the method comprising the steps of receiving, from a first client application, first graphical data comprising a first node; receiving, from a second client application independent of the first client application, second graphical data comprising a second node; and generating a scenegraph, wherein the scenegraph describes a hierarchical relationship between the first node and the second node.

Abstract: Inverse rendering estimates physical scene attributes (e.g., reflectance, geometry, and lighting) from image(s) and is used for gaming, virtual reality, augmented reality, and robotics. An inverse rendering network (IRN) receives a single input image of a 3D scene and generates the physical scene attributes for the image. The IRN is trained by using the estimated physical scene attributes generated by the IRN to reproduce the input image and updating parameters of the IRN to reduce differences between the reproduced input image and the input image. A direct renderer and a residual appearance renderer (RAR) reproduce the input image. The RAR predicts a residual image representing complex appearance effects of the real (not synthetic) image based on features extracted from the image and the reflectance and geometry properties. The residual image represents near-field illumination, cast shadows, inter-reflections, and realistic shading that are not provided by the direct renderer.

Abstract: A method is disclosed, the method comprising the steps of receiving, from a first client application, first graphical data comprising a first node; receiving, from a second client application independent of the first client application, second graphical data comprising a second node; and generating a scenegraph, wherein the scenegraph describes a hierarchical relationship between the first node and the second node according to visual occlusion relative to a perspective from a display.