Abstract: A Virtual reality system which comprises a head mounted display and positional tracking to determine the position and orientation of the head mounted display. A player wearing the head mounted display would view a virtual world. External physical objects such as a cup can be identified and displayed inside the virtual world displayed inside the head mounted display so that a player can drink out of the cup without having to remove the head mounted display.

Abstract: In some examples, an apparatus for mesh processing includes processing circuitry. The processing circuitry receives a first mesh frame with polygons representing a surface of an object, and determining that the first mesh frame is a non manifold type mesh in response to one or more singularity components in the first mesh frame. The processing circuitry converts the first mesh frame to a second mesh frame that is a manifold type mesh. The first mesh frame has first boundary loops that respectively correspond to second boundary loops in the second mesh frame. The processing circuitry detects the second boundary loops in the second mesh frame, and determines the first boundary loops in the first mesh frame according to the second boundary loops in the second mesh frame.

Abstract: An appearance-responsive material map generation system generates a set of material maps based on the appearance of a material depicted in the source material data. A neural network included in the appearance-responsive material map generation system is trained to identify features of particular source material data, such as features that contribute to a highly realistic appearance of a graphical object rendered with the material depicted in the source material data. In some cases, the trained neural network receives source material data that includes at least one source material map. Based on the features that are identified for the particular source material data, the appearance-responsive material map generation system creates a respective set of appearance-responsive material maps for the particular source material data. In some cases, the appearance-responsive rendering map set is arranged as an inconsistent pyramid of material maps.

Abstract: Generating polygon meshes that approximate surfaces using iteration for mesh vertex positions. In some implementations, a method includes receiving input data that represents a surface distinguishing a volume, where a voxel grid includes the surface. Particular voxels of the voxel grid are identified, which the surface intersects. A surface-approximating mesh is generated including polygons defined by vertices in the particular voxels. Generating the mesh includes determining approximate positions of a subset of the vertices in a subset of the particular voxels, based on interpolation of locations in the voxel subset where the surface intersects the voxel subset. Errors between approximate voxel values (based on the approximate positions) and assigned voxel values of the particular voxels (based on the input data) are determined, and the approximate position of at least one vertex of the subset of the vertices is adjusted using a successive over-relaxation technique to reduce the errors.

Abstract: A processing system includes hull shader circuitry that launches thread groups including one or more primitives. The hull shader circuitry also generates tessellation factors that indicate subdivisions of the primitives. The processing system also includes throttling circuitry that estimates a primitive launch time interval for the domain shader based on the tessellation factors and selectively throttles launching of the thread groups from the hull shader circuitry based on the primitive launch time interval of the domain shader and a hull shader latency. In some cases, the throttling circuitry includes a first counter that is incremented in response to launching a thread group from the buffer and a second counter that modifies the first counter based on a measured latency of the domain shader.

Abstract: A method and three-dimensional (3D) modeling engine for managing modeling data during 3D modeling includes generating, by an editable mesh module, a data search list. The method and engine further includes searching, by the editable mesh module, for connection information of vertices, edges, and faces of a 3D model on the basis of the data search list.

Abstract: A system comprises a prediction module configured to predict an attribute value, such as a texture coordinate, for a vertex of a triangle in a two-dimensional (2D) attribute representation based on known positions of vertices of a corresponding triangle in a three-dimensional (3D) geometric representation. In some embodiments, the prediction module adaptively selects a prediction technique between multiple available prediction techniques based on availability of vertices information in the 3D geometric representation and in the 2D attribute representation and further based on compression efficiency and distortion minimization. The prediction module enables compression of attribute information being signaled for volumetric visual content, such as a mesh with texture.

Abstract: A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, various techniques are performed for manipulating virtual objects in an XR environment. In a first technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location. In a second technique, the XR software application program facilitates the rotation of a virtual object. In a third technique, the XR software application program facilitates the scaling of a virtual object along one or more axes.

Abstract: A method includes generating one or more nominal images of at least a portion of a digital twin of an environment, defining one or more anomalous characteristics of the one or more components, generating one or more anomalous images of the portion of the digital twin of the environment based on the field of view and the one or more anomalous characteristics, performing a tessellation routine and a texture mapping routine on the one or more nominal images and the one or more anomalous images to generate a plurality of synthetic images, and labeling, for each synthetic image from among the plurality of synthetic images, the synthetic image as one of an anomalous type, a nominal type, or a combination thereof.

Abstract: A method and system to create a versatile graft surface and at least one corresponding graft groom having the versatile graft surface as a base, to fit and transform the versatile graft surface onto a target surface and process the created graft groom into a modifiable hair model after the versatile graft surface is transformed onto the target surface.

Abstract: Certain aspects and features of this disclosure relate to neural network based 3D object surface mapping. In one example, a first representation of a first surface of a first 3D object and a second representation of a second surface of a second 3D object are produced. A surface mapping function is generated for mapping the first surface to the second surface. The surface mapping function is defined the representations and by a neural network model configured to map a first 2D representation of the first surface to a second 2D representation of the second surface. One or more features of the a first 3D mesh on the first surface can be applied to a second 3D mesh on the second surface using the surface mapping function to produce a modified second surface, which can be rendered through a user interface.

Abstract: A tetrahedral interpolation calculation method and apparatus, a gamut conversion method and apparatus, and a medium are provided, the tetrahedral interpolation calculation method comprising: obtaining coordinates of an interpolation point in a sampling space, a side length of a cube formed of nearby eight sampling points surrounding the interpolation point in the sampling space, and mapping values of four vertices of a tetrahedron surrounding the interpolation point, wherein the four vertices are four out of the eight sampling points; calculating a volume of the tetrahedron, and volumes of four sub-tetrahedrons formed of the interpolation point and arbitrary three vertices in the tetrahedron, based on coordinates of the interpolation point in the sampling space, and the side length of the cube formed of nearby eight sampling points surrounding the interpolation point in the sampling space; and obtaining an interpolation value of the interpolation point, based on a tetrahedral interpolation theorem formula, th

Abstract: A method for merging surface skin three-dimensional (3D) data includes the following steps: 1. constructing actually-measured 3D data of a workpiece and 3D data of a design model of the workpiece; 2. calculating a normal vector, a neighborhood radius, and a position of a sphere center of each point in the design model 3D data; 3. finding closest points to the design model 3D data for all points in the actually-measured 3D data; 4. calculating a static closest distance and a dynamic closest distance from each point in the actually-measured 3D data to the closest point in the design model 3D data; 5. constructing an objective function of a surface adaptive distance; 6. minimizing the objective function and calculating a differential motion screw; and 7. updating the actually-measured 3D data and achieving data merging.

Abstract: A method of compression of 3D mesh data using projections of mesh surface data and video representation of connectivity data is described herein. The method utilizes 3D surface patches to represent a set of connected triangles on a mesh surface. The projected surface data is stored in patches (a mesh patch) that is encoded in atlas data. The connectivity of the mesh, that is, the vertices and the triangles of the surface patch, are encoded using video-based compression techniques. The data is encapsulated in a new video component named vertex video data, and the disclosed structure allows for progressive mesh coding by separating sets of vertices in layers, and creating levels of detail for the mesh connectivity. This approach extends the functionality of the V3C (volumetric video-based) standard, currently being used for coding of point cloud and multiview plus depth content.

Abstract: An illustrative 3D modeling system generates a first voxelized representation of an object with respect to a voxel space and a second voxelized representation of the object with respect to the voxel space. Based on a first normal of a first voxel included in the first voxelized representation and a second normal of a second voxel included in the second voxelized representation, the 3D modeling system identifies a mergeable intersection between the first and second voxels. Based on the first and second voxelized representations, the 3D modeling system generates a merged voxelized representation of the object with respect to the voxel space. The merged voxelized representation includes a single merged voxel generated, based on the identified mergeable intersection, to represent both the first and second voxels. Corresponding methods and systems are also disclosed.

Abstract: A method, apparatus, and computer program product provide for compression of volumetric video in a manner that is more efficient and requires less metadata updates. A method can include converting a volumetric video scene into a canonical representation comprising a plurality of frames comprising a video atlas and corresponding metadata. Each frame can be divided into a plurality of tiles based on different tile characteristics, which can be used to analyze and characterize the different tiles for atlas packing purposes. Tiles can be clipped or merged or otherwise edited in the atlas. Tiles can be decomposed to metadata suitable for later rendering of the tile. Tiles having a similar enough color attribute or depth attribute during the entire group of photos can be rendered as a single instance, clipped entirely, and rendered based upon a reference tile and the stored metadata.

Abstract: The model generation system may generate a 3D object model based on computer aided design (CAD) data describing an object. The CAD data received by the CAD conversion module 160 may contain a set of surfaces for the object. Each surface may be described by a surface equation that describes the shape of the surface in a 3D space. The model generation system may extract those surface equations from the CAD data and generate field lines and equipotential lines. The field lines may be lines that are tangent to the gradient vector field of the surface, and the equipotential lines may be lines along the surface that designate points that have the same potential within the gradient field vector. The model generation system may use the field lines and the equipotential lines to generate quadrangular tessellations for a 3D object model for the object described by the CAD data.

Abstract: A three-dimensional shape of a subject is analyzed by inputting captured images of a depth camera and a visible light camera. There is provided an image processing unit configured to input captured images of the depth camera and the visible light camera, to analyze a three-dimensional shape of the subject. The image processing unit generates a depth map based TSDF space (TSDF Volume) by using a depth map acquired from a captured image of the depth camera, and generates a visible light image based TSDF space by using a captured image of the visible light camera. Moreover, an integrated TSDF space is generated by integration processing on the depth map based TSDF space and the visible light image based TSDF space, and three-dimensional shape analysis processing on the subject is executed using the integrated TSDF space.

Abstract: The photo-video based spatial-temporal volumetric capture system more efficiently, produces high frame rate and high resolution 4D dynamic human videos, without a need for 2 separate 3D and 4D scanner systems, by combining a set of high frame rate machine vision video cameras with a set of high resolution photography cameras. It reduces a need for manual CG works, by temporally up-sampling shape and texture resolution of 4D scanned video data from a temporally sparse set of higher resolution 3D scanned keyframes that are reconstructed both by using machine vision cameras and photography cameras. Unlike typical performance capture system that uses single static template model at initialization (e.g. A or pose), the photo-video based spatial-temporal volumetric capture system stores multiple keyframes of high resolution 3D template models for robust and dynamic shape and texture refinement of 4D scanned video sequence.

Abstract: An image generator generates images of a set of virtual fibers and effects thereon by processing representations of the set of fibers and computing representation of a virtual surface for a fiber clump in the set of virtual fibers from an artist parameter representing a desired artist effect, computing correlations of the vertices from a set of vertices based on associations of the vertices corresponding to the artist parameter, computing a set of relevant vertices using the correlations of the vertices, computing orthogonal gradients to produce a plurality of gradients using a selected vertex and the set of relevant vertices for the fiber clump, and computing the virtual surface of the fiber clump from the plurality of gradients.