Abstract: A three-dimensional (3D) streaming system provides client-controlled adaptive streaming of 3D content in which the client may receive the 3D primitives of 3D content at different fidelities that the client selects. The system includes generating a 3D model at different fidelities, partitioning the 3D model into different volumetric spatial units, generating a manifest with an index for each volumetric spatial unit and an identifier for each fidelity, and presenting the 3D primitives in a first set of volumetric spatial units at a first fidelity and the 3D primitives in a second set of volumetric spatial units at a second fidelity in response to a request that includes indices of the first set of volumetric spatial units with a first identifier for the first fidelity and indices of the second set of volumetric spatial units with a second identifier for the second fidelity.

Abstract: A system and associated methods select splats at different fidelities to optimize a requested field-of-view of a three-dimensional (3D) model for presentation on a local device or for streaming to a remote device. The system determines priority values that are associated with parts of the 3D model within the field-of-view, selects first splats that represent a first part of the 3D model at a first fidelity in response to a first priority value being associated with the first part, selects second splats that represent a second part of the 3D model at a second fidelity in response to a second priority value being associated with the second part, and presents or streams the first splats and the second splats in response to the request in order to generate the field-of-view with different fidelities for the first part and the second part of the 3D model.

Abstract: A splat generation system and associated methods implement splatting with adaptive density control to generate a splat representation of a three-dimensional (3D) model in which the splat density and quality in regions of the 3D model that are prioritized based on creator intent or that are commonly or consistently in a user's field-of-view are increased relative to the splat density and quality in other regions of the 3D model. The system receives the different priorities associated with different parts of the 3D model based on the creator intent or tracked view paths. The system generates a first set of splats that represent the 3D model with a first fidelity, and generates a second set of splats at a greater second fidelity for a first subset of parts of the 3D model that have a higher priority than a second subset of parts of the 3D model.

Abstract: A splat compression system and associated methods are provided to efficiently compress and decompress data of a three-dimensional (3D) splat representation using textures so that the size of the splat representation is reduced with minimal loss in fidelity. The compression includes receiving the splats that make up the 3D splat representation, determining clusters that are associated with a different set of the splats that are positioned about a different common plane, and defining each cluster with a position based on the positional data from the different set of splats associated with that cluster. The compression includes converting the positional data from the different set of splats associated with each cluster to offsets from the position of the associated cluster, and generating the compressed 3D representation with a definition for each cluster and a texture that stores the offsets for the different set of splats associated with each cluster.

Abstract: A three-dimensional (3D) interactivity system automatically and dynamically generates shape-conforming and computationally efficient colliders for detecting collisions with automatically differentiated features represented by different sets of points in a point cloud. The system selects a set of points that represent a particular feature of a 3D object, decimates the set of points to a subset of points that represent an approximate shape of the particular feature with fewer points than the set of points, and generates a collider with the approximate shape represented by the subset of points. The system may then use the collider in determining whether a collision element collides with the particular feature.

Abstract: A modeling system converts polygons of a three-dimensional (3D) mesh model to points of a point cloud in an automated manner that increases the resolution and visual fidelity of the point cloud relative to the 3D mesh model. The system receives the polygons of the 3D mesh model, and generates points over the flat plane of each polygon according to a density and arrangement that increases the resolution of the points relative to the original polygon. The system receives an enhancement map with values for displacing the polygons of the 3D mesh model. The system displaces the generated points by mapping the values from positions in the enhancement map to corresponding positions of the generated points. The system generates the point cloud with the displaced points to provide improved visual quality and detail relative to the polygons of the 3D mesh model after enhancement with the enhancement map.

Abstract: Disclosed is an interface and/or system for presenting three-dimensional (“3D”) graphical user interface (“GUI”) elements to improve user interactions with a device. The system determines a first angle from which to render a 3D GUI. The system receives 3D images that are linked to the 3D GUI elements. The system generates the 3D GUI elements by rendering each of the 3D images from a first render position that aligns with the first angle. The system detects an input that changes the first angle to a second angle, and updates a visualization of the 3D GUI elements by rendering each of the 3D images from a second render position that aligns with the second angle.

Abstract: An optimization system reduces the data encoded within a point cloud for streaming and/or rendering of a lossy representation of the point cloud. The optimization system generates a first optimized splat for a first visual characteristic of the point cloud by replacing a first set of points having a first common value for the first visual characteristic with a first replacement primitive, and generates a second optimized splat for a second visual characteristic of the point cloud by replacing a second set of points having a second common value for the second visual characteristic with a second replacement primitive. The optimization system provides the first optimized splat and the second optimized splat instead of the original points of the point cloud in response to a request to access the point cloud.

Abstract: A system and associated methods select splats at different fidelities to optimize a requested field-of-view of a three-dimensional (3D) model for presentation on a local device or for streaming to a remote device. The system determines priority values that are associated with parts of the 3D model within the field-of-view, selects first splats that represent a first part of the 3D model at a first fidelity in response to a first priority value being associated with the first part, selects second splats that represent a second part of the 3D model at a second fidelity in response to a second priority value being associated with the second part, and presents or streams the first splats and the second splats in response to the request in order to generate the field-of-view with different fidelities for the first part and the second part of the 3D model.

Abstract: Disclosed is a graphics system and associated methods for generating and animating three-dimensional (“3D”) assets with a dynamic resolution. The graphics system receives a 3D asset at a first resolution, defines procedural surfaces that recreate the overall shape of the 3D asset, and generates the 3D asset at any desired resolution from the defined procedural surfaces. Specifically, the graphics system partitions the overall shape of the 3D object into simpler shapes, defines equations that recreate the simpler shapes, and generates new points amongst the existing points at positions along surfaces that are created by each of the equations. The graphics system generates the 3D asset at a second resolution that is greater than the first resolution by rendering the new points with the existing points.

Abstract: A system and associated methods select splats at different fidelities to optimize a requested field-of-view of a three-dimensional (3D) model for presentation on a local device or for streaming to a remote device. The system determines priority values that are associated with parts of the 3D model within the field-of-view, selects first splats that represent a first part of the 3D model at a first fidelity in response to a first priority value being associated with the first part, selects second splats that represent a second part of the 3D model at a second fidelity in response to a second priority value being associated with the second part, and presents or streams the first splats and the second splats in response to the request in order to generate the field-of-view with different fidelities for the first part and the second part of the 3D model.

Abstract: A three-dimensional (3D) streaming system provides client-controlled adaptive streaming of 3D content in which the client may receive the 3D primitives of 3D content at different fidelities that the client selects. The system includes generating a 3D model at different fidelities, partitioning the 3D model into different volumetric spatial units, generating a manifest with an index for each volumetric spatial unit and an identifier for each fidelity, and presenting the 3D primitives in a first set of volumetric spatial units at a first fidelity and the 3D primitives in a second set of volumetric spatial units at a second fidelity in response to a request that includes indices of the first set of volumetric spatial units with a first identifier for the first fidelity and indices of the second set of volumetric spatial units with a second identifier for the second fidelity.

Abstract: An optimization system reduces the data encoded within a point cloud for streaming and/or rendering of a lossy representation of the point cloud. The optimization system generates a first optimized splat for a first visual characteristic of the point cloud by replacing a first set of points having a first common value for the first visual characteristic with a first replacement primitive, and generates a second optimized splat for a second visual characteristic of the point cloud by replacing a second set of points having a second common value for the second visual characteristic with a second replacement primitive. The optimization system provides the first optimized splat and the second optimized splat instead of the original points of the point cloud in response to a request to access the point cloud.

Abstract: Disclosed is a system and associated methods for improving interactions with three-dimensional (“3D”) objects in a 3D space by dynamically defining the positioning of the handles used to control the interactions with the camera and/or the 3D objects. The system analyzes the positioning of different constructs that form the 3D objects. From the analysis, the system defines handles at different dynamically determined positions about the 3D objects. The system applies an edit from a first dynamically determined position about a particular 3D object in response to a user interaction with a first handle defined at the first dynamically determined position, and applies the edit from a second dynamically determined position about the particular 3D object in response to a user interaction with a second handle defined at the second dynamically determined position.

Abstract: Disclosed is a graphics system and associated methodologies for selectively increasing the level-of-detail at specific parts of a mesh model based on a point cloud that provides a higher detailed representation of the same or similar three-dimensional (“3D”) object. The graphics system receives the mesh model and the point cloud of the 3D object. The graphics system determines a region-of-interest of the 3D object based in part on differences amongst points that represent part or all of the region-of-interest. The graphics system reconstructs the region-of-interest in the mesh model and generates a modified mesh model by modifying a first set of meshes representing the region-of-interest in the mesh model to a second set of meshes based on the positional elements of the point cloud points. The second set of meshes has more meshes and represents the region-of-interest at a higher level-of-detail than the first set of meshes.

Abstract: Disclosed is a system and associated methods for the generative drawing and customization of three-dimensional (“3D”) objects in 3D space using hand gestures. The system adapts the hand gestures as intuitive controls for rapidly creating and customizing the 3D objects to have a desired artistic effect or a desired look. The system selects a 3D model of a particular object in response to a first user input, sets a position in a virtual space at which to generate the particular object in response to a mapped position of a first hand gesture tracked in a physical space, and generates a first state representation of the particular object at the position in the virtual space in response to a second hand gesture. The first state representation presents the particular object at one of different modeled stages of the particular object lifecycle.

Abstract: Disclosed is an encoding system and associated methods for generating a graph-integrated tree-based representation of data that provides for direct lateral traversals of nodes in a each layer of the tree-based representation. The encoding system organizes data from a dataset to a tree-based representation with multiple layers and multiple nodes in each layer. The encoding system detects the nodes in each layer, and defines a graph structure that links the nodes in each layer for direct lateral access. The encoding system searches the tree-based representation in response to a query for a particular subset of the data by performing a single downward traversal to a particular layer with individual nodes that satisfy part of the query, and by laterally traversing the nodes in the particular layer using the graph structure to directly access a second node in the particular layer from a first node in the particular layer.

Abstract: A three-dimensional (3D) streaming system and associated methods optimize 3D content streaming to remote devices by receiving 3D data that is distributed across a 3D space. The system partitions the 3D space into different regions, and compresses a different subset of the 3D data that is within each partitioned region as a separate compressed file. The system receives a request for a particular field-of-view in the 3D space and streams a set of compressed files that contain the different subset of 3D data for a set of the partitioned regions within the particular field-of-view. In response to a request for an updated field-of-view with a region that is not within the particular field-of-view, the system selects the compressed file that contains the 3D data within that region and streams the selected compressed file in response to the request for the updated field-of-view.

Abstract: Spatial audio integrated point clouds expand the definition of point cloud points to include acoustic characteristics in addition to positional coordinates for the positioning of the points in a three-dimensional (3D) space and visual characteristics for how the individual points are presented at their respective positions in the 3D space. A system may generate a 3D scene based on the positioning of the points, and may track a path for sound that is emitted from a sound source. The system determines that the path reaches a position of one or more of the points, and performs a first adjustment to the sound according to the defined acoustic characteristics of the one or more points.

Abstract: Disclosed is a system and associated methods for compressing motion within an animated point cloud. The resulting compressed file encodes different transforms that recreate the motion of different sets of points across different point clouds or frames of the animation in place of the data for the different sets of points from the different point clouds. The compression involves detecting a motion that changes positioning of a set of points between a first point cloud and subsequent point clouds of an uncompressed encoding of two or more frames of an animation. The compression further involves defining a transform that models the motion, and generating a compressed animated point cloud by encoding the data of the first point cloud in the compressed animated point cloud, and by replacing the data for the set of points in the one or more subsequent point clouds with the transform.