Abstract: Device, system, and method of generating a reduced-size volumetric dataset. A method includes receiving a plurality of three-dimensional volumetric datasets that correspond to a particular object; and generating, from that plurality of three-dimensional volumetric datasets, a single uniform mesh dataset that corresponds to that particular object. The size of that single uniform mesh dataset is less than ¼ of the aggregate size of the plurality of three-dimensional volumetric datasets. The resulting uniform mesh is temporally coherent, and can be used for animating that object, as well as for introducing modifications to that object or to clothing or garments worn by that object.

Abstract: Systems and methods are described for generating a plurality of three-dimensional (3D) proxy geometries of an object, generating, based on the plurality of 3D proxy geometries, a plurality of neural textures of the object, the neural textures defining a plurality of different shapes and appearances representing the object, providing the plurality of neural textures to a neural renderer, receiving, from the neural renderer and based on the plurality of neural textures, a color image and an alpha mask representing an opacity of at least a portion of the object, and generating a composite image based on the pose, the color image, and the alpha mask.

Abstract: The present disclosure relates to an image processing apparatus and method that can prevent an increase in the load of a decoding process for encoded data in a point cloud video-based approach. The parameters related to a plurality of point cloud models of a point cloud are transformed, a two-dimensional plane image onto which the plurality of point cloud models having the transformed parameters is projected is encoded, and a bitstream containing encoded data of the two-dimensional image and transform information that is information regarding the transform of the parameters is generated. The present disclosure can be applied to an information processing device, an image processing apparatus, an electronic apparatus, an information processing method, a program, or the like, for example.

Abstract: A system and method for coherency gathering for rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes including upper level nodes and lower level nodes. For each instance where one of the lower level nodes is a child of one of the upper level nodes, an instance transform is defined, specifying the relationship between a first coordinate system of the upper level node and the second coordinate system for that instance of the lower level node. The system provides an instance transform cache for storing a plurality of these instance transforms while conducting intersection testing.

Abstract: A device for decoding encoded point cloud data can be configured to: for a point of a point cloud, determine a first attribute value for a first color component based on a first predicted value and a first residual value; apply a scaling factor to the first residual value to determine a predicted second residual value, wherein the scaling factor has one or both of a non-integer value or an absolute value greater than one; for the point of the point cloud, receive a second residual value in the encoded point cloud data; determine a final second residual value based on the predicted second residual value and the received second residual value; and for the point of the point cloud, determine a second attribute value for a second color component based on a second predicted value and the final second residual value.

Abstract: A method for the computer-aided editing of a digital 3D model (1) of a dental object using digital tools (T1, T2, T3) provides for the identification of different dental-specific regions (R1, R2, R3) of the 3D model (1) that are affected by the tool (T1, T2, T3) in different ways, for computation of the effect on the whole 3D model and for display thereof as a proposal model (2) together with the 3D model (1). The proposal model (2) is then rejected or accepted in part or in full. If it is accepted in part, at least one subregion of the 3D model (1) is selected as a region (10) and a result model (6) is formed from the 3D model (1) and the proposal model (2) by virtue of the 3D model (1) being taken as the starting point for replacing the selected region (10) or at least a central portion of the selected region (10) with a corresponding region of the proposal model (2) or approaching the latter using a strength factor (S).

Abstract: A device for decoding encoded point cloud data can be configured to, for a point of a point cloud, determine a first color value for a first color component based on a first predicted value and a first residual value; apply a scaling factor to the first residual value to determine a predicted second residual value, wherein the scaling factor has one or both of a non-integer value or an absolute value greater than one; for the point of the point cloud, receive a second residual value in the encoded point cloud data; determine a final second residual value based on the predicted second residual value and the received second residual value; and for the point of the point cloud, determine a second color value for a second color component based on a second predicted value and the final second residual value.

Abstract: The present technique relates to an information processing apparatus, an information processing method, a program, and a moving body that can appropriately display content on top of a scene viewed by a user. An aspect of the present technique provides an information processing apparatus that sets a frame as a superimposition location of content in a region corresponding to a surface of an object on the basis of a movement state of a user and generates visual information for displaying the content in the region corresponding to the set frame. The present technique can be applied to an apparatus that performs AR display of content.

Abstract: An image processing apparatus comprises a receiver (201) for receiving an image signal which comprises at least an encoded image and a target display reference. The target display reference is indicative of a dynamic range of a target display for which the encoded image is encoded. A dynamic range processor (203) generates an output image by applying a dynamic range transform to the encoded image in response to the target display reference. An output (205) then outputs an output image signal comprising the output image, e.g. to a suitable display. The dynamic range transform may furthermore be performed in response to a display dynamic range indication received from a display. The invention may be used to generate an improved High Dynamic Range (HDR) image from e.g. a Low Dynamic Range (LDR) image, or vice versa.

Abstract: In one embodiment, a computing system may access surfaces and texel data of an artificial reality scene. The surfaces may be generated based on a first viewing position of a viewer. The system may determine tiles on a display to test for a visibility of the surfaces from a second viewing position. The tiles may include first tiles that need more computational resources and second tiles that need less computational resources. The system may determine a tile order which interleaves the first and second tiles. The system may generate rays based on the tile order. The system may determine the visibility of the surfaces from the second viewing position based on the ray-surface intersections. The system may generate color values of a subframe based on the surface visibility and the texel data. The system may provide the color values to the display.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The present disclosure can calculate a center-edge distance of a first pixel, the center-edge distance of the first pixel equal to a distance from a first pixel center to one or more edges of a first primitive. Additionally, the present disclosure can store the center-edge distance of the first pixel when the first primitive is visible in a scene. The present disclosure can also determine an amount of overlap between the first pixel and the first primitive. Further, the present disclosure can blend a color of the first pixel with a color of a second pixel based on at least one of the center-edge distance of the first pixel or the amount of overlap between the first pixel and the first primitive.

Abstract: Embodiments of the systems and methods described herein provide a three dimensional reconstruction system that can receive an image from a camera, and then utilize machine learning algorithms to identify objects in the image. The three dimensional reconstruction system can identify a geolocation of a user, identify features of the surrounding area, such as structures or geographic features, and reconstruct the scene including the identified features. The three dimensional reconstruction system can generate three dimensional object data for the features and/or objects, modify the three dimensional objects, arrange the objects in a scene, and render a two dimensional view of the scene.

Abstract: An information-processing device selects a worn-item object to be worn by a character object within a virtual space, controls the character object within the virtual space, deforms at least one part of the character object by a degree according to a first parameter that is associated with the selected worn-item object, the at least one part being associated with the first parameter, and generates, by use of a virtual camera, an image of the virtual space that includes the character object wearing the selected worn-item object.

Abstract: Disclosed are systems and methods for improving interactions with and between computers in content providing, searching and/or hosting systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel framework for performing automatic detection of surfaces in video frames resulting in the creation of a seamless in-video ad experience for viewing users. The disclosed framework operates by leveraging available surfaces in videos to show advertisements in compliance with publisher protection, compliance and policy in a fully automatic, end-to-end solution. The disclosed framework evidences a streamlined, automatic and computationally efficient process(es) that modifies digital content at the surface level within the frames of the content in compliance with the digital rights of the owners of the content being merged via the disclosed augmentation.

Abstract: A rendering system adapts textures used by a Graphics Processing Unit (“GPU”) for the purpose of transferring data points of a point cloud to the GPU for processing and rendering. The rendering system determines the GPU constraints, and obtains a tree-based representation for the point cloud data points. The rendering system selects nodes from the tree-based representation that represent at least a first set of data points within the field-of-view with a first level of detail, that represent a second set of data points within the field-of-view with a different second level of detail, and that collectively satisfy the GPU constraints. The rendering system partitions a texture into chunks, encodes each chunk with data from different selected nodes, and presents an image based on rendered partial images generated by the GPU for the texture chunks.

Abstract: A method and apparatus are provided for tessellating patches of surfaces in a tile based three dimensional computer graphics rendering system. For each tile in an image a per tile list of primitive indices is derived for tessellated primitives which make up a patch. Hidden surface removal is then performed on the patch and any domain points which remain after hidden surface removal are derived. The primitives are then shaded for display.

Abstract: Systems, methods, and non-transitory computer-readable media can receive a first set of static lighting information associated with a first static lighting setup and a second set of static lighting information associated with a second static lighting setup. The first set of static lighting information and the second set of static lighting information are associated with a scene to be rendered. A first set of global illumination information is precomputed based on the first set of static lighting information. A second set of global illumination information is precomputed based on the second set of static lighting information. The first and second sets of global illumination information are blended to derive a blended set of global illumination information. The scene is rendered in a real-time application based on the blended set of global illumination information.

Abstract: Described herein are systems and methods of processing immobilization molds for application of treatment, A computing system may generate a three-dimensional mold model of immobilization mold within with a subject is to be positioned for application of a treatment. The computing system may subtract a three-dimensional scan of at least a portion of the subject from the three-dimensional mold model to define an opening therein. The computing system may remove, from the three-dimensional mold model, a first portion to define an imprint in the opening from a first axis along which the subject is to enter. The computing system may remove, from a second portion of the three-dimensional mold model remaining with the removal of the first portion, inward protrusions into the imprint of relative to the second axis intersecting the first axis.

Abstract: Techniques for performing automatic interactive animation by automatically matching objects between multiple artboards, allowing an animator to link multiple artboards in a temporal sequence using time as a trigger and allowing an animator to preview an animation using intuitive drag controls via an input device such as a mouse or touch screen. An automatic animation process is performed by matching objects/nodes between artboards by determining a ranking of similarity between objects based upon a distance metric computed for a set of one or more attributes associated with each object in the artboards. If sufficient match is found, the matched objects can be treated as a single entity to be animated. In another embodiment, dominant direction of movement with respect to the matched objects is determined, and receipt of a drag event (mouse input or touch screen gesture input) in said dominant direction causes a preview of animation of that entity.

Abstract: A system and method for coherency gathering for rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes including upper level nodes and lower level nodes. For each instance where one of the lower level nodes is a child of one of the upper level nodes, an instance transform is defined, specifying the relationship between a first coordinate system of the upper level node and the second coordinate system for that instance of the lower level node. The system provides an instance transform cache for storing a plurality of these instance transforms while conducting intersection testing.