Abstract: Provided is a method for reconstructing a face mesh model. The method includes: acquiring face scanning data to be reconstructed and a three-dimensional face mesh template; obtaining a target face mesh model by hierarchically extracting key feature points in the 3D face mesh template and by sequentially deforming the 3D face mesh template based on posture matching positions of the hierarchically extracted key feature points in the face scanning data; and obtaining a reconstructed face mesh model by acquiring global feature points in the target face mesh model and by deforming the target face mesh model based on the posture matching positions of the global feature points in the face scanning data.

Abstract: A color modulation method for a display includes: obtaining a group of original RGB data of a pixel of an image; calling a display look-up-table (LUT) to determine whether a group of RGB mapped data corresponding to the group of original RGB data is present in the display LUT; if in, performing color modulation using the group of RGB mapped data corresponding to the group of original RGB data; and if not in, using the group of original RGB data, a plurality of groups of selected RGB data, and a group of RGB mapped data corresponding to each group of selected RGB data in combination with a predetermined interpolation algorithm to calculate the group of RGB mapped data corresponding to the group of original RGB data, and then using the obtained group of RGB mapped data to perform the color modulation.

Abstract: Methods, systems, and computer readable media for utilizing visuomotor error augmentation for balance rehabilitation are provided. An exemplary method includes displaying a dynamic virtual environment defined by an optical flow, obtaining position data of an anatomical portion of a subject that is virtually traversing the dynamic virtual environment, and using the position data to determine a mediolateral displacement measurement of the subject. The method further includes utilizing the mediolateral displacement measurement to define feedback control loop data, establishing an augmented visual error that dynamically adjusts the dynamic virtual environment, wherein the augmented visual error is based on the feedback control loop data and a predefined visual gain factor, and adjusting the optical flow of the dynamic virtual environment by using the augmented visual error.

Abstract: A processing device is provided which includes memory and a processor. The processor is configured to receive an input image having a first resolution, generate at least one linear down-sampled version of the input image via a linear upscaling network, generate at least one non-linear down-sampled version of the input image via a non-linear upscaling network, extract a first feature map from the at least one linear down-sampled version of the input image, and extract a second feature map from the at least one non-linear down-sampled version of the input image. The processor is also configured to convert the at least one linear down-sampled version of the input image and the at least one non-linear down-sampled version of the input image into pixels of an output image having a second resolution higher than the first resolution using the first feature map and the second feature map.

Abstract: Improved texturing processes utilizing smart materials are provided to increase developer productivity when texturing objects within multi-dimensional environments, and particularly, 3D environments. A developer may generate an object, select a smart material to apply, and manipulate the dimensions of the object to cause an aspect ratio of at least one surface having a material applied to change without altering an aspect ratio of a texture tile of the material as rendered on the surface of the object. Texturing of object surfaces from a selected smart material is determined in a shared material space based on a mapping of object vertices that maintain original material qualities (e.g., a defined aspect ratio of the texture) and mitigate discontinuities in a material applied to adjacent surfaces, including those of different objects and when those objects are repositioned.

Abstract: An example system for lightweight view dependent rendering is described herein. An example mobile device includes a display, instructions, and processor circuitry to execute instructions to extract a moving region within a first set of frames of volumetric video content captured by a plurality of real-world cameras facing a scene at different angles. The processor circuitry to generate a first billboard based on a cropped area of the frames in the first set of frames, the cropped area corresponding to the first moving region. The processor circuitry to, in response to user selection of a first view of the scene, cause presentation of the first billboard on the display. The processor circuitry to, in response to a change from the first view to a second view of the scene, cause a second billboard to replace the first billboard on the display.

Abstract: Disclosed is a graphics system and associated methods for dynamic backfilling a point cloud to conceal gaps that appear when zooming into the point cloud. The dynamically backfilling fills a gap with dynamically generated points that continue a texture, contour, pattern, shape, coloring, and/or other commonality of an original set of points from the point cloud that form a single continuous surface with that gap. The system defines a model based on images of an object or scene. The model represents the object or scene at different zoom depths with different dynamically generated points. The system determines that a requested render position exposes a gap in the original set of points. The system fills the gap by using the model to generate points at positions over the gap that continue a shape, form, or structure of a single continuous surface formed by the original set of points.

Abstract: An apparatus and method are described for utilizing volume proxies. For example, one embodiment of an apparatus comprises: a volume subdivision module to subdivide a volume into a plurality of partitions, the apparatus to process a first of the partitions and to distribute data associated with each of the other partitions to each of a plurality of nodes; a proxy generation module to compute a first proxy for the first partition, the first proxy to be transmitted to the plurality of nodes; and a ray tracing engine to perform one or more traversal/intersection operations for a current ray or group of rays using the first proxy; if the ray or group of rays interacts with the first proxy, then the ray tracing engine to send the ray(s) to a second node associated with the first proxy or retrieves data related to the interaction from the second node.

Abstract: There is provided an image processing apparatus and an image processing method that are capable of suppressing an increase in loads when a point cloud is generated from a mesh. Point cloud data is generated by positioning points at intersection points between a surface of a mesh and vectors each including, as a start origin, position coordinates corresponding to a specified resolution. For example, intersection determination is performed between the surface of the mesh and each of the vectors, and in a case where the surface and the vector are determined to intersect each other, the coordinates of the intersection point are calculated. The present disclosure can be applied to an image processing apparatus, electronic equipment, an image processing method, a program, or the like.

Abstract: Systems, methods, and non-transitory computer-readable media can obtain data associated with a computer-based experience. The computer-based experience can be based on interactive real-time technology. At least one virtual camera can be configured within the computer-based experience in a real-time engine. Data associated with an edit cut of the computer-based experience can be obtained based on content captured by the at least one virtual camera. A plurality of shots that correspond to two-dimensional content can be generated from the edit cut of the computer-based experience in the real-time engine. Data associated with a two-dimensional version of the computer-based experience can be generated with the real-time engine based on the plurality of shots. The two-dimensional version can be rendered based on the generated data.

Abstract: A method of rendering an image of a 3-D scene includes rendering a noisy image; and obtaining one or more guide channels. For each of a plurality of local neighbourhoods, the method comprises: calculating the parameters of a model that approximates the noisy image as a function of the one or more guide channels, and applying the calculated parameters to produce a denoised image. Tiling is used when calculating the parameters of the model.

Abstract: The present technology is directed to presenting a 3-D representation of an object, which is captured in a 2-D image of the object in an environment in a 3-D simulation of the environment. The present technology can receive 3-D data representing the environment including image data of the object in the environment, and a label identifying the object. The present technology can further locate a position of the object in the 3-D simulation of the environment based on determining a depth and an orientation of the object in the environment based on a semantic database of attributes associated with the object, obtain a 3-D representation of the object from the semantic database of attributes associated with the object, and project the 3-D representation of the object into the 3-D simulation of the environment at the determined position for the object.

Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.

Abstract: In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.

Abstract: An agricultural modeling system may include a mobile ranging platform configured to generate 3D point cloud data of an agricultural geographic area, client devices, a geospatial database configured to store a data layer for the agricultural geographic area, and a server computing resource in communication with the mobile ranging platform, the client devices, and the geospatial database. The server computing resource may be configured to geographically reference the data layer fused with the 3D point cloud data of the agricultural geographic area, and generate a multi-layered data model for the geographically referenced data layer fused with the 3D point cloud data of the agricultural geographic area. A client device may be configured to selectively render the multi-layered data model.

Abstract: Systems and methods are described for rendering complex surfaces or geometry. In at least one embodiment, neural signed distance functions (SDFs) can be used that efficiently capture multiple levels of detail (LODs), and that can be used to reconstruct multi-dimensional geometry or surfaces with high image quality. An example architecture can represent complex shapes in a compressed format with high visual fidelity, and can generalize across different geometries from a single learned example. Extremely small multi-layer perceptrons (MLPs) can be used with an octree-based feature representation for the learned neural SDFs.

Abstract: The present disclosure relates to methods and apparatus for graphics processing. The apparatus may configure a plurality of billboards associated with a viewpoint of a first frame of a plurality of frames, the plurality of billboards being configured in one or more layers at least partially around the viewpoint, the configuration of the plurality of billboards being based on one or more volumetric elements between at least one of the plurality of billboards and the viewpoint. The apparatus may also render an image associated with each of the one or more volumetric elements between at least one billboard of the plurality of billboards and the viewpoint, the rendered image including a set of pixels. The apparatus may also store data in the at least one billboard based on the rendered image associated with each of the one or more volumetric elements, the data corresponding to the set of pixels.

Abstract: A system and method for volume rendering a light field, wherein the light field data is subjected to a layering scheme introducing a partitioning of the hogels into subsets. Each subset corresponding to a sub-volume of the layer volume, corresponds to the sub-region of the layer. Novel partitioning of the data combined with an efficient local memory caching technique, plenoptic downsampling strategies to reduce memory bandwidth requirements and volume rendering algorithm to produce a rendered light field image. A reduction in the total number of samples required can be obtained while still maintaining the quality of the resulting image. A method is also provided to order memory accesses aligned with ray calculations in order to maximize access coherency. Real-time layered scene decomposition can be combined with surface rendering method to create a hybrid real-time rendering method that supports rendering of scenes containing superimposed volumes and surfaces.

Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system makes use of a serial-mode ray intersection process, in which, when a ray intersects a bounding volume, a limited number of new ray requests are generated.

Abstract: The present invention provides an octree-based three-dimensional building model LOD method, specifically comprising the following steps: S1, reading three-dimensional building model data; S2, setting a tree depth Depth parameter of the octree; S3, respectively merging leaf node bounding boxes of the octree according to layers, and establishing coarse grid blocks; S4, merging the coarse grid blocks of the components of each layer; S5, performing triangularization; S6, calculating a normal vector of the coarse grid block; S7, merging the simplified components to form a building model of a coarse grid block; S8, deleting internal vertexes; S9, setting materials or textures; and S10, outputting the three-dimensional building LOD model.