Abstract: A medical imaging communication system processes medical images for being transmitted to a client device. The system receives a set of images, each image corresponding to a slice of a three-dimensional object. The system combines a first subset of the images into a first combined image and combines a second subset of the images into a second combined image. The first and second combined image are compressed using a lossless compression algorithm and transmitted to the client device.

Abstract: An avatar personalized for a subject and used in movement analysis and coaching uses a 3D polygon mesh representation of a human, authored for one human skeleton model, with a different size (scaled) skeleton model, without producing visual artifacts. Dimensions of the scaled skeleton model can be determined from three or eight measurements of a subject or from scanning or photographic methods. The avatar animated based on motion capture data may be animated alone or with one or more other avatars that are synchronized spatially, orientationally, and/or at multiple times to allow a user to easily compare differences between performances. An information presentation in an animation may use pixel energies from multiple animation frames to ensure that the information remains relatively stationary and does not obstruct important visual details.

Abstract: An avatar output device includes an avatar storage unit that stores, for each of two or more avatars, avatar information including first model information for displaying the avatar; a determination unit that determines at least one first avatar displayed using the first model information and at least one second avatar displayed using second model information with a data size smaller than a data size of the first model information from among the two or more avatars; an avatar acquisition unit that acquires an avatar using the second model information for each of the at least one second avatar determined by the determination unit, and acquires an avatar using the first model information for each of the at least one first avatar; and an avatar output unit that outputs the two or more avatars acquired by the avatar acquisition unit.

Abstract: A plurality of images is obtained, whether as separate images or part of a video. The plurality of images is used to generate a three-dimensional (3D) model of the imagery. The 3D model is registered to a geographic coordinate system as a first registered 3D model. The first registered 3D model is merged with a second registered 3D model to generate a merged 3D model. A request including a value corresponding to a location within the geographic coordinate system that includes at least a portion of the merged 3D model is received from a client device. A message identifying at least a subset of points in the portion of the merged 3D model is sent to the client device, each point in the subset having a three-dimensional coordinate.

Abstract: Method for modelling blood vessels includes: obtaining medical imaging data of the blood vessels; generating a three-dimensional personalized model of the blood vessels, based on the medical imaging data; generating a three-dimensional reference model of the blood vessels that reflects a state of healthy blood vessels that lack lesions, based on the medical imaging data or based on numerical reconstruction of the personalized model; performing a numerical simulation of blood flow for the same physical and boundary conditions in the personalized model and in the reference model, the simulation comprising determining conditions of blood flow at an inlet to the blood vessels model and calculating blood flow energy for the inlet and all outlets of the blood vessels model; comparing the blood flow energy measured for the personalized model and for the reference model; determining flow energy change indexes of the blood flow in the personalized model and the reference model.

Abstract: Graphics processing systems and methods with geometry level of detail processing are described. An example graphics processing system includes a processor configured to retrieve a first level of detail value for a meshlet instance. The processor may further be configured to compute a second level of detail value for a meshlet instance. The processor may further be configured to, based on a comparison between the first level of detail value for the meshlet instance and the second level of detail value for the meshlet instance, select a final level of detail value for the meshlet instance. The processor may further be configured to fetch vertices and corresponding indices for the meshlet instance based on the final level of detail value for the meshlet instance and process the vertices of the meshlet instance.

Abstract: A processor includes a first mode where the processor is not to use packed data operation masking, and a second mode where the processor is to use packed data operation masking. A decode unit to decode an unmasked packed data instruction for a given packed data operation in the first mode, and to decode a masked packed data instruction for a masked version of the given packed data operation in the second mode. The instructions have a same instruction length. The masked instruction has bit(s) to specify a mask. Execution unit(s) are coupled with the decode unit. The execution unit(s), in response to the decode unit decoding the unmasked instruction in the first mode, to perform the given packed data operation. The execution unit(s), in response to the decode unit decoding the masked instruction in the second mode, to perform the masked version of the given packed data operation.

Abstract: Methods and apparatuses for assessing oral health and automatically providing diagnosis of one or more oral diseases. Described herein are intraoral scanning methods and apparatuses for collecting and analyzing image data and to detect and visualize features within image data that are indicative of oral diseases or conditions, such as gingival inflammation or oral cancer. These methods and apparatuses may be used for identifying and evaluating lesions, redness and inflammation in soft tissue and caries and cracks in the teeth. The methods can include training a machine learning model and using the trained machine learning model to provide a diagnosis of an oral disease or condition based on image data collected using multiple scanning modes of an intraoral scanner.

Abstract: Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.

Abstract: A model of a human subject's head may be generated to assist in a therapeutic and/or diagnostic procedure. A treatment and/or diagnostic system may generate a fitted head model using a predetermined head model and a plurality of points. The plurality of points may include facial feature information and may be determined using a sensor, for example, an IR or optical sensor. One or more anatomical landmarks may be determined and registered in association with the fitted head model using the facial feature information, for example, without the use of additional image information, such as an MM image. The fitted head model may include visual aids, for example, anatomical landmarks, reference points, marking of the human subject's MT location, and/or marking of the human subject's treatment location. The visual aids may assist a technician to perform the therapeutic and/or diagnostic procedure of the human subject.

Abstract: A method is performed at an electronic device with one or more processors and a non-transitory memory. The method includes obtaining hair curve data that represents a plurality of hair strands. Each of the plurality of hair strands includes a respective plurality of hair points. The method includes projecting the plurality of hair strands to a hair mesh that is associated with a virtual agent. The method includes rendering a first subset of the plurality of hair strands in order to generate a hair texture based on a corresponding portion of the projection. The method includes rendering the hair texture in association with the virtual agent in order to generate a display render. In some implementations, the method includes changing the number of hair strands rendered during a particular rendering cycle, enabling dynamic generation of hair textures across rendering cycles.

Abstract: Embodiments are disclosed for using machine learning models to perform three-dimensional garment deformation due to character body motion with collision handling. In particular, in one or more embodiments, the disclosed systems and methods comprise receiving an input, the input including character body shape parameters and character body pose parameters defining a character body, and garment parameters. The disclosed systems and methods further comprise generating, by a first neural network, a first set of garment vertices defining deformations of a garment with the character body based on the input. The disclosed systems and methods further comprise determining, by a second neural network, that the first set of garment vertices includes a second set of garment vertices penetrating the character body. The disclosed systems and methods further comprise modifying, by a third neural network, each garment vertex in the second set of garment vertices to positions outside the character body.

Abstract: In some examples, an apparatus for mesh processing includes processing circuitry. The processing circuitry receives a first mesh frame with polygons representing a surface of an object, and determining that the first mesh frame is a non manifold type mesh in response to one or more singularity components in the first mesh frame. The processing circuitry converts the first mesh frame to a second mesh frame that is a manifold type mesh. The first mesh frame has first boundary loops that respectively correspond to second boundary loops in the second mesh frame. The processing circuitry detects the second boundary loops in the second mesh frame, and determines the first boundary loops in the first mesh frame according to the second boundary loops in the second mesh frame.

Abstract: A Virtual reality system which comprises a head mounted display and positional tracking to determine the position and orientation of the head mounted display. A player wearing the head mounted display would view a virtual world. External physical objects such as a cup can be identified and displayed inside the virtual world displayed inside the head mounted display so that a player can drink out of the cup without having to remove the head mounted display.

Abstract: An appearance-responsive material map generation system generates a set of material maps based on the appearance of a material depicted in the source material data. A neural network included in the appearance-responsive material map generation system is trained to identify features of particular source material data, such as features that contribute to a highly realistic appearance of a graphical object rendered with the material depicted in the source material data. In some cases, the trained neural network receives source material data that includes at least one source material map. Based on the features that are identified for the particular source material data, the appearance-responsive material map generation system creates a respective set of appearance-responsive material maps for the particular source material data. In some cases, the appearance-responsive rendering map set is arranged as an inconsistent pyramid of material maps.

Abstract: Generating polygon meshes that approximate surfaces using iteration for mesh vertex positions. In some implementations, a method includes receiving input data that represents a surface distinguishing a volume, where a voxel grid includes the surface. Particular voxels of the voxel grid are identified, which the surface intersects. A surface-approximating mesh is generated including polygons defined by vertices in the particular voxels. Generating the mesh includes determining approximate positions of a subset of the vertices in a subset of the particular voxels, based on interpolation of locations in the voxel subset where the surface intersects the voxel subset. Errors between approximate voxel values (based on the approximate positions) and assigned voxel values of the particular voxels (based on the input data) are determined, and the approximate position of at least one vertex of the subset of the vertices is adjusted using a successive over-relaxation technique to reduce the errors.

Abstract: A processing system includes hull shader circuitry that launches thread groups including one or more primitives. The hull shader circuitry also generates tessellation factors that indicate subdivisions of the primitives. The processing system also includes throttling circuitry that estimates a primitive launch time interval for the domain shader based on the tessellation factors and selectively throttles launching of the thread groups from the hull shader circuitry based on the primitive launch time interval of the domain shader and a hull shader latency. In some cases, the throttling circuitry includes a first counter that is incremented in response to launching a thread group from the buffer and a second counter that modifies the first counter based on a measured latency of the domain shader.

Abstract: A method and three-dimensional (3D) modeling engine for managing modeling data during 3D modeling includes generating, by an editable mesh module, a data search list. The method and engine further includes searching, by the editable mesh module, for connection information of vertices, edges, and faces of a 3D model on the basis of the data search list.

Abstract: A system comprises a prediction module configured to predict an attribute value, such as a texture coordinate, for a vertex of a triangle in a two-dimensional (2D) attribute representation based on known positions of vertices of a corresponding triangle in a three-dimensional (3D) geometric representation. In some embodiments, the prediction module adaptively selects a prediction technique between multiple available prediction techniques based on availability of vertices information in the 3D geometric representation and in the 2D attribute representation and further based on compression efficiency and distortion minimization. The prediction module enables compression of attribute information being signaled for volumetric visual content, such as a mesh with texture.

Abstract: A mobile device is fitted with a camera and an extended reality (XR) software application program executing on a processor within an XR system. Via the XR software application program, various techniques are performed for manipulating virtual objects in an XR environment. In a first technique, the XR software application program facilitates the movement of a virtual object from a first location to a second location. In a second technique, the XR software application program facilitates the rotation of a virtual object. In a third technique, the XR software application program facilitates the scaling of a virtual object along one or more axes.