Abstract: Apparatuses, systems, and techniques to identify a shape or camera pose of a three-dimensional object from a two-dimensional image of the object. In at least one embodiment, objects are identified in an image using one or more neural networks that have been trained on objects of a similar category and a three-dimensional mesh template.

Abstract: A method includes processing an input comprising data from an intraoral image using a trained machine learning model that has been trained to classify regions of dental sites, wherein the trained machine learning model outputs a probability map comprising, for each pixel in the intraoral image, a first probability that the pixel belongs to a first dental class and a second probability that the pixel belongs to a second dental class, wherein the first dental class represents excess material, the excess material comprising material other than teeth or gums. The method further includes determining, based on the probability map, one or more pixels in the intraoral image that are classified as excess material. The method further includes hiding or removing from the intraoral image data for the one or more pixels that are classified as excess material.

Abstract: A method of generating and modifying a 2D image of a 3D scene the method including the steps: processing an image of a 3D scene to generate a set of data points representative of the 3D scene and 3D objects within the scene; retrieving one or more data points from the set of data; transforming the one or more data points according to one or more mathematical conversion functions, including; a function defining a projection trajectory for each data point; a function defining a geometry of a projection surface for each data point; a function defining a projection volume for each data point; a function defining an angle of projection of each data point with respect to a convergence point on a projection surface; a function defining the size to distance ratio of each data point from a projection surface; generating a transformed set of data points; projecting the transformed set of data points representative of a modified 2D image of the 3D scene; and, rendering the projected transformed set of data points into a

Abstract: Methods and apparatus relating to three-dimensional object models are described. In one example, (i) data representing a geometrical description of a three-dimensional object defining object geometry in a geometric space and (ii) at least one object property description describing an object property in an object property space are received. The object property space and the geometric space are intersected to define an object model, wherein an object property is defined at an intersection between a described object property and defined object geometry.

Abstract: Techniques are described for, given two images taken at two viewing locations, generating and presenting an image transition sequence that simulates viewer movement between the viewing locations, such as without using information about relative distance between the viewing locations and other depth information to objects in an environment around the viewing locations. The start and end images for an image transition sequence may be part of panorama images acquired at the viewing locations, and generating of the image transition sequence may include selecting and using one of multiple types of transition sequences to perform rotating (e.g., from a start image's viewing direction to face toward the viewing location for the end image), zooming (e.g., to simulate moving forward), and/or blending of the end image with a modified version of the start image, with the resulting image transition sequence played as a video or other animation.

Abstract: Described herein are systems, methods, and computer readable media for performing data conversion on sensor data to obtain modified sensor data that is formatted/structured appropriately for downstream processes that rely on the sensor data as input. The sensor data can include point cloud data captured by a LiDAR, for example. A grid structure and corresponding grid characteristics can be determined and the sensor data can be converted to grid-based sensor data by associating the grid structure and its characteristics with the sensor data. Generating the grid-based sensor data can include reformatting the point cloud data to superimpose the grid structure and its grid characteristics onto the point cloud data. Various downstream processing that cannot feasibly be performed on the raw sensor data can then be performed efficiently on the modified grid-based sensor data by virtue of the grid structure imbuing the sensor data with spatial proximity information.

Abstract: An information processing apparatus includes a first detection unit configured to detect a first object located on a first direction side of a refracting surface from an image obtained by an imaging apparatus located on the first direction side, a second detection unit configured to detect a second object located on a second direction side of the refracting surface from an image obtained by an imaging apparatus located on the second direction side, an obtaining unit configured to obtain position information indicating at least either one of a positional relationship between the first and second objects and positions of the first and second objects, and an identification unit configured to identify positions of the plurality of imaging apparatuses in a common coordinate system, based on a result of detection performed by the first detection unit, a result of detection performed by the second detection unit, and the position information.

Abstract: A method and a system for manufacturing an orthodontic appliance are provided. The method comprises: receiving a 3D mesh including a plurality of inner vertices representative of an inner surface of the appliance; generating a reference plane positioned relative to the arch form 3D mesh according to a predetermined position; determining, based on the 3D mesh, for each one of the plurality of inner vertices, a respective distance to the reference plane, the respective distance being indicative of a thickness of the appliance after forming; generating, based on the respective distance, a plurality of outer vertices representative of an outer surface of the appliance; generating, based on the plurality of inner vertices and the plurality of outer vertices, an appliance 3D representation of the appliance including data indicative of the thickness of the appliance; causing the manufacturing of the appliance based on the appliance 3D representation.

Abstract: An apparatus comprises a receiver (201) for receiving an image signal comprising a number of three dimensional images representing a scene from different viewpoints, each three dimensional image comprising a mesh and a texture map, the signal further comprising a plurality of residual data texture maps for a first viewpoint being different from the different viewpoints of the number of three dimensional images, a first residual data texture map of the plurality of residual texture maps providing residual data for a texture map for the first viewpoint relative to a texture map resulting from a viewpoint shift of a first reference texture map being a texture map of a first three dimensional image of the number of three dimensional images and a second residual data texture map of the plurality of residual texture maps providing residual data for a texture map for the first viewpoint relative to a texture map resulting from a viewpoint shift of a second reference texture map being a texture map of a second three

Abstract: The present disclosure relates to an image processing apparatus and an image processing method capable of storing auxiliary information in CbCr components in a YCbCr format. The image processing apparatus includes a receiving section that receives depth image data in which a depth image transmitted together with a texture image is stored in a Y component in a YCbCr format and auxiliary information is stored in CbCr components in the YCbCr format, and an auxiliary information utilization section that executes a predetermined image process using the auxiliary information on at least one of the texture image or the depth image. A value that can be taken on by the auxiliary information for each pixel of the texture image has N patterns, and a gradation value out of N×N gradation values into which a combination of the auxiliary information regarding two pixels is converted is stored in the CbCr components.

Abstract: A method for measuring shoe comfort level is provided. A 3D polygonal model of a foot is constructed from an array of images taken from multiple angles of the foot and leg. Each vertex point is loaded with foot anthropometric sensitive characteristics information. A 3D model of a shoe's inner space is constructed with a scanning device having various opening modes. Each of shoe inner space vertex points is complimented by shoe data such as material type, rigidity, structure, vamp and shoelaces. The 3D polygonal foot model and the vertex inner shoe space model are fitted together and the comfort level for the foot is defined with the simulation of movement.

Abstract: Systems and methods are disclosed for secret sharing for secure collaborative graphical design. Graphical secret shares are generated from a three-dimensional graphical design and distributed to one or more contributor devices. Contributor graphical designs modifying graphical secret shares may be received from contributor devices. Various corresponding and related systems, methods, and software are described.

Abstract: An animation system wherein a machine learning model is adopted to generate animated facial actions based on parameters obtained from a live actor. Specifically, the anatomical structure such as a facial muscle topology and a skull surface that are specific to the live actor may be used. A muscle structure of simplified “pseudo” muscles that approximate the actual muscle topology but with reduced degree of freedom is determined to improve computational efficiency.

Abstract: A computer process including receiving first patient bone data of a patient leg and foot in a first pose, the first pose comprising a position and orientation of the patient leg relative to the patient foot as defined in the first patient bone data. The computer process may further include receiving second patient bone data of the patient leg and foot in a second pose, the second pose comprising a position and orientation of the patient leg relative to the patient foot as defined in the second patient bone data. The computer process may further include generating a 3D bone model of the patient leg and foot. Finally, the computer process may include modifying the 3D bone model of the patient leg and foot such that the plurality of 3D bone models are reoriented into a third pose that matches the second pose.

Abstract: Complementary near-field and far-field light field displays (LFDs) are provided. A distributed LFD system is disclosed in which the light field is cooperatively displayed by a direct view LFD and a near-eye LFD. The two display components of the system work together synchronously to display a high-fidelity 3D experience to one or multiple viewers.

Abstract: In one aspect, the present application provides a computer-based method of measuring positional relationship between two teeth, comprising: obtaining a second 3D digital model representing a plurality of teeth under a second tooth arrangement, wherein the plurality of teeth comprise a first tooth and a second tooth; and measuring a value of a collision or a size of a gap between the first tooth and second tooth based on the second 3D digital model and in a predetermined first direction.

Abstract: A method of processor-aided design of a workholding frame for a manufacturing process includes using a processor to perform operations including receiving, by a processor, first data representing a first three-dimensional (3D) model of an object to be manufactured. The operations further include obtaining, by the processor, second data describing a second 3D model. The second 3D model represents a bounding box having one or more sides adjoining a surface of the object within the first 3D model. The operations further include automatically generating, by the processor and based on the first data and the bounding box, third data indicating one or more parameters of the workholding frame. The workholding frame and the object are to be formed based on the one or more parameters and as a single workpiece from a blank material during a machining process associated with the object.

Abstract: The method for remote clothing selection includes determination of anthropometric dimensional parameters of a user, automatic assessment of correspondence of a garment to the shape and body measurements of a user, determination and provision of recommendations to a user on the selection of a particular garment and, optionally, visualization of a garment on a digital avatar of this user in the virtual fitting room, including optional change of his/her pose. The invention provides an increase in the efficiency of remote clothing selection by a user, an improvement in user's experience of remote purchase, an increase in user satisfaction and, ultimately, an increase in online sales of clothing and a decrease in the proportion of clothing returned after a purchase due to unsatisfactory matching to the shape and measurements of user's body.

Abstract: Two or more adjacent teeth in a virtual model are determined. The two or more adjacent teeth include a first tooth adjacent to a second tooth in the virtual model. The virtual filler is inserted in the virtual model between the first tooth and the second tooth. Points in the virtual model are selected. The points and the virtual filler are transformed into a voxel volume. A geometry of an updated virtual filler is determined by transforming a surface of the voxel volume into a polygonal mesh.

Abstract: Rendering systems that can use combinations of rasterization rendering processes and ray tracing rendering processes are disclosed. In some implementations, these systems perform a rasterization pass to identify visible surfaces of pixels in an image. Some implementations may begin shading processes for visible surfaces, before the geometry is entirely processed, in which rays are emitted. Rays can be culled at various points during processing, based on determining whether the surface from which the ray was emitted is still visible. Rendering systems may implement rendering effects as disclosed.