Abstract: Systems and methods are provided for enhanced animation generation based on using motion mapping with local bone phases. An example method includes accessing first animation control information generated for a first frame of an electronic game including local bone phases representing phase information associated with contacts of a plurality of rigid bodies of an in-game character with an in-game environment. Executing a local motion matching process for each of the plurality of local bone phases and generating a second pose of the character model based on the plurality of matched local poses for a second frame of the electronic game.

Abstract: Provided herein is a method, apparatus, and computer program product for identifying locations along a road segment as a tunnel based on point cloud data. Methods may include: receiving point cloud data representative of an environment of a trajectory along a road segment; generating, from the point cloud data, one or more two-dimensional images in one or more corresponding planes orthogonal to the trajectory; determining, for the one or more two-dimensional images, a probability as to whether a respective two-dimensional image is captured within a tunnel along the road segment; and classifying a point along the road segment at a position corresponding to a respective one of the one or more two-dimensional images as a tunnel point in response to the probability as to whether the respective two-dimensional image is captured within a tunnel along the road segment satisfying a predetermined value.

Abstract: A method of generating map images in a computing device includes loading source map data or vector data onto a host; loading an output tile system; determining which output tiles to process by cross-referencing the source map data or the vector data with the output tile system; loading source maps or vector data to a graphics processing unit memory; executing a graphics processing unit kernel to process data and return a map tile to the host; writing the map tile to a file on a database; determining if all tiles have been processed; and generating output map tiles. A map tile generation system includes computing devices; servers connected via a network; non-transitory computer-readable storage media storing instructions and machine-learning graphics processor units coupled to the servers via a kernel interface program.

Abstract: A processing system comprises a first integrated circuit (IC) and a second IC. The first IC comprises first image processing circuitry, first display panel driver circuitry, and first communication circuitry. The first image processing circuitry is configured to generate a first overlay image by overlaying a first partial input image with a first image element based on first partial input image data representing the first partial input image and first image element data representing the first image element. The first display panel driver circuitry is configured to drive a display panel based on the first overlay image. The first communication circuitry is configured to output second image element data representing a second image element to the second IC.

Abstract: A method of dental treatment may include receiving photos of a person's dentition, identifying a stage of a treatment plan administered to the person's dentition, gathering a three-dimensional (3D) model of the person's dentition corresponding to the stage of the treatment plan, projecting attributes of the 3D model of the person's dentition onto an image plane to get a projected representation of the person's dentition at the stage of the treatment plan, comparing the photos to the projected representation to derive an error image representing the comparison, and analyzing the error image for discrepancies, wherein the discrepancies represent one or more deviations of the person's dentition from the stage of the treatment plan.

Abstract: A three-dimensional scene constructing method, apparatus and system, and a storage medium. The three-dimensional scene constructing method includes: acquiring point cloud data of a key object and a background object in a target scene, wherein the point cloud data of the key object comprises three-dimensional information and corresponding feature information, and the point cloud data of the background object at least comprises three-dimensional information; establishing a feature database of the target scene, wherein the feature database at least comprises a key object feature library for recording three-dimensional information and feature information of the key object; performing registration and fusion on the point cloud data of the key object and the point cloud data of the background object, so as to obtain a three-dimensional model of the target scene; and when updating the three-dimensional model, reconstructing the three-dimensional model in a regional manner according to the feature database.

Abstract: A three-dimensional data encoding method includes: (i) in a first case where a layered structure is generated by classifying three-dimensional points into layers: encoding attribute information for the three-dimensional points based on the layered structure; and generating a bitstream including layer information utilized for the generation of the layered structure; and (ii) in a second case where the three-dimensional points are not classified: encoding attribute information for the three-dimensional points; and generating a bitstream not including the layer information.

Abstract: A method and a system for garment try-on. The method includes: capturing a three dimensional (3D) image of a customer; obtaining first 3D pose of the customer in the 3D image; performing a machine learning model on the 3D pose to generate a first skinned multi-person linear model (SMPL) pose; calculating an angle of the whole body rotation of the customer based on the first SMPL pose; when the angle is in a predefined range relative to a front direction of the customer: constructing an SMPL model using the first SMPL pose; and when the angle is out of the predefined range: generating a second SMPL pose using two dimensional (2D) component of the 3D image, and constructing the SMPL model using the second SMPL pose.

Abstract: A method, computer program, and computer system is provided for streaming immersive media. Content is ingested in a first two-dimension format or a first three-dimensional format, whereby the format references a neural network. The ingested content is converted to a second two-dimensional or a second three-dimensional format based on the referenced neural network. The converted content is streamed to a client end-point, such as a television, a computer, a head-mounted display, a lenticular light field display, a holographic display, an augmented reality display, or a dense light field display.

Abstract: Techniques for aligning images generated by two cameras are disclosed. This alignment is performed by computing a relative 3D orientation between the two cameras. A first gravity vector for a first camera and a second gravity vector for a second camera are determined. A first camera image is obtained from the first camera, and a second camera image is obtained from the second camera. A first alignment process is performed to partially align the first camera's orientation with the second camera's orientation. This process is performed by aligning the gravity vectors, thereby resulting in two degrees of freedom of the relative 3D orientation being eliminated. Visual correspondences between the two images are identified. A second alignment process is performed to fully align the orientations. This process is performed by using the identified visual correspondences to identify and eliminate a third degree of freedom of the relative 3D orientation.

Abstract: Method for evaluating a dental situation of a patient. The method having the following successive steps: 1) generating an initial model of at least one dental arch of the patient, preferably by means of a scanner; 2) splitting the initial model in order to define a tooth model for at least some of the teeth represented on the initial model and thereby to obtain a split model; 3) determining an initial support curve of the tooth models in the split model; 4) fixing each tooth model virtually on the initial support curve, preferably by computer; 5) modifying the split model by deformation of the initial support curve according to a deformed support curve, so as to obtain a first deformed model, in which the tooth models are aligned according to the deformed support curve; 6) presenting the first deformed model.

Abstract: Disclosed are methods and systems for generating three-dimensional reconstructions of environments. A system, for example, may include a housing having an image sensor directed in a first direction and a distance sensor directed in a second direction and a control unit including a processor and a memory storing instructions. The processor may be configured to execute the instructions to: generate a first 3D model of an environment; generate a plurality of revolved 3D models by revolving the first 3D model relative to the image sensor to a plurality of positions within a predetermined angular range; match a set of distance values to one of the revolved 3D models; determine an angular position of the second direction relative to the first direction; and generate a 3D reconstruction of the environment.

Abstract: The application relates to the problem of navigating a surgical instrument (at 301, 311) towards a region-of-interest (at 312) in endoscopic surgery when an image (300) provided by the endoscope is obscured at least partly by obscuring matter (at 303), wherein the obscuring matter is a leaking body fluid, debris or smoke caused by ablation. To address this problem, a computer-implemented method is proposed, wherein, upon detecting that the image from the endoscope is at least partly obscured, a second image is determined based on a sequence of historic images and based on the current position and orientation of the endoscope. Furthermore, a virtual image (310) is generated based on the determined second image.

Abstract: An apparatus includes an electronic display configured to be positioned in a first location and one or more processors electronically coupled to the electronic display. The processors receive a video from a server. The video depicts a view of a second location and includes an image of a rectangular casing, a frame, and one or more muntins. The image is composited with the video by the server to provide an illusion of a window in the second location to a user viewing the video. The rectangular casing surrounds the window. The processors synchronize a time-of-view at the second location in the video with a time-of-day at the first location and synchronize a second length-of-day at the second location in the video with a first length-of-day at the first location. The processors transmit the video to the electronic display for viewing by the user.

Abstract: An autoencoder includes memory configured to store data including an encode network and a decode network, and processing circuitry coupled to the memory. The processing circuitry is configured to cause the encode network to convert inputted data to a plurality of values and output the plurality of values, batch-normalize values indicated by at least two or more layers of the encode network, out of the output plurality of values, the batch-normalized values having a predetermined average value and a predetermined variance value, quantize each of the batch-normalized values, and cause the decode network to decode each of the quantized values.

Abstract: A system for creating a wiring guide graphic comprising a database configured to receive inputs of a connector body identity, an engineering specification and a wiring table; and a processor coupled to the sensor, the processor configured to create a wiring guide graphic.

Abstract: This application discloses methods, systems, and computer-implemented virtualization software applications and computer-implemented graphical user interface tools for remote virtual visualization of structures. Images are captured by an imaging vehicle of a structure and the captured images are transmitted to a remote server via a communication network. Using virtual 3D digital modeling software the server, using the images received from the imaging vehicle, generates a virtual 3D digital model of the structure and stores it in a database. This virtual 3D digital model can be accessed by remote users, using virtualization software applications, and used to view images of the structure. The user is able to manipulate the images and to view them from various perspectives and compare the before-the-damage images with images taken after damage have occurred. Based on all this the user is enabled to remotely communicate with an insurance agent and/or file an insurance claim.

Abstract: Methods, systems, computer-readable media, and apparatuses for generating an Augmented Reality (AR) object are presented. The apparatus can include memory and one or more processors coupled to the memory. The one or more processors can be configured to receive an image of at least a portion of a real-world scene including a target object. The one or more processors can also be configured to generate an AR object corresponding to the target object and including a plurality of parts. The one or more processors can further be configured to receive a user input associated with a designated part of the plurality of parts and manipulate the designated part based on the received user input.

Abstract: Methods, systems, and computer readable media for 3D printing from images, e.g., medical images or images obtained using any appropriate volumetric imaging technology. In some examples, a method includes receiving, from a medical imaging device, a multi-dimensional image of a structure. The method includes, for each two dimensional (2D) slice of the multi-dimensional image, converting, row-by-row for each row of the 2D slice, voxels of the 2D slice into 3D printing instructions for the 2D slice. The method includes 3D printing, by controlling a 3D printing extruder, a physical model based on the structure by 3D printing, slice by slice, each 2D slice using the 3D printing instructions.

Abstract: A modeling engine generates a prediction model that quantifies and predicts secondary dynamics associated with the face of a performer enacting a performance. The modeling engine generates a set of geometric representations that represents the face of the performer enacting different facial expressions under a range of loading conditions. For a given facial expression and specific loading condition, the modeling engine trains a Machine Learning model to predict how soft tissue regions of the face of the performer change in response to external forces applied to the performer during the performance. The modeling engine combines different expression models associated with different facial expressions to generate a prediction model. The prediction model can be used to predict and remove secondary dynamics from a given geometric representation of a performance or to generate and add secondary dynamics to a given geometric representation of a performance.