Abstract: A system and method enabling per-user-optimized computing, rendering, and provisioning within virtual worlds. The system comprises a server including memory and at least one processor, the memory storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and a computing optimization platform configured to store and provide rules for optimizing the computing, rendering and data provisioning to users via user devices. A plurality of connected devices connected to the server via a network provide multi-source data, user input, or combinations thereof, to the persistent virtual world system, updating the virtual replicas. The server retrieves user location, viewing position and orientation from the one or more user devices to determine a user interaction radius, thereby optimizing via the computing optimization platform the relevant computing, rendering and provisioning for the one or more user devices.

Abstract: Methods and systems for generating composite images of a patient and models of the patient's dentition are provided. In some embodiments, a method includes generating a plurality of 3D models, each comprising a virtual representation of the patient's dentition at different treatment stages of a treatment plan and obtaining an image of the patient's face and dentition. The method can include projecting the obtained image into a 3D space to create a projected 3D model of the patient's face and dentition. The method can also include generating a plurality of modified images, each representing the patient in a treatment stage of the treatment plan and formed by combining the patient's dentition of one of the 3D models with the patient's face of the projected 3D model. A modified image corresponding to a selected treatment stage and a corresponding 3D model can be provided for display.

Abstract: A computer includes a processor and a memory storing instructions executable by the processor to receive a plurality of first images of an environment in a first lighting condition, classify pixels of the first images into categories, mask the pixels belonging to at least one of the categories from the first images, generate a three-dimensional representation of the environment based on the masked first images, and generate a second image of the environment in a second lighting condition based on the three-dimensional representation and on a first one of the first images.

Abstract: Systems and methods for planning delivery of an object via a catheter, such as transseptal delivery of a prosthetic mitral valve to a patient's heart are disclosed.

Abstract: The disclosed systems and methods are for performing digital separation of teeth. The method includes: (i) obtaining a 3D digital model of two adjacent teeth, wherein the 3D digital model includes a first set of elements comprising first tooth elements and second tooth elements, (ii) generating a separation plane relative to the two adjacent teeth by: obtaining a second set of elements associated with a separation zone, identifying a third set of elements which are a subset of the second set of elements, and determining the separation plane, (iv) performing the digital separation by generating a first cutting plane and a second cutting plane, and (v) updating the 3D digital model by removing the first tooth elements and the second tooth elements which are between the first and second cutting planes, and (vi) storing the updated 3D digital model in a memory.

Abstract: A computer includes a processor and a memory storing instructions executable by the processor to receive a first image of a scene in a first lighting condition, generate a three-dimensional representation of the scene based on the first image, and generate a second image of the scene in a second lighting condition based on the three-dimensional representation and on the first image. The first image is an only image of the scene used for generating the three-dimensional representation. The first image is an only image of the scene used for generating the second image.

Abstract: Systems, devices and methods are provided that provide assistance in selecting appropriate interventions for treatment of disease and injury to the eye. Systems of the inventive concept provide cloud-based processing and storage of clinical and patient-specific data, which can provide treatment recommendations and projected outcomes to a practitioner using a local device. Systems, devices, and methods can generate interactive physiomechanical models of the eye of a specified individual, which are derived measurements of mechanical properties of structures of the eye. The physiomechanical model is interactive, and can be used to emulate the effects of one or more medical interventions in the eye in order to implement an optimized treatment plan for the individual.

Abstract: Ray tracing systems and computer-implemented methods for generating a hierarchical acceleration structure for intersection testing. Nodes of the hierarchical acceleration structure are determined, wherein each of the nodes represents a region in a scene, and wherein the nodes are linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure. The stored data comprises data defining the regions represented by a plurality of the nodes. At least one node is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from the stored data.

Abstract: A method may include obtaining sensor data from one or more LiDAR units and determining a point-cloud corresponding to the sensor data obtained from each respective LiDAR unit. The method may include aggregating the point-clouds as an aggregated point-cloud. A number of data points included in the aggregated point-cloud may be decreased by filtering out one or more of the data points according to one or more heuristic rules to generate a reduced point-cloud. The method may include determining an operational granularity level for the reduced point-cloud. An array of existence-based objects may be generated based on the reduced point-cloud and the operational granularity level.

Abstract: A structured light 3D measurement device and method based on defocus-degree-based unwrapping. Binary fringes varying in fringe width are projected onto an object, and a corresponding fringe image is collected by a camera, and then subjected to phase demodulation to calculate a wrapped phase. The defocus degree is calculated according to modulation degrees of the binary fringes. The defocus degree is plugged into the defocusing phase function to obtain a normalized reference phase. The wrapped phase is subjected to phase unwrapping based on the normalized reference phase to obtain an absolute phase to reconstruct a 3D point cloud.

Abstract: In one embodiment, a method includes accessing display timing information associated with a display, and determining, based on the display timing information, one or more rendering requirements for a plurality of portions of the display. For each portion of the display, the method may determine a current viewpoint of a user, render, based on the current viewpoint of the user, pixel values for that portion of the display in accordance with the associated rendering requirement, and send the rendered pixel values to be output by the display. The display timing information may include a waveform associated with an oscillation motion of a scanning assembly of the display, and/or a requested size for each portion of the plurality of portions of the display. The rendering requirements may include a timing interval for rendering and sending the pixel values for each of the plurality of portions of the display.

Abstract: A method and an intersection testing module for performing intersection testing of a ray with a box in a ray tracing system. The ray and the box are defined in a 3D space using a space-coordinate system, and the ray is defined with a ray origin and a ray direction. A ray-coordinate system is used to perform intersection testing, wherein the ray-coordinate system has an origin at the ray origin, and the ray-coordinate system has three basis vectors. A first of the basis vectors is aligned with the ray direction. A second and a third of the basis vectors: (i) are both orthogonal to the first basis vector, (ii) are not parallel with each other, and (iii) have a zero as one component when expressed in the space-coordinate system. A result of performing the intersection testing is outputted for use by the ray tracing system.

Abstract: One embodiment of a computer-implemented method for processing ray tracing operations in parallel includes receiving a plurality of rays and a corresponding set of importance sampling instructions for each ray included in the plurality of rays for processing, wherein each ray represents a path from a light source to at least one point within a three-dimensional (3D) environment, and each corresponding set of importance sampling instruction is based at least in part on one or more material properties associated with at least one surface of at least one object included in the 3D environment; assigning each ray included in the plurality of rays to a different processing core included in a plurality of processing cores; and for each ray included in the plurality of rays, causing the processing core assigned to the ray to execute the corresponding set of importance sampling instructions on the ray to generate a direction for a secondary ray that is produced when the ray intersects a surface of an object within the

Abstract: A method is disclosed, the method comprising the steps of receiving, from a first client application, first graphical data comprising a first node; receiving, from a second client application independent of the first client application, second graphical data comprising a second node; and generating a scenegraph, wherein the scenegraph describes a hierarchical relationship between the first node and the second node according to visual occlusion relative to a perspective from a display.

Abstract: High-fidelity three-dimensional (3D) models and other high-fidelity digital media that depict objects with a high-level of detail may be computationally demanding to display on some devices. According to some embodiments of the present disclosure, digital media may be supplemented with one or more 3D models to improve the overall level of detail provided by the digital media without excessively increasing computational requirements. An example computer-implemented method includes instructing a user device to display digital media depicting an object, receiving an indication selecting a region of the depicted object, and instructing the user device to display a 3D model corresponding to the selected region of the depicted object, where the 3D model is different from the digital media.

Abstract: A method and apparatus for providing a guide for combining pattern pieces receives a selection of a first point in a first pattern piece and a selection of a second point in a second pattern piece to be combined with the first pattern piece, generates a virtual pattern piece in response to the selection of the second point being received, arranges the virtual pattern piece such that a third point in the virtual pattern piece having a position corresponding to the first point in the first pattern piece is matched to the second point in the second pattern piece, and provides a guide for combining the first pattern piece and the second pattern piece by moving the virtual pattern piece such that an outer line of the second pattern piece and an outer line of the virtual pattern piece correspond to each other.

Abstract: A method and an intersection testing module for performing intersection testing of a ray with a convex polygon in a ray tracing system. The ray and the convex polygon are defined in a 3D space using a space-coordinate system. The ray is defined with a ray origin and a ray direction. A ray-coordinate system is used to perform intersection testing, wherein the ray-coordinate system has an origin at the ray origin, and wherein the ray-coordinate system has three basis vectors. A first of the basis vectors is aligned with the ray direction. A second and a third of the basis vectors: (i) are both orthogonal to the first basis vector, (ii) are not parallel with each other, and (iii) have a zero as one component when expressed in the space-coordinate system. A result of performing the intersection testing is outputted for use by the ray tracing system.

Abstract: A method for designing a material for an aircraft component according to one example includes training a neural network to correlate microstructural features of an alloy with material properties of the alloy by at least providing a set of images of the alloy. Each of the images in the set of images has varied constituent compositions and at least one patch of corresponding data is embedded into the image. The method also includes determining non-linear relationships between the microstructural features and corresponding empirically determined material properties via a machine learning algorithm, receiving a set of desired material properties of the alloy for aircraft component, and determining a set of microstructural features capable of achieving the desired material properties of the alloy based on the determined non-linear relationships.

Abstract: Techniques are disclosed relating to ray intersection in the context of motion blur. In some embodiments, a graphics processor includes time-oblivious ray intersect circuitry configured to receive coordinates for a ray and traverse a bounding volume hierarchy (BVH) data structure based on the coordinates to determine whether the ray intersects with one or more bounding regions of a graphics space. In some embodiments, in response to reaching a temporal branch element of the BVH data structure, the ray intersect circuitry initiates a shader program that determines a sub-tree of the BVH data structure for further traversal by the ray intersection circuitry, where the sub-tree corresponds to a portion of a motion-blur interval in which the ray falls. This may provide accurate ray tracing for motion blur while reducing area and power consumption of intersect circuitry, relative to time-aware implementations.

Abstract: A method and system is provided for culling hidden objects in a tile-based graphics system before they are indicated in a display list for a tile. A rendering space is divided into a plurality of regions which may for example be a plurality of tiles or a plurality of areas into which one or more tiles are divided. Depth thresholds for the regions, which are used to identify hidden objects for culling, are updated when an object entirely covers a region and in dependence on a comparison between a depth value for the object and the depth threshold for the region. For example, if the depth threshold is a maximum depth threshold, the depth threshold may be updated if an object entirely covers the tile and the maximum depth value of the object is less than the maximum depth threshold.