Abstract: Apparatus and method for encoding sub-primitives to improve ray tracing efficiency. For example, one embodiment of an apparatus comprises: a ray generator to generate a plurality of rays in a ray tracing graphics pipeline; a sub-primitive generator to subdivide each primitive of a plurality of primitives into a plurality of sub-primitives; a sub-primitive encoder to identify a first subset of the plurality of sub-primitives as being fully transparent and to identify a second subset of the plurality of sub-primitives as being fully opaque; and wherein the first subset of the plurality of primitives identified as being fully transparent are culled prior to further processing of each respective primitive.

Abstract: Method, device, and non-transitory storage medium for adaptive streaming of immersive media are provided. The method may include determining characteristics associated with a scene to be transmitted to the end client, adjusting at least a part of the scene to be transmitted to the end client based on the determined characteristics, and transmitting an adaptive stream of the lightfield or holographic immersive media comprising the adjusted scene based on the determined characteristics.

Abstract: An apparatus for creating a virtual world includes a processor and a memory connected to the processor, in which the memory stores program instructions executed by the processor so as to receive an image of a real space through a device having a stereo camera, collect mesh data for the real space and an object existing in the real space through the image, determine coordinates for first edges of the real space from the mesh data for the real space, select one of a plurality of second edges based on an area of a virtual space defined by each of the plurality of second edges facing a predetermined direction, when there are more first edges of the real space than edges of a polygon preset for the real space, and output a virtual space defined by some of the first edges and the selected one second edge and a virtual object corresponding to the real object recognized in the real space.

Abstract: Systems and methods for planning a treatment for a patient's teeth are provided. In some embodiments, a method includes receiving input data representing an initial tooth arrangement of a patient's teeth. The method can include determining a target tooth arrangement for the patient's teeth, the target tooth arrangement including a change in mass of at least one tooth. The method can also include generating a plurality of intermediate tooth arrangements configured to adjust the patient's teeth from the initial tooth arrangement toward the target tooth arrangement. The method can further include generating instructions to output a visualization showing a difference in tooth mass between at least one intermediate tooth arrangement of the plurality of intermediate tooth arrangements and the target tooth arrangement.

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.

Abstract: A method of rendering an image of a 3-D scene includes rendering a noisy image at a first resolution; obtaining one or more guide channels at the first resolution, and obtaining one or more corresponding guide channels at a second resolution. The second resolution may be the same resolution as, or a higher resolution than, the first resolution. For each of a plurality of local neighbourhoods, the method comprises: calculating the parameters of a model that approximates the noisy image as a function of the one or more guide channels (at the first resolution), and applying the calculated parameters to the one or more guide channels at the second resolution, to produce a denoised image at the second resolution.

Abstract: Systems and methods for satellite Synthetic Aperture Radar (SAR) artifact suppression for enhanced three-dimensional feature extraction, change detection, and/or visualizations are described. In some aspects, the described systems and methods include a method for suppressing artifacts from complex SAR data associated with a scene. In some aspects, the described systems and methods include a method for creating a photo-realistic 3D model of a scene based on complex SAR data associated with a scene. In some aspects, the described systems and methods include a method for identifying three-dimensional (3D) features and changes in SAR imagery.

Abstract: An image processing apparatus includes a controller. The controller calculates a fundamental frequency component included in sound data and a harmonic component corresponding to the fundamental frequency component, converts the fundamental frequency component and the harmonic component into image data, and generates a sound image where the fundamental frequency component and the harmonic component converted into the image data are arranged adjacent each other.

Abstract: Images may be captured at an image capture device mounted on an image capture device gimbal capable of rotating the image capture device around a nodal point in one or more dimensions. Each of the plurality of images may be captured from a respective rotational position. The images may be captured by a designated camera that is not located at the nodal point in one or more of the respective rotational positions. A designated three-dimensional point cloud may be determined based on the plurality of images. The designated three-dimensional point cloud may include a plurality of points each having a respective position in a virtual three-dimensional space.

Abstract: Devices and techniques are generally described for three dimensional room modeling. In various examples, a three-dimensional (3D) room model comprising at least a first wall and a floor may be received. A first sphere sized and shaped such that the 3D room model fits within the first sphere may be determined and a virtual camera may be positioned on the first sphere at a first position. A first command may be received to move the virtual camera in a first direction. The virtual camera may be translated in the first direction along a surface of the first sphere to a second position. A view of the interior of the 3D room model may be displayed from a second viewpoint of the virtual camera at the second position.

Abstract: A display for displaying image data includes defining virtual color gamuts based on a plurality of primary display colors associated with a light source. At least one of the virtual color gamuts is defined to approximate an established color gamut. Intensity values associated with the virtual color gamuts are generated based on received video data, and the intensity values associated with the virtual color gamuts are used to generate drive values for the primary colors of the light source. A display using one or more virtual color gamuts is also disclosed.

Abstract: A geographical location of a user device is determined. It is determined that the geographical location of the user device matches a digital element based on a distance difference between the geographical location of the user device and a geographical location of the digital element. In response to the determination that the geographical location of the user device matches the digital element, an indication that the digital element is selectable is provided. A representation of the digital element is provided without providing an auditory content of the digital element prior to the digital element being obtained. A user selection indication that selects the representation of the digital element to obtain the auditory content of the digital element is received. The auditory content of the digital element is provided upon receiving the user selection indication.

Abstract: A system for virtual therapy-based treatment of psychological issues is disclosed. The system receives a first input associated with a first scene via one or more sources. The system further extracts a set of audio signals associated with a set of objects within the first scene based on the received first input. The system further generates digital immersive content associated with the first scene based on the received first input and the extracted set of audio signals. The generated digital immersive content includes at least a first virtual object of a set of virtual objects associated with the set of objects and a first audio signal of the extracted set of audio signals. The system further renders the generated digital immersive content via a user platform. The user platform executes on the first user device associated with the first user.

Abstract: The following relates generally to light detection and ranging (LIDAR) and artificial intelligence (AI). In some embodiments, a system: receives LIDAR data generated from a LIDAR camera; measures a plurality of dimensions of a room of the home based upon processor analysis of the LIDAR data; builds a 3D model of the room based upon the measured plurality of dimensions; receives an indication of a proposed change to the room; modifies the 3D model to include the proposed change to the room; and displays a representation of the modified 3D model.

Abstract: A computer implemented method of creating a simulated realistic virtual model of a geographical area for training an autonomous driving system, comprising obtaining geographic map data of a geographical area, obtaining visual imagery data of the geographical area, classifying static objects identified in the visual imagery data to corresponding labels to designate labeled objects, superimposing the labeled objects over the geographic map data, generating a virtual 3D realistic model emulating the geographical area by synthesizing a corresponding visual texture for each of the labeled objects and injecting synthetic 3D imaging feed of the realistic model to imaging sensor(s) input(s) of the autonomous driving system controlling movement of an emulated vehicle in the realistic model where the synthetic 3D imaging feed is generated to depict the realistic model from a point of view of emulated imaging sensor(s) mounted on the emulated vehicle.

Abstract: Ray tracing systems and methods generate a hierarchical acceleration structure to be used for intersection testing in a ray tracing system. Nodes of the hierarchical acceleration structure are determined, each representing a region in a scene, and being linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure, including data defining the regions represented by a plurality of the nodes. At least one node is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from the stored data. Intersection testing in the ray tracing system is performed in which, based on conditions in the ray tracing system, a determination is made as to whether testing of one or more rays for intersection with a region represented by a particular node of a sub-tree is to be skipped.

Abstract: This application generally relates to defining, displaying and interacting with tags in a 3D model. In an embodiment, a method includes generating, by a system including a processor, a three-dimensional model of an environment based on sets of aligned three-dimensional data captured from the environment, and associating tags with defined locations of the three-dimensional model, wherein the tags are respectively represented by tag icons that are spatially aligned with the defined locations of the three-dimensional model as included in different representations of the three-dimensional model rendered via an interface of a device, wherein the different representations correspond to different perspectives of the three-dimensional model, and wherein selection of the tag icons causes the tags respectively associated therewith to be rendered at the device.

Abstract: Described herein is a computer-implemented method for simulating texture features of a n-layer target coating, the method including at least the steps of: a) providing known real geometrical properties and known individual ingredients with known real material properties; b) modelling the n-layer target coating in a virtual environment; c) virtually tracing rays of light from one or more light sources towards an aim region defined on a surface of the n-layer target coating; d) virtually collecting rays of light that interacted with the n-layer target coating; e) virtually determining, at least one of an angular, a spectral and a spatial distribution of intensity of the rays of light re-emitted from or reflected by the n-layer target coating; and f) evaluating the determined distribution(s) of intensity and outputting, by an output device, at least one image based on the evaluation.

Abstract: A method includes causing background content to be displayed on a display device with a first virtual object and a second virtual object; causing augmented reality (AR) content to be rendered based on a location of an AR device relative to the display device; determining that the AR content is in front of the first virtual object in the scene when viewed through the AR device and rendering the background content with a cutout in the first virtual object when the first virtual object overlaps with the AR content; and determining that the AR content is behind the second virtual object in the scene when viewed through the AR device and rendering the AR content with a cutout in the AR content when the AR content overlaps with the second virtual object.

Abstract: A computer-implemented method of creating a bounding volume hierarchy (BVH) for a model defined with respect to a local coordinate system for the model. The method includes defining BVH branch nodes within the model, establishing a plurality of local transformation matrices for the BVH; and for each BVH branch node, determining a first bounding volume and associating the branch node with one of the plurality of local transformation matrices that maps between the first bounding volume and a second bounding volume in the local coordinate system.