Abstract: Disclosed is a graphics system and associated methods for dynamic backfilling a point cloud to conceal gaps that appear when zooming into the point cloud. The dynamically backfilling fills a gap with dynamically generated points that continue a texture, contour, pattern, shape, coloring, and/or other commonality of an original set of points from the point cloud that form a single continuous surface with that gap. The system defines a model based on images of an object or scene. The model represents the object or scene at different zoom depths with different dynamically generated points. The system determines that a requested render position exposes a gap in the original set of points. The system fills the gap by using the model to generate points at positions over the gap that continue a shape, form, or structure of a single continuous surface formed by the original set of points.

Abstract: An editing system may dynamically and intelligently determine which data points to remove, replace, and/or modify from a point cloud space so that more features, color information, and/or detail of the point cloud are preserved after decimation. The system may receive data points that are distributed in space, and may select one or more elements of the data points on which to base the decimation. For instance, the system may decimate a first subset of the data points by a first amount based on a first difference in values defined for the one or more elements of the first subset of data points, and may decimate a different second subset of the data points by a different second amount based on a second difference in values defined for the one or more elements of the second subset of data points.

Abstract: Disclosed are three-dimensional (“3D”) graphical user interface (“GUI”) elements for improving user interactions with a digital environment or a device by simplifying access to different data, functionality, and operations of the digital environment or the device. A 3D GUI element may include first visual information at a first position and second visual information at a second position within the 3D space represented by the 3D GUI element. In response to first input directed to the first visual information, the 3D GUI or system may perform a first action that is mapped to the first input and the first visual information within the 3D GUI element. In response to second input directed to the second visual information, the 3D GUI or system may perform a second action that is mapped to the second input and the second visual information within the 3D GUI element.

Abstract: Disclosed is an interface and/or system for presenting three-dimensional (“3D”) graphical user interface (“GUI”) elements to improve user interactions with a device. The system determines a first angle from which to render a 3D GUI. The system receives 3D images that are linked to the 3D GUI elements. The system generates the 3D GUI elements by rendering each of the 3D images from a first render position that aligns with the first angle. The system detects an input that changes the first angle to a second angle, and updates a visualization of the 3D GUI elements by rendering each of the 3D images from a second render position that aligns with the second angle.

Abstract: Disclosed is an imaging system and associated methods for mapping in-focus image data from two-dimensional (“2D”) images of a scene to a three-dimensional (“3D”) model of the scene. The imaging system receives the 2D images and the 3D model, determines the depth of field (“DOF”) and the field of view (“FOV”) for each 2D image, and selects a subset of 3D model constructs that form the FOV and are within the DOF of a particular 2D image. The imaging system determines pixels of the particular 2D image that represent a same set of points in the scene as the subset of 3D model constructs, and maps the visual characteristics from those pixels to non-positional elements of the subset of 3D model constructs.

Abstract: An editing system may dynamically and intelligently determine which data points to remove, replace, and/or modify from a point cloud space so that more features, color information, and/or detail of the point cloud are preserved after decimation. The system may receive data points that are distributed in space, and may select one or more elements of the data points on which to base the decimation. For instance, the system may decimate a first subset of the data points by a first amount based on a first difference in values defined for the one or more elements of the first subset of data points, and may decimate a different second subset of the data points by a different second amount based on a second difference in values defined for the one or more elements of the second subset of data points.

Abstract: Disclosed is a system and associated methods for generating a point-accurate three-dimensional (“3D”) model of a scene with point-accurate color information from a non-cosited capture of the scene. The system may define a first model based on positional measurements obtained from a first device. The system may capture images of the scene with a different set of devices, and may generate a second model from a photogrammetry modeling of the images. The system may align the models in order to determine positioning of the set of devices relative to the first model, and may select a particular device that captures descriptive characteristics from a position in the scene that is represented by the positional elements of a particular data point. The system may define non-positional elements of the particular data point based on the descriptive characteristics captured by the particular device.

Abstract: Disclosed is an imaging system and associated methods for mapping in-focus image data from two-dimensional (“2D”) images of a scene to a three-dimensional (“3D”) model of the scene. The imaging system receives the 2D images and the 3D model, determines the depth of field (“DOF”) and the field of view (“FOV”) for each 2D image, and selects a subset of 3D model constructs that form the FOV and are within the DOF of a particular 2D image. The imaging system determines pixels of the particular 2D image that represent a same set of points in the scene as the subset of 3D model constructs, and maps the visual characteristics from those pixels to non-positional elements of the subset of 3D model constructs.

Abstract: Disclosed is a system and associated methods for generating a point-accurate three-dimensional (“3D”) model of a scene with point-accurate color information from a non-cosited capture of the scene. The system may define a first model based on positional measurements obtained from a first device. The system may capture images of the scene with a different set of devices, and may generate a second model from a photogrammetry modeling of the images. The system may align the models in order to determine positioning of the set of devices relative to the first model, and may select a particular device that captures descriptive characteristics from a position in the scene that is represented by the positional elements of a particular data point. The system may define non-positional elements of the particular data point based on the descriptive characteristics captured by the particular device.

Abstract: Disclosed are three-dimensional (“3D”) graphical user interface (“GUI”) elements for improving user interactions with a digital environment or a device by simplifying access to different data, functionality, and operations of the digital environment or the device. A 3D GUI element may include first visual information at a first position and second visual information at a second position within the 3D space represented by the 3D GUI element. In response to first input directed to the first visual information, the 3D GUI or system may perform a first action that is mapped to the first input and the first visual information within the 3D GUI element. In response to second input directed to the second visual information, the 3D GUI or system may perform a second action that is mapped to the second input and the second visual information within the 3D GUI element.

Abstract: A point cloud capture system is provided to detect and correct data density during point cloud generation. The system obtains data points that are distributed within a space and that collectively represent one or more surfaces of an object, scene, or environment. The system computes the different densities with which the data points are distributed in different regions of the space, and presents an interface with a first representation for a first region of the space in which a first subset of the data points are distributed with a first density, and a second representation for a second region of the space in which a second subset of the data points are distributed with a second density.

Abstract: An image postprocessor enhances the quality and detail of a rendered image by applying a photosite demosaicing technique directly to the pixels stored in the viewport of the rendered image. The image postprocessor detects a first subset of the viewport pixels having color values that deviate by more than a threshold amount from color values of a neighboring second subset of the viewport pixels. The image postprocessor maps the viewport pixels to a set of emulated photosites based on a position of each pixel in the viewport, and demosaics and/or interpolates the color values associated with a subset of the emulated photosites in order to generate new pixels for the gap. The image postprocessor replaces the first subset of pixels in the viewport with the new pixels, and presents a second visualization based on the modified pixels of the viewport.

Abstract: An editing system may dynamically and intelligently determine which data points to remove, replace, and/or modify from a point cloud space so that more features, color information, and/or detail of the point cloud are preserved after decimation. The system may receive data points that are distributed in space, and may select one or more elements of the data points on which to base the decimation. For instance, the system may decimate a first subset of the data points by a first amount based on a first difference in values defined for the one or more elements of the first subset of data points, and may decimate a different second subset of the data points by a different second amount based on a second difference in values defined for the one or more elements of the second subset of data points.

Abstract: A point cloud capture system is provided to detect and correct data density during point cloud generation. The system obtains data points that are distributed within a space and that collectively represent one or more surfaces of an object, scene, or environment. The system computes the different densities with which the data points are distributed in different regions of the space, and presents an interface with a first representation for a first region of the space in which a first subset of the data points are distributed with a first density, and a second representation for a second region of the space in which a second subset of the data points are distributed with a second density.

Abstract: Provided is a multispectral imaging device for providing precise tracking and verification. The imaging device may configure a first filter for a sensor, and may determine first spectral properties of a target object based on a first image of the target object generated from visible light passing through the first filter onto the sensor. The imaging device may configure a different second filter for the sensor, and may determine second spectral properties of the target object based on a second image of the target object generated from the non-visible light passing through the second filter onto the sensor. The imaging device may align the second spectral properties of the second image with the first spectral properties of the first image, and may present the first spectral properties with the second spectral properties in a single composite image of the target object.

Abstract: Provided is a multispectral imaging device for providing precise tracking and verification. The imaging device may configure a first filter for a sensor, and may determine first spectral properties of a target object based on a first image of the target object generated from visible light passing through the first filter onto the sensor. The imaging device may configure a different second filter for the sensor, and may determine second spectral properties of the target object based on a second image of the target object generated from the non-visible light passing through the second filter onto the sensor. The imaging device may align the second spectral properties of the second image with the first spectral properties of the first image, and may present the first spectral properties with the second spectral properties in a single composite image of the target object.

Abstract: Provided is a three-dimensional (“3D”) analysis tool or device for generating visualizations for attributes in different multi-plane slice of a point cloud or 3D image. The device may receive a point cloud with a plurality of data points that are distributed across a plurality of different planes and that collectively produce a 3D image. The device may select a set of the plurality of data points that are located within a particular slice of the point cloud, may generate a visualization from one or more attributes of the set of data points, and may present the visualization of the one or more attributes for the set of data points in a different format than a rendering of the set of data points.

Abstract: Provided is a multispectral imaging device for providing precise tracking and verification. The imaging device may configure a first filter for a sensor, and may determine first spectral properties of a target object based on a first image of the target object generated from visible light passing through the first filter onto the sensor. The imaging device may configure a different second filter for the sensor, and may determine second spectral properties of the target object based on a second image of the target object generated from the non-visible light passing through the second filter onto the sensor. The imaging device may align the second spectral properties of the second image with the first spectral properties of the first image, and may present the first spectral properties with the second spectral properties in a single composite image of the target object.