Abstract: Systems and methods applicable, for instance, to using continuous levels of detail (CLODs) in connection with computer graphic models. Distinct levels of detail (LODs) can be generated, floating point LOD (fLOD) values can be calculated, and interpolated LODs can be generated. Further, LOD display can occur.

Abstract: A curve sampling technique for generating transformed digital visual content is leveraged in a digital medium environment. Initially, a curve sampling system obtains digital visual content, e.g., images and videos. The curve sampling system generates transformed digital visual content by transforming one or more pixels of the digital visual content using a lookup table that is derived from samples of a curve taken at evenly spaced intervals along a y-axis of a graph of the curve. Broadly speaking, the curve defines how to transform a visual characteristic of the pixels in order to achieve a desired digital visual content transformation. Additionally, the curve sampling may correspond to one step in a series of steps for transforming colors of digital visual content. Indeed, such transformations may involve multiple curve sampling steps.

Abstract: Visually seamless grafting of volumetric data. In some implementations, a method includes obtaining volumetric data that represents a first volume including one or more three-dimensional objects. Planar slices of the first volume are determined and for each planar slice, a result region and an outer region are determined, the outer region located between the result region and an edge of the planar slice. A target region is determined within the result region and adjacent to an edge of the result region. The result region is modified by updating source voxels in the target region based on corresponding continuity voxels in the outer region, and the updating is weighted based on a distance of each source voxel from an associated edge of the result region. The modified result regions are grafted to a second volume at the edge of the result regions to provide a grafted volume.

Abstract: A method for monitoring and visualizing a patient's medical condition, wherein a graphical representation of the patient comprising a body having at least a torso and a head, as well as particularly two legs and two arms, is displayed using a display device, wherein said displayed graphical representation comprises at least one region which is allocated to at least one or several provided (e.g. measured and/or determined) patient monitoring quantities, and wherein the appearance of the at least one region is altered in real-time when the at least one patient monitoring quantity to which said at least one region is allocated changes.

Abstract: A technique for performing ray tracing operations is provided. The technique includes processing small bounding box nodes in a box intersection test circuit to generate intersection test results for the small bounding box nodes; and processing large bounding box nodes in the box intersection test circuit to generate intersection test results for the large bounding box nodes.

Abstract: An encoder encodes three-dimensional (3D) volumetric content, such as immersive media, using video encoded attribute patch images packed into a 2D atlas to communicate the attribute values for the 3D volumetric content. The encoder also uses mesh-encoded sub-meshes to communicate geometry information for portions of the 3D object or scene corresponding to the attribute patch images packed into the 2D atlas. The encoder applies decimation operations to the sub-meshes to simplify the sub-meshes before mesh encoding the sub-meshes. A distortion analysis is performed to bound the level to which the sub-meshes are simplified at the encoder. Mesh simplification at the encoder reduces the number of vertices and edges included in the sub-meshes which simplifies rendering at a decoder receiving the encoded 3D volumetric content.

Abstract: Embodiments are disclosed for computing accurate smooth occluding contours. In one embodiment, a method of computing accurate smooth occluding contours includes projecting a boundary polygon associated with a first region of a three-dimensional (3D) object to a two-dimensional (2D) image plane, the boundary polygon comprising a plurality of contour vertices and edges connecting the plurality of contour vertices, triangulating the first region in the 2D image plane to generate a 2D triangulation, and generating a 3D mesh for the first region by mapping the 2D triangulation to the 3D object.

Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.

Abstract: An apparatus includes a cable having two ends and at least two object markers coupled to the cable configured to enable augmented reality (AR) detection of each end of the cable among a plurality of cables. A computer-implemented method using augmented reality (AR) technology includes selecting a cable of interest and identifying an object marker positioned toward a first end of the cable of interest. The method also includes storing the object marker, scanning a plurality of cables, and identifying a second end of the cable of interest based an instance of the object marker positioned toward the second end of the cable of interest. A computer program product for detecting ends of cables using augmented reality (AR) technology includes a computer readable storage medium having program instructions embodied therewith. The program instructions are executable by a computer to cause the computer to perform the foregoing method.

Abstract: Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Abstract: The consistent use of lighting in different instances of digital media may help ensure that objects are depicted in a similar manner in the digital media. However, in some cases, a three-dimensional (3D) model may depict an object under lighting conditions that differ from the lighting conditions depicted in other digital media. The present disclosure provides systems and methods for generating 3D models to include lighting that is consistent with the lighting used in other digital media. According to an embodiment, a lighting template is determined based on digital media depicting a first physical object. A modified 3D model of a second physical object is then generated based on the lighting template to light the second physical object according to the lighting template.

Abstract: Techniques for determining a swept volume of an object moving along a trajectory in a 3D space are disclosed. In some examples, a computer graphics application accesses a representation of the object, such as the signed distance field (SDF), and the trajectory information describing the movement path in the 3D space over a time period. The 3D space is represented using a grid of voxels each having multiple vertices. The computer graphics application determines the swept volume of the object in the 3D space by evaluating a subset of the grid of voxels (e.g., the voxels surrounding the surface of the swept volume). The number of voxels in the subset of voxels is less than the number of voxels in the grid of voxels. The computer graphics application further generates a representation of the swept volume surface for output.

Abstract: Aspects of the present invention relate to providing assistance to medical professionals during the performance of medical procedures through the use of technologies facilitated through a head-worn computer.

Abstract: Disclosed approaches provide for irradiance caches which may be used to share irradiance between ray interactions spatially and/or temporally. An irradiance cache may store incoming irradiance or outgoing irradiance and may be updated by casting one or more rays from one or more locations to sample irradiance for the location(s). The number of rays that are cast may be reduced by ranking the locations, irradiance caches, and/or corresponding groups of geometry based on one or more characteristics thereof. For example, a ranking score may be computed based on camera distance, camera visibility, and/or a number of frames since a prior update. When sampling a location, outgoing irradiance from an outgoing irradiance cache may be used to determine shading when a hit distance of a ray used to generate the sample exceeds a threshold value.

Abstract: In one implementation, a method of blind object tracking is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a first three-dimensional scene model of a physical environment during a first time period including a first plurality of points, wherein each of the first plurality of points is associated with a set of coordinates in a three-dimensional space, wherein a subset of the first plurality of points is associated with a particular cluster identifier. The method includes obtaining a second three-dimensional scene model of the physical environment during a second time period subsequent to the first time period including a second plurality of points, wherein each of the second plurality of points is associated with a set of coordinates the three-dimensional space.

Abstract: Graphics processing renders a scene with a plurality of different rendering parameters for different locations on a screen area. Each primitive of a batch of primitives belonging to an object covering at least two of the zones of the screen area is assembled to a screen space. Assembling each of the primitives includes iterating each primitive with a primitive assembler for each of the zones covered by the object. Each said zone is associated with a different set of screen space transform parameters used to transform locations of vertices in the batch of primitives from a homogenous coordinate space to a screen space that is not flat. The zones are arranged to minimize an overlap between zones.

Abstract: A first image can be processed through a neural network. The first image can cause each first hidden node to assume a first state. A second image can be accessed along with a region-of-interest (ROI) for the second image. At least some of the first hidden nodes can be frozen based on the ROI. At least some of the first hidden nodes can be kept fluid based on the ROI. The second image can be processed through the neural network. The fluid first hidden nodes can assume second states. The frozen first hidden nodes can remain in the first state.

Abstract: Systems and methods automatically generate contours on an illustrated object for performing an animation. Contour lines are generated on the surface of the object according to criteria related to the shape of the surface of the object. Points of the contour lines that are occluded from a virtual camera are identified. The occluded points are removed to generate visible lines. The visible lines are extruded to define a three-dimensional volume defining contours of the object. The object itself, along with the three-dimensional volume, are illuminated and rendered. The parameters defining the opacity and color of the contour may differ from corresponding parameters of the rest of the object, so that the contours stand out and define portions of the object. The contours are useful in contexts such as defining areas of an object that is fuzzy or cloudy in appearance, as well as creating certain artistic effects.

Abstract: A system and method for three-dimensional (3D) microgeometry and reflectance modeling is provided. The system receives images comprising a first set of images of a face and a second set of images of the face. The faces in the first set of images and the second set of images are exposed to omni-directional lighting and directional lighting, respectively. The system generates a 3D face mesh based on the received images and executes a set of skin-reflectance modeling operations by using the generated 3D face mesh and the second set of images, to estimate a set of texture maps for the face. Based on the estimated set of texture maps, the system texturizes the generated 3D face mesh. The texturization includes an operation in which texture information, including microgeometry skin details and skin reflectance details, of the estimated set of texture maps is mapped onto the generated 3D face mesh.

Abstract: Systems and methods for generating a map. The methods comprise: performing, by a computing device, ray-casting operations to generate a 3D point cloud with a reduced number of data points associated with moving objects; generating, by the computing device, a 2D binary mask for at least one semantic label class of the 3D point cloud; determining, by the computing device, x-coordinates and y-coordinates for a 2D volume defining an object of the at least one semantic label class; identifying, by the computing device, data points in the 3D point cloud based on the 2D volume; comparing, by the computing device, z-coordinates of the identified data points to at least one threshold value selected for the at least one semantic label class; and generating, by the computing device, the map by removing data points from the 3D point cloud based on results of the comparing.