Abstract: One embodiment of a virtual reality apparatus comprises: a graphics processing engine comprising a plurality of graphics processing stages, the graphics processing engine to render a plurality of image frames for left and right displays of a head mounted display (HMD); and foveation control hardware logic to independently control two or more of the plurality of graphics processing stages based on feedback received from an eye tracking module of the HMD, the feedback indicating a foveated region selected based on a current or anticipated direction of a user's gaze, the foveation control hardware logic to cause the two or more of the graphics processing stages to process the foveated region differently than other regions of the image frames.

Abstract: Systems and methods are provided to perform constrained BSDF sampling in relation to various algorithms, and specifically in relation to ray tracing algorithms. In some embodiments, a method is provided to generate samples by: determining a spherical polygon on a unit hemisphere; determining, on a unit circle, a projected area corresponding to the spherical polygon on the unit hemisphere; determining a parameterization of the projected area of the spherical polygon on the unit circle; generating samples in the projected area based on the parameterization; and generating samples in the spherical polygon. The unit circle is abase of the unit hemisphere, and the projection of the projected area is along a vector perpendicular to the unit circle. The generated samples in the spherical polygon correspond to the samples in the projected area. The method may further include evaluating a rendering equation based on the generated samples in the spherical polygon.

Abstract: A fully-connected neural network may be configured for execution by a processor as a fully-fused neural network by limiting slow global memory accesses to reading and writing inputs to and outputs from the fully-connected neural network. The computational cost of fully-connected neural networks scale quadratically with its width, whereas its memory traffic scales linearly. Modern graphics processing units typically have much greater computational throughput compared with memory bandwidth, so that for narrow, fully-connected neural networks, the linear memory traffic is the bottleneck. The key to improving performance of the fully-connected neural network is to minimize traffic to slow “global” memory (off-chip memory and high-level caches) and to fully utilize fast on-chip memory (low-level caches, “shared” memory, and registers), which is achieved by the fully-fused approach.

Abstract: Interactive systems using adaptive control software and hardware from known and later developed eyepieces to later developed head-wear to lenses, including implantable, temporarily insertable and contact and related film based types of lenses including thin film transparent elements for housing cameras lenses and projector and functional equivalent processing tools. Simple controls, real-time updates and instant feedback allow implicit optimization of a universal model while managing complexity.

Abstract: Methods and systems are disclosed for traversing nodes in a BVH tree by an intersection engine. Techniques disclosed comprise receiving, by the intersection engine, a traversal instruction, including a tracing-mode, ray data, and an identifier of a node to be traversed. Where the tracing-mode includes a closest hit mode and a first hit mode. If the node to be traversed is an internal node, the intersection engine determines, based on the tracing-mode, an order in which children nodes of the node are to be next traversed and output identifiers of the children nodes in the determined order.

Abstract: Apparatus and method for stack throttling.

Abstract: In one embodiment, a computing system may store, by first buffer blocks, texels organized into a texel array including a number of N×N texel sub-arrays. Each texel may fall within a corresponding N×N texel sub-array and may be associated with a two-dimensional sub-array coordinate indicating a position of that texel within the corresponding N×N texel sub-array. Each first buffer block of may be assigned a particular two-dimensional sub-array coordinate and stores a texel subset having the particular two-dimensional sub-array coordinate. The system may receive, by filter blocks, texels from the first buffer blocks. Each filter block may receive a texel from each first buffer block to form a corresponding N×N texel sub-array. The system may perform, by filter blocks, sampling operations parallelly on their respective N×N texel sub-arrays.

Abstract: Methods, systems, and computer readable media for providing an extended reality (XR) user interface. A method for providing an XR user interface occurs at a user device executing an XR application.

Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements for intersection testing. The system defines and updates progress information that identifies, for a ray, leaf nodes of the hierarchical acceleration structure which identify elements for which it is not yet known whether or not the ray interests.

Abstract: A system and method for content creation via interactive layers is provided. A mutable general object on which to build an artefact is stored. The mutable general object includes a plurality of n-dimensional data units capable of being rendered in a multi-dimensional display. An environment represented by the artefact is displayed. The artefact includes layers that each represent a different characteristic of the environment. Each layer includes a generator and layer parameters. A unique identifier is assigned to each layer. The identifiers for the layers of the artefact are composited and the composited identifiers are stored. Upon accessing the composited identifiers, the artefact is reconfigured for display using the generator and layer parameters from each of the layers.

Abstract: The present disclosure relates to an augmented reality system including one or more of a building, sensor(s), a gateway, a server, and a monitoring computer. The augmented reality system may further includes drones that capture video or other images of the building. The monitoring computer gathers information from the sensor(s) and/or drones and facilitates the creation of an augmented view of the building to provide intelligence to emergency responders.

Abstract: A method of rendering a scene formed by primitives in a graphics processing system. For a sequence of primitives, a pipeline fragment shading rate value and a primitive fragment shading rate value for a primitive are combined to produce a combined fragment shading rate value for the primitive. Fragment shading rate data representing the combined fragment shading rate value for the primitive is stored and data identifying the primitive is associated with the fragment shading rate data. For a subsequent primitive, it is determined whether or not a combined fragment shading rate value for the subsequent primitive is the same as for the preceding primitive. If it is the same, data identifying the subsequent primitive is associated with the fragment shading rate data that the data identifying the preceding primitive is associated with.

Abstract: Described herein is a technique for modifying a bounding volume hierarchy. The techniques include combining preferred orientations of child nodes of a first bounding box node to generate a first preferred orientation; based on the first preferred orientation, converting one or more child nodes of the first bounding box node into one or more oriented bounding box nodes; combining preferred orientations of child nodes of a second bounding box node to generate a second preferred orientation; and based on the second preferred orientation, maintaining one or more children of the second bounding box node as non-oriented bounding box nodes.

Abstract: Various disclosed embodiments are directed to estimating that a first vertex of a patch will change from a first position to a second position (the second position being at least partially indicative of secondary motion) based at least in part on one or more features of: primary motion data, one or more material properties, and constraint data associated with the particular patch. Such estimation can be made for some or all of the patches of an entire volumetric mesh in order to accurately predict the overall secondary motion of an object. This, among other functionality described herein resolves the inaccuracies, computer resource consumption, and the user experience of existing technologies.

Abstract: One embodiment of a computer-implemented method for processing data within a fixed-function pipeline included in an execution unit includes receiving a first input from a first processing unit, wherein the first input corresponds to a first fixed-function; executing the first fixed-function on the first input to generate a first output, wherein the first fixed-function is executed on the first input prior to executing the first fixed-function on one or more inputs received from a plurality of processing cores that are processing a plurality of rays, and wherein each ray represents a path from a light source to at least one point within a three-dimensional (3D) environment; and transmitting the first output to the first processing unit for further processing.

Abstract: A method can include accessing volumetric data from a data store, where the volumetric data correspond to a region; generating structured shape information for the region using at least a portion of the volumetric data; and, in response to a command from a client device, transmitting to the client device, via a network interface, a visualization data stream generated using at least a portion of the structured shape information.

Abstract: A system and method enabling per-user-optimized computing, rendering, and provisioning within virtual worlds. The system comprises a server including memory and at least one processor, the memory storing a persistent virtual world system comprising a data structure in which at least one virtual replica of at least one corresponding real object is represented, and a computing optimization platform configured to store and provide rules for optimizing the computing, rendering and data provisioning to users via user devices. A plurality of connected devices connected to the server via a network provide multi-source data, user input, or combinations thereof, to the persistent virtual world system, updating the virtual replicas. The server retrieves user location, viewing position and orientation from the one or more user devices to determine a user interaction radius, thereby optimizing via the computing optimization platform the relevant computing, rendering and provisioning for the one or more user devices.

Abstract: Methods and systems for generating composite images of a patient and models of the patient's dentition are provided. In some embodiments, a method includes generating a plurality of 3D models, each comprising a virtual representation of the patient's dentition at different treatment stages of a treatment plan and obtaining an image of the patient's face and dentition. The method can include projecting the obtained image into a 3D space to create a projected 3D model of the patient's face and dentition. The method can also include generating a plurality of modified images, each representing the patient in a treatment stage of the treatment plan and formed by combining the patient's dentition of one of the 3D models with the patient's face of the projected 3D model. A modified image corresponding to a selected treatment stage and a corresponding 3D model can be provided for display.

Abstract: A computer includes a processor and a memory storing instructions executable by the processor to receive a plurality of first images of an environment in a first lighting condition, classify pixels of the first images into categories, mask the pixels belonging to at least one of the categories from the first images, generate a three-dimensional representation of the environment based on the masked first images, and generate a second image of the environment in a second lighting condition based on the three-dimensional representation and on a first one of the first images.

Abstract: Systems and methods for planning delivery of an object via a catheter, such as transseptal delivery of a prosthetic mitral valve to a patient's heart are disclosed.