Abstract: A GPU includes shader cores and a shader warp packer unit. The shader warp packer unit may receive a first primitive associated with a first partially covered quad, and a second primitive associated with a second partially covered quad. The shader warp packer unit may determine that the first partially covered quad and the second partially covered quad have non-overlapping coverage. The shader warp packer unit may pack the first partially covered quad and the second partially covered quad into a packed quad. The shader warp packer unit may send the packed quad to the shader cores. The first partially covered quad and the second partially covered quad may be spatially disjoint from each other. The shader cores may receive and process the packed quad with no loss of information relative to the shader cores individually processing the first partially covered quad and the second partially covered quad.

Abstract: Graphics processing systems can include lighting effects when rendering images. “Light probes” are directional representations of lighting at particular probe positions in the space of a scene which is being rendered. Light probes can be determined iteratively, which can allow them to be determined dynamically, in real-time over a sequence of frames. Once the light probes have been determined for a frame then the lighting at a pixel can be determined based on the lighting at the nearby light probe positions. Pixels can then be shaded based on the lighting determined for the pixel positions.

Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned geometry model can predict one or more adjusted depths for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.

Abstract: A graphics rendering system is disclosed for generating and streaming graphics data of a 3D environment from a server for rendering on a client in 2.5D. 2D textures can be transmitted in advance of frames showing the textures. Data transmitted for each frame can include 2D vertex positions of 2D meshes and depth data. The 2D vertex positions can be positions on a 2D projection as seen from a viewpoint within the 3D environment. Data for each frame can include changes to vertex positions and/or depth data. A prediction system can be used to predict when new objects will be displayed, and textures of those new objects can be transmitted in advance.

Abstract: Examples are described here that can be used to allocate commands from multiple sources to performance by one or more segments of a processing device. For example, a processing device can be segmented into multiple portions and each portion is allocated to process commands from a particular source. In the event a single source provides commands, the entire processing device (all segments) can be allocated to process commands from the single source. When a second source provides commands, some segments can be allocated to perform commands from the first source and other segments can be allocated to perform commands from the second source. Accordingly, commands from multiple applications can be executed by a processing unit at the same time.

Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system iteratively obtains ray requests, each of which identifies a ray and a node against which the ray is to be tested, and performs intersection testing based on the ray requests. The number of ray requests obtained in each iteration reduces responsive to an amount of memory occupied by information relating to the rays (undergoing intersection testing) increasing.

Abstract: A GPU includes shader cores and a shader warp packer unit. The shader warp packer unit may receive a first primitive associated with a first partially covered quad, and a second primitive associated with a second partially covered quad. The shader warp packer unit may determine that the first partially covered quad and the second partially covered quad have non-overlapping coverage. The shader warp packer unit may pack the first partially covered quad and the second partially covered quad into a packed quad. The shader warp packer unit may send the packed quad to the shader cores. The first partially covered quad and the second partially covered quad may be spatially disjoint from each other. The shader cores may receive and process the packed quad with no loss of information relative to the shader cores individually processing the first partially covered quad and the second partially covered quad.

Abstract: A device corrects an indirect lighting color in response to changes in a vehicle interior finishing material. An input unit of the device receives a finishing material color of a vehicle interior and a target indirect lighting color. A light source control map of the device includes light source control signals of indirect lighting based on finishing material colors and target indirect lighting colors. A controller of the device generates a light source control signal according to the finishing material color and the target indirect lighting color input to the input unit from the light source control map. The controller also corrects the color of a light source of control target indirect lighting by the generated light source control signal.

Abstract: In one embodiment, a method includes reconstructing a three-dimensional shape of a target object, creating a two-dimensional normal map for the three-dimensional shape of the target object, accessing image data and depth data associated with the target object, generating a first normal data associated with the target object using the image data and the depth data, updating the normal map using the first normal data, and re-rendering the three-dimensional shape of the target object based on the updated normal map.

Abstract: A method of rasterising a line in computer graphics determines whether the line's start and/or end is inside a diamond test area within the pixel. If the end is not inside and the start is inside, the pixel is drawn as part of the line. If neither the start nor the end of the line are inside, it is determined whether the line crosses more than one extended diamond edge and if so, it is further determined (i) whether an extended line passing through the start and end is substantially vertical and touches the right point of the diamond area, (ii) if the extended line touches the bottom point of the diamond area, and (iii) whether the extended line is on a same side of each point of the diamond area. If any of (i), (ii) and (iii) is positive, the pixel is drawn as part of the line.

Abstract: One embodiment of a computer-implemented method for processing ray tracing operations in parallel includes receiving a plurality of rays and a corresponding set of importance sampling instructions for each ray included in the plurality of rays for processing, wherein each ray represents a path from a light source to at least one point within a three-dimensional (3D) environment, and each corresponding set of importance sampling instruction is based at least in part on one or more material properties associated with at least one surface of at least one object included in the 3D environment; assigning each ray included in the plurality of rays to a different processing core included in a plurality of processing cores; and for each ray included in the plurality of rays, causing the processing core assigned to the ray to execute the corresponding set of importance sampling instructions on the ray to generate a direction for a secondary ray that is produced when the ray intersects a surface of an object within the

Abstract: Provided is a 360-degree image data processing method performed by a 360-degree video reception apparatus. The method includes receiving 360-degree image data, obtaining information on an encoded picture and metadata from the 360-degree image data, decoding a picture based on the information on the encoded picture, rendering the decoded picture and an overlay based on the metadata, in which the metadata includes overlay related metadata, the overlay is rendered based on the overlay related metadata, the overlay related metadata includes information on an alpha plane of the overlay, and the information on the alpha plane of the overlay is included in a image item or a video track.

Abstract: Implementations generally perform pose reconstruction by tracking for video analysis. In some implementations, a method includes obtaining a plurality of videos of at least one subject performing at least one action in an environment. The method further includes tracking the at least one subject across at least two cameras. The method further includes reconstructing a 3-dimensional (3D) model of the at least one subject based on the plurality of videos and the tracking of the at least one subject.

Abstract: Methods and systems are provided for performing material capture to determine properties of an imaged surface. A plurality of images can be received depicting a material surface. The plurality of images can be calibrated to align corresponding pixels of the images and determine reflectance information for at least a portion of the aligned pixels. After calibration, a set of reference materials from a material library can be selected using the calibrated images. The set of reference materials can be used to determine a material model that accurately represents properties of the material surface.

Abstract: Graphics processing systems and methods provide soft shadowing effects into rendered images. This is achieved in a simple manner which can be implemented in real-time without incurring high processing costs so it is suitable for implementation in low-cost devices. Rays are cast from positions on visible surfaces corresponding to pixel positions towards the center of a light, and occlusions of the rays are determined. The results of these determinations are used to apply soft shadows to the rendered pixel values.

Abstract: A tessellation method uses vertex tessellation factors. For a quad patch, the method involves comparing the vertex tessellation factors for each vertex of the quad patch to a threshold value and if none exceed the threshold, the quad is sub-divided into two or four triangles. If at least one of the four vertex tessellation factors exceeds the threshold, a recursive or iterative method is used which considers each vertex of the quad patch and determines how to further tessellate the patch dependent upon the value of the vertex tessellation factor of the selected vertex or dependent upon values of the vertex tessellation factors of the selected vertex and a neighbor vertex. A similar method is described for a triangle patch.

Abstract: The present invention relates to a medical image processing apparatus and a medical image processing method for a medical navigation device, and more particularly, to an apparatus and method for processing an image provided when using the medical navigation device. To this end, the present invention provides a medical image processing apparatus for a medical navigation device, including: a position tracking unit configured to obtain position information of the medical navigation device within an object; a memory configured to store medical image data generated based on a medical image of the object; and a processor configured to set a region of interest (ROI) based on position information of the medical navigation device in reference to the medical image data, and generate partial medical image data corresponding to the ROI, and a medical image processing method using the same.

Abstract: One embodiment of a method for computing a texture color includes tracing a ray cone through a graphics scene, determining at least one axis of an ellipse formed by the ray cone intersecting a plane associated with geometry within the graphics scene at a hit point, computing one or more gradients along the at least one axis of the ellipse, and computing a texture color based on the one or more gradients and a texture.

Abstract: An apparatus for processing a neural network comprises an image memory into which an input image is written tile-by-tile, each tile overlapping a previous tile to a limited extent; a weights memory for storing weight information for a plurality of convolutional layers of a neural network, including at least two pooling layers; and a layer processing engine configured to combine information from the image and weights memories to generate an output map and to write the output map to image memory. The apparatus is configured to store a limited number of values from adjacent a boundary of an output map for a given layer. The layer processing engine is configured to combine the output map values from a previously processed image tile with the information from the image memory and the weights when generating an output map for a layer of the neural network following the given layer.

Abstract: Apparatus and method for efficient BVH construction. For example, one embodiment of an apparatus comprises: a memory to store graphics data for a scene including a plurality of primitives in a scene at a first precision; a geometry quantizer to read vertices of the primitives at the first precision and to adaptively quantize the vertices of the primitives to a second precision associated with a first local coordinate grid of a first BVH node positioned within a global coordinate grid, the second precision lower than the first precision; a BVH builder to determine coordinates of child nodes of the first BVH node by performing non-spatial-split binning or spatial-split binning for the first BVH node using primitives associated with the first BVH node, the BVH builder to determine final coordinates for the child nodes based, at least in part, on an evaluation of surface areas of different bounding boxes generated for each of the child node.

Abstract: This technology relates to rendering content from discrete applications. In this regard, one or more computing devices may receive a global scene graph containing resources provided by two or more discrete processes, wherein the global scene graph is instantiated by a first process of the two or more discrete processes. The one or more computing devices may render and output for display, the global scene graph in accordance with the resources contained there.

Abstract: Apparatus and method for processing motion blur operations. For example, one embodiment of a graphics processing apparatus comprises: a bounding volume hierarchy (BVH) generator to build a BVH comprising hierarchically-arranged BVH nodes based on input primitives, at least one BVH node comprising one or more child nodes; and motion blur processing hardware logic to determine motion values for a quantization grid based on motion values of the one or more child nodes of the at least one BVH node and to map linear bounds of each of the child nodes to the quantization grid.

Abstract: Examples are disclosed that relate to image reprojection. One example provides a method, comprising receiving a first rendered image comprising content associated with a viewer reference frame, receiving a second rendered image comprising content associated with a manipulator reference frame, and reprojecting the first rendered image based on a head pose of a user to thereby produce a first reprojected image. The method further comprises reprojecting the second rendered image based on the head pose of the user and a pose of the manipulator to thereby produce a second reprojected image, and outputting the first reprojected image and the second reprojected image for display as a composited image.

Abstract: Introduced here are techniques for relighting an image by automatically segmenting a human object in an image. The segmented image is input to an encoder that transforms it into a feature space. The feature space is concatenated with coefficients of a target illumination for the image and input to an albedo decoder and a light transport detector to predict an albedo map and a light transport matrix, respectively. In addition, the output of the encoder is concatenated with outputs of residual parts of each decoder and fed to a light coefficients block, which predicts coefficients of the illumination for the image. The light transport matrix and predicted illumination coefficients are multiplied to obtain a shading map that can sharpen details of the image. Scaling the resulting image by the albedo map to produce the relight image. The relight image can be refined to denoise the relight image.

Abstract: A vehicle is provided and includes an image acquisition device and an image processing apparatus that receives an original frame for an image obtained by the image acquisition device at a set time interval in the parking state and obtains a key frame having the same pixel with each other by comparing a plurality of original frames received at the set time interval. The image processing apparatus obtains a plurality of delta frames having pixels different from the reference original frame from remaining original frames by comparing each of the reference original frame and the remaining original frames among the plurality of frames and compresses the key frame and the plurality of delta frames, respectively. A storage device stores the key frame and a plurality of delta frames compressed by the image processing apparatus.

Abstract: Systems and methods interacting with tabletop models are provided herein. A display system includes a tabletop model, including a horizontal display that is configured to display a two-dimensional digital map and a three-dimensional physical model that is configured to overlay the two-dimensional digital map. The display receives a selection of an object from a device of a display system and synchronizes a change to the tabletop model and the three-dimensional digital model that reflects the selection of the object.

Abstract: The various embodiments of the invention relates to a method and a technical equipment for video compression. The method comprises processing volumetric image data comprising a plurality of points; defining a hemisphere (601) around a surface (602) normal at each point in the volumetric image; partitioning each of the defined hemispheres spatially into a predefined number of angles (603); determining a representative radiance value for each angle of the predefined number of angles (603) of a defined hemisphere (601); generating a matrix (610) for a point storing the determined representative radiance values; and encoding the generated matrix (610) for the point for video compression.

Abstract: A method of projecting digital information on a real object in a real environment includes the steps of projecting digital information on a real object or part of a real object with a visible light projector, capturing at least one image of the real object with the projected digital information using a camera, providing a depth sensor registered with the camera, the depth sensor capturing depth data of the real object or part of the real object, and calculating a spatial transformation between the visible light projector and the real object based on the at least one image and the depth data. The invention is also concerned with a corresponding system.

Abstract: A hybrid rendering HMI terminal device (32) is provided with a web browser (321) and an HMI Web Runtime (322). The web browser (321) displays an HMI screen on which a first part and a second part that represent the state of a monitoring target device (7) are arranged. When signal data from the monitoring target device (7) is analog numerical data, a WebGL rendering processing unit (322i) renders the first part associated with the signal data by WebGL rendering. When signal data from the monitoring target device (7) is data other than analog numerical data, an SVG rendering processing unit (322h) renders the second part associated with the signal data by SVG rendering.

Abstract: A method and system for data transformation based on machine learning is disclosed. The method includes generating a matrix for a plurality of input vectors based on a machine learning model. The method further includes comparing for each of the plurality of input vectors, the intent value in the matrix with a predefined intent threshold, wherein, for an intent value below the predefined intent threshold, an associated function is unavailable. The method further includes determining a first set of vectors from the plurality of input vectors based on the comparing, wherein for each input vector in the first set, the associated intent value is below the predefined intent threshold. The method further includes mapping, by the data transformation device, each input vector in the first set with an intent value above the predefined intent threshold and an associated function.

Abstract: A method of rendering an image of an environment is disclosed. Environment data for the environment is accessed. The environment data corresponds to a frame of a video. A plurality of subframes associated with the frame is determined. An angle for each of the plurality of subframes is determined. One or more lights corresponding to the environment are selected. For each light of the one or more lights, a shadow map is generated. The shadow map corresponds to a subframe of the plurality of subframes based on a frustum view oriented at the angle determined for the subframe. The image of the environment is rendered. The rendering includes using the generated shadow map for each light of the one or more lights.

Abstract: Systems and methods of the present disclosure enable automated roof planning using a processor. The processor receives a digital image of a roof of a structure and models each roof plane of the roof to generate a roof model. The processor determines dimensions of each roof plane based on the roof model. The processor retrieves roofing accessory data from a database, the roofing accessory data solar roofing accessory part identifiers and solar roofing accessory part performance characteristics for solar roofing accessories. The processor simulates multiple candidate roof layouts based on the dimensions of each roof plan and the solar roofing accessory parts and determines a utilization prediction for each candidate layout. Based on each utilization prediction, the processor determines a particular roof layout having selected solar roofing accessory parts, and generates a solar roof design, including a list of materials, for the particular roof layout.

Abstract: A system for performing a raytracing process, the system comprising a bounding volume hierarchy, BVH, identification unit operable to identify a BVH structure for use in generating images of a virtual environment, the BVH structure comprising information about one or more surfaces within the virtual environment, a BVH selection unit operable to discard one or more elements of the BVH structure in dependence upon a direction of an incident ray, and a raytracing unit operable to perform a raytracing process using the remaining BVH elements.

Abstract: An illustrative shader construction system accesses a plurality of instructions based on a shader construction request. The plurality of instructions is associated with a shader component indicated in the shader construction request and includes a first instruction that relates to a selected platform indicated in the shader construction request and a second instruction that relates to a non-selected platform and that is incompatible with the selected platform. The shader construction system assembles a shader based on the plurality of instructions. The assembled shader is configured for use with the selected platform to perform a shader function implemented by the shader component. The shader construction system provides the assembled shader to a graphics rendering system configured to use the assembled shader to perform the shader function as part of rendering an image. Corresponding methods and systems are also disclosed.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for generating enriched light sources by utilizing surface-centric representations of three-dimensional surfaces. Specifically, the disclosed system utilizes a surface-centric re-parameterization that combines geometric and algebraic components of a sphere to model different light source types in a continuous range of lighting configurations. The disclosed systems utilize a set of intuitive parameters to determine a shape and emission parameters for generating an enriched light source. Additionally, the disclosed system provides a set of interactive light source controls to modify a position, orientation, shape, emittance, and lighting attenuation over distance of a light source within a three-dimensional environment. The disclosed system determines the light source controls based on sets of three-dimensional interaction primitives to control one or more parameters of the light source.

Abstract: A method and intersection testing module in a ray tracing system for determining whether a ray intersects a 3D axis-aligned box that represents a volume defined by a front-facing plane and a back-facing plane for each dimension. Scaled inverse ray components are determined and a scaled minimum culling distance is determined using a result of multiplying an unscaled minimum culling distance for the ray by a predetermined magnitude. Scaled intersection distances to the planes defining the box are determined using scaled inverse ray components. The largest of the determined scaled intersection distances to a front-facing plane of the box is identified. The smallest of the determined scaled intersection distances to a back-facing plane of the box is identified. It is determined that the ray intersects the box if all of three determinations are satisfied, and it is determined that the ray misses the box if one or more of the three determinations are not satisfied.

Abstract: Appearance driven automatic three-dimensional (3D) modeling enables optimization of a 3D model comprising the shape and appearance of a particular 3D scene or object. Triangle meshes and shading models may be jointly optimized to match the appearance of a reference 3D model based on reference images of the reference 3D model. Compared with the reference 3D model, the optimized 3D model is a lower resolution 3D model that can be rendered in less time. More specifically, the optimized 3D model may include fewer geometric primitives compared with the reference 3D model. In contrast with the conventional inverse rendering or analysis-by-synthesis modeling tools, the shape and appearance representations of the 3D model are automatically generated that, when rendered, match the reference images.

Abstract: Data objects of a geospatial data set are arranged in a low-discrepancy sequence spanning over a pre-defined interval, and assigned to N computing units based on in which sub-interval within the pre-defined interval the point, to which the data object belongs, falls. A subset of the data objects that have been distributed over the N computing units is subjected to processing operations by computer readable instructions loaded on each of the N computing units.

Abstract: The disclosure relates to a method for processing an image. The method includes: obtaining a colorized image of a light-receiving object in a current scene; obtaining a target position of the light-receiving object in a camera coordinate system based on a current position of the light-receiving object in an image coordinate system of the current scene; obtaining a lighting-color map of the imaging device; and obtaining a lighting image of the light-receiving object by processing the colorized image based on the target position and the lighting-color map of the imaging device.

Abstract: A system and method of operation of a computing system comprising: receiving a current location; determining a travel path based on the current location; determining a directionality along the travel path while in a free drive navigation mode; predicting a connectivity area based on the directionality; generating map information for a connectivity segment in the connectivity area with a low connectivity; and communicating the map information for storing onto a device for displaying when the connectivity segment is at a surrounding geographic adjacent area relative to the current location and while in the free drive navigation mode.

Abstract: Systems, methods, and non-transitory computer-readable media can receive a first set of static lighting information associated with a first static lighting setup and a second set of static lighting information associated with a second static lighting setup. The first set of static lighting information and the second set of static lighting information are associated with a scene to be rendered. A first set of global illumination information is precomputed based on the first set of static lighting information. A second set of global illumination information is precomputed based on the second set of static lighting information. The first and second sets of global illumination information are blended to derive a blended set of global illumination information. The scene is rendered in a real-time application based on the blended set of global illumination information.

Abstract: An embodiment of a parallel processor apparatus may include a sample pattern selector to select a sample pattern for a pixel, and a sample pattern subset selector communicatively coupled to the sample pattern selector to select a first subset of the sample pattern for the pixel corresponding to a left eye display frame and to select a second subset of the sample pattern for the pixel corresponding to a right eye display frame, wherein the second subset is different from the first subset. Other embodiments are disclosed and claimed.

Abstract: An illumination rendering method and apparatus includes obtaining a first picture at a target viewing angle from a virtual three-dimensional (3D) scene. The first picture includes a virtual object to be subject to illumination rendering in the virtual 3D scene at the target viewing angle. A target virtual light source point set is determined that performs illumination rendering on the virtual object in the first picture. Illumination rendering is performed on the virtual object in the first picture by using the target virtual light source point set. This illumination rendering improves efficiency in rendering on the virtual object in the virtual 3D scene.

Abstract: Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within a virtual environment. Various methods for efficient modeling, rendering, and shading are disclosed herein.

Abstract: In one embodiment, a computing system may update a first 3D model of a region of an environment based on comparisons between the first 3D model and first depth measurements of the region generated during a first time period. The computing system may determine that the region is static by comparing the first 3D model to second depth measurements of the region generated during a second time period. The computing system may in response to determining that the region is static, detect whether the region changed after the second time period based on comparisons between a second 3D model of the region and third depth measurements of the region generated after the second time period, the second 3D model having a lower resolution than the first 3D model. The computing system may in response to detecting a change in the region, update the first 3D model of the region.

Abstract: Example implementations relate to emulating 3D texture patterns in a printer system. One example implementation determines a 3D texture pattern data having a number of pattern pixels at different heights and associated with respective surfaces of a corresponding 3D texture pattern. Luminance change data is determined for each pattern pixel depending on an angle between a normal vector of the respective surface and a simulated light vector. Image data is obtained having a number of image pixels and the luminance of each image pixel is adjusted depending on the luminance change data of a corresponding pattern pixel in order to generate an image with an emulated 3D texture pattern.

Abstract: Rendering system combines point sampling and volume sampling operations to produce rendering outputs. For example, to determine color information for a surface location in a 3-D scene, one or more point sampling operations are conducted in a volume around the surface location, and one or more sampling operations of volumetric light transport data are performed farther from the surface location. A transition zone between point sampling and volume sampling can be provided, in which both point and volume sampling operations are conducted. Data obtained from point and volume sampling operations can be blended in determining color information for the surface location. For example, point samples are obtained by tracing a ray for each point sample, to identify an intersection between another surface and the ray, to be shaded, and volume samples are obtained from a nested 3-D grids of volume elements expressing light transport data at different levels of granularity.

Abstract: Systems and methods of geometry processing, for rasterization and ray tracing processes provide for pre-processing of source geometry, such as by tessellating or other procedural modification of source geometry, to produce final geometry on which a rendering will be based. An acceleration structure (or portion thereof) for use during ray tracing is defined based on the final geometry. Only coarse-grained elements of the acceleration structure may be produced or retained, and a fine-grained structure within a particular coarse-grained element may be Produced in response to a collection of rays being ready for traversal within the coarse grained element. Final geometry can be recreated in response to demand from a rasterization engine, and from ray intersection units that require such geometry for intersection testing with primitives. Geometry at different resolutions can be generated to respond to demands from different rendering components.

Abstract: Disclosed herein is a web-based videoconference system that allows for video avatars to navigate within a virtual environment. Various methods for efficient modeling, rendering, and shading are disclosed herein.

Abstract: An apparatus to facilitate compute optimization is disclosed. The apparatus includes one or more processing units to provide a first set of shader operations associated with a shader stage of a graphics pipeline, a scheduler to schedule shader threads for processing, and a field-programmable gate array (FPGA) dynamically configured to provide a second set of shader operations associated with the shader stage of the graphics pipeline.