Lighting/shading Patents (Class 345/426)
  • Patent number: 11908063
    Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: February 20, 2024
    Assignee: ADOBE INC.
    Inventors: Theo Thonat, Xin Sun, Tamy Boubekeur, Nathan Carr, Francois Beaune
  • Patent number: 11908079
    Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for variable rate tessellation. A graphics processor may receive data for geometry processing of a plurality of patches in a draw call. The graphics processor may reduce a tessellation factor of each of the plurality of patches based on a property of each of the plurality of patches. The reduced tessellation factor may correspond to a TRF. The property may correspond to a shading rate or a number of visible pixels. The graphics processor may apply the TRF for each of the plurality of patches. The graphics processor may render each of the plurality of patches based on the applied TRF for each of the plurality of patches.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: February 20, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Renju Boben, Kalyan Kumar Bhiravabhatla, Vishwanath Shashikant Nikam, Suvam Chatterjee, Ankit Kumar Singh, Abhishek Lal, Sampathkumar Periasamy
  • Patent number: 11908062
    Abstract: A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: February 20, 2024
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventor: Bo Li
  • Patent number: 11910095
    Abstract: In an information processing apparatus, a captured image acquiring section acquires data of an image captured of a reference object while part of incident light applied thereto is being blocked. An incident light information acquiring section acquires, according to a predetermined model equation, a brightness distribution of partial incident light in each of light-blocked states on the basis of the image of the reference object, and acquires a brightness distribution of overall incident light by calculating brightness distributions of partial incident light. A target information acquiring section acquires the shape and material of a target by using the brightness distribution of overall incident light.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: February 20, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Takayuki Ishida, Shinya Wada
  • Patent number: 11906906
    Abstract: Disclosed is a method of metrology comprising using measurement illumination to measure a target, said measurement illumination comprising a plurality of illumination conditions. The method comprises performing a first measurement capture with a first subset of said plurality of illumination conditions, e.g., each comprising a positive weighting, to obtain a first parameter value and performing a second measurement capture with a second subset of said plurality of illumination conditions, e.g., each comprising a negative weighting, to obtain a second parameter value. An optimized parameter value is determined as a weighted combination of at least the first parameter value and the second parameter value.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: February 20, 2024
    Assignee: ASML Netherlands B.V.
    Inventors: Sebastianus Adrianus Goorden, Simon Reinald Huisman, Arjan Johannes Anton Beukman
  • Patent number: 11900498
    Abstract: Apparatus and method for stable and short latency sorting.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: February 13, 2024
    Assignee: Intel Corporation
    Inventors: Saikat Mandal, Prasoonkumar Surti, Sven Woop
  • Patent number: 11892632
    Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: February 6, 2024
    Assignee: APPLE INC.
    Inventors: Anselm Grundhoefer, Michael J. Rockwell
  • Patent number: 11893221
    Abstract: A method for generating a texture shader is described. A user interface for editing the texture shader is displayed. The texture shader has a plurality of parameters that affect rendering characteristics of the texture shader. Displaying includes displaying a widget for at least one parameter of the plurality of parameters, and applying the texture shader to an input image using current values of the plurality of parameters to generate a preview of the texture shader. A user input that changes a value of a parameter of the at least one parameter is received via at least one widget. The texture shader is applied to the input image using the changed value of the parameter to generate the preview of the texture shader. The preview of the texture shader applied to the input image is displayed.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: February 6, 2024
    Assignee: Lemon Inc.
    Inventors: Kexin Lin, Qianyi Li
  • Patent number: 11893917
    Abstract: An apparatus and method is provided including: modulating or modifying light output by one or more light sources, wherein the light output is for use in rendering content in a first direction using a display, wherein the display has at least one curved portion, wherein the modulating or modifying of the light output by the one or more light sources modulates or modifies said light within said at least one curved portion such that said content is rendered in the first direction.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: February 6, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Nicholas Jeffers, Ian Davis, Akshat Agarwal, Diarmuid O'Connell, Oliver Burns
  • Patent number: 11887244
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements for intersection testing. The system defines and updates progress information that identifies, for a ray, leaf nodes of the hierarchical acceleration structure which identify elements for which it is not yet known whether or not the ray interests.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: January 30, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11880929
    Abstract: An image processing apparatus (1) includes a numerical value receiving unit (10), a transparency determination unit (20), a display color determination unit (30), and a voxel display unit (40). The numerical value receiving unit (10) receives a numerical value. The transparency determination unit (20) determines a transparency of each one of a plurality of voxels each associated with a position in a three-dimensional space and associated with a value of a state quantity of the three-dimensional space at that position, based on the received numerical value and the value of the state quantity. The display color determination unit (30) determines a display color of each voxel according to display color information which defines the display color of the voxel in accordance with the value of the state quantity. The voxel display unit (40) displays the voxel for which the transparency and the display color have been determined on a display device (220).
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: January 23, 2024
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Futa Watanabe
  • Patent number: 11875513
    Abstract: A self-adaptive point cloud stripe division method. The method comprises: firstly, carrying out space division with a certain depth on a point cloud to obtain a plurality of local point clouds; then, counting the number of points in each of the local point clouds, comparing same with an upper and lower limit for the number of stripe points, and determining whether the number of points satisfies a requirement; and after a series of re-segmentation or re-fusion operations on the local point clouds, adjusting the number of points in each of the local point clouds until the number of points satisfies a range, thereby obtaining a final point cloud stripe. A plurality of local structures capable of being independently coded and decoded are obtained by means of division of a point cloud stripe, and this supports parallel processing, enhances system fault tolerance, and improves coding efficiency.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: January 16, 2024
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ge Li, Yiting Shao, Jiamin Jin
  • Patent number: 11877007
    Abstract: A method and apparatus for coding information of a point cloud that includes obtaining the point cloud including a set of points in a three-dimensional space; determining whether a current node in the set of points is isolated; and coding the current node in isolation mode based on a determination that the current node is isolated and coding the current node in non-isolation mode, based on a determination that the current node is not isolated.
    Type: Grant
    Filed: March 14, 2022
    Date of Patent: January 16, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11875453
    Abstract: In some embodiments, a given frame or picture may have different shading rates. In one embodiment in some areas of the frame or picture the shading rate may be less than once per pixel and in other places it may be once per pixel. Examples where the shading rate may be reduced include areas where there is motion and camera defocus, areas of peripheral blur, and in general, any case where the visibility is reduced anyway. The shading rate may be changed in a region, such as a shading quad, by changing the size of the region.
    Type: Grant
    Filed: April 5, 2021
    Date of Patent: January 16, 2024
    Assignee: Intel Corporation
    Inventors: Karthik Vaidyanathan, Marco Salvi, Robert M. Toth
  • Patent number: 11869139
    Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 9, 2024
    Assignee: Packsize LLC
    Inventors: Giulio Marin, Abbas Rafii, Carlo Dal Mutto, Kinh Tieu, Giridhar Murali, Alvise Memo
  • Patent number: 11869133
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system makes use of a serial-mode ray intersection process, in which, when a ray intersects a bounding volume, a limited number of new ray requests are generated.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: January 9, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11854141
    Abstract: Techniques are disclosed for improving the throughput of ray intersection or visibility queries performed by a ray tracing hardware accelerator. Throughput is improved, for example, by releasing allocated resources before ray visibility query results are reported by the hardware accelerator. The allocated resources are released when the ray visibility query results can be stored in a compressed format outside of the allocated resources. When reporting the ray visibility query results, the results are reconstructed based on the results stored in the compressed format. The compressed format storage can be used for ray visibility queries that return no intersections or terminate on any hit ray visibility query. One or more individual components of allocated resources can also be independently deallocated based on the type of data to be returned and/or results of the ray visibility query.
    Type: Grant
    Filed: October 18, 2022
    Date of Patent: December 26, 2023
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess, Ronald Charles Babich, Jr., William Parsons Newhall, Jr.
  • Patent number: 11854144
    Abstract: The embodiments of the present disclosure disclose subsurface scattering calculation method for translucent material rendering, which relates to the clipping and polynomial fitting of brute-force Monte Carlo photon tracking experimental results to accurately represent the energy attenuation of subsurface scattering in distance. On this basis, an average free path and a single scattering rate are used to determine the relationship of each term in the multinomial fitting formula so as to facilitate the calculation and adjustment of the reflection profile. In the end, through a new real-time importance sampling solution, the outgoing radiation from any point on the object surface is calculated by the Monte Carlo method. This importance sampling solution is also applicable to any other subsurface scattering calculation model. By combining this subsurface scattering calculation result with other results, such as highlight reflection, any translucent material object can be rendered accurately and efficiently.
    Type: Grant
    Filed: January 17, 2022
    Date of Patent: December 26, 2023
    Assignee: Beihang University
    Inventors: Yang Gao, Shiyu Liang, Aimin Hao, Hongyu Wu
  • Patent number: 11842505
    Abstract: An apparatus includes an acquisition unit configured to acquire target data, a determination unit configured to determine whether the target data has material appearance information of an object, and a control unit configured to display, on a display unit, an image corresponding to the target data based on a result of the determination by the determination unit, wherein, in a case where the target data has the material appearance information of the object, the control unit displays a moving image or consecutive still images, which includes a plurality of images under different viewing conditions, corresponding to the target data.
    Type: Grant
    Filed: September 21, 2021
    Date of Patent: December 12, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takayuki Jinno
  • Patent number: 11830138
    Abstract: Various disclosed embodiments are directed to estimating that a first vertex of a patch will change from a first position to a second position (the second position being at least partially indicative of secondary motion) based at least in part on one or more features of: primary motion data, one or more material properties, and constraint data associated with the particular patch. Such estimation can be made for some or all of the patches of an entire volumetric mesh in order to accurately predict the overall secondary motion of an object. This, among other functionality described herein resolves the inaccuracies, computer resource consumption, and the user experience of existing technologies.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: November 28, 2023
    Assignee: ADOBE INC.
    Inventors: Duygu Ceylan Aksit, Mianlun Zheng, Yi Zhou
  • Patent number: 11829733
    Abstract: Implementing an application for a data processing engine (DPE) array can include detecting, using computer hardware, a component of a hardware library package instantiated by an application. The application is specified in source code and is configured to execute on a DPE array. An instance of the component is extracted from the application. The extracted instance specifies values of parameters for the instance of the component. The instance can be partitioned by generating program code defining one or more kernels corresponding to the instance of the component. The partitioning is based on a defined performance metric of the component and a defined performance requirement of the application. The application is transformed by replacing the instance of the component with the program code generated by the partitioning. The application, as transformed, is compiled into program code executable by the DPE array.
    Type: Grant
    Filed: November 22, 2021
    Date of Patent: November 28, 2023
    Assignee: Xilinx, Inc.
    Inventors: Sumanta Datta, Srijan Tiwary, Aman Gayasen
  • Patent number: 11823325
    Abstract: Techniques are described for using computing devices to perform automated operations related to, with respect to a computer model of a house or other building's interior, generating and displaying simulated lighting information in the model based on sunlight or other external light that is estimated to enter the building and be visible in particular rooms of the interior under specified conditions, such as using ambient occlusion and light transport matrix calculations. The computer model may be a 3D (three-dimensional) or 2.5D representation that is generated after the house is built and that shows physical components of the actual house's interior (e.g., walls), and may be displayed to a user of a client computing device in a displayed GUI (graphical user interface) via which the user specifies conditions for which the simulated lighting display is generated.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: November 21, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Joshuah Vincent, Pierre Moulon, Ivaylo Boyadzhiev, Joshua David Maruska
  • Patent number: 11823324
    Abstract: A graphics processing system configured to use a rendering space which is subdivided into a plurality of tiles, includes geometry processing logic having geometry transform and sub-primitive logic configured to receive graphics data of input graphics data items, and to determine transformed positions within the rendering space of one or more sub-primitives derived from the input graphics data items using a plurality of shader stages; and a tiling unit configured to generate control stream data including sub-primitive indications to indicate which of the sub-primitives are to be used for rendering each tile. The geometry processing logic is configured to write to a memory, for each instance of a pre-determined shader stage, shader stage output data comprising data output from each instance of the pre-determined shader stage used to process the received graphics data.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: November 21, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Xile Yang, John W. Howson
  • Patent number: 11816788
    Abstract: Described herein are apparatuses, systems and methods for generating an interactive three-dimensional (“3D”) environment using virtual depth. A method comprises receiving a pre-rendered media file comprising a plurality of frames, receiving depth data related to the media file, wherein the depth data corresponds to each of the plurality of frames, creating an invisible three-dimensional (“3D”) framework of a first frame of the media file based on the corresponding depth data, and rendering a new first frame in real time to include the pre-rendered first frame, one or more virtual visible 3D objects and the invisible 3D framework.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: November 14, 2023
    Assignee: VIACOM INTERNATIONAL INC.
    Inventors: Tamer Eskander, Isaac Steele
  • Patent number: 11816781
    Abstract: A processor shares path tracing data across sampling locations to amortize computations across space and time. The processor maps a group of sampling locations of a frame that are adjacent to each other in world-space to a cell of a hash table. Each cell of the hash table stores a list of reservoirs that are each associated with a ray that intersects the group of sampling locations from world-space. The processor resamples the reservoirs at the hash table by combining and re-using reservoirs across neighboring sampling locations and corresponding sampling locations of the previous frame to select a set of samples mapped to the cell. The processor then performs resampling of the selected set of samples to obtain a representative light sample to determine a value for the cell and renders the frame based on the value of the cell.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: November 14, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventor: Guillaume Marie Boisse
  • Patent number: 11810239
    Abstract: Graphics processing system configured to perform ray tracing. Rays are bundled together and processed together. When differential data is needed by a shader, the data of a true ray in the bundle can be used rather than processing separate tracker rays.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: November 7, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Luke T. Peterson, James Jones, Aaron Dwyer
  • Patent number: 11810238
    Abstract: Ray tracing systems and computer-implemented methods for generating a hierarchical acceleration structure for intersection testing in a ray tracing system. Nodes of the hierarchical acceleration structure are determined, wherein each of the nodes represents a region in a scene, and wherein the nodes are linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure including data defining the regions represented by a plurality of the nodes of the hierarchical acceleration structure. At least one node is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from the stored data.
    Type: Grant
    Filed: June 23, 2022
    Date of Patent: November 7, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Gregory Clark, Steven J. Clohset
  • Patent number: 11798118
    Abstract: Systems, apparatuses and methods may provide for technology that sends a first message via an input output (IO) link, wherein the first message includes a first rendering asset and an identifier (ID) associated with the first rendering asset. The technology may also exclude a second rendering asset from a second message in response to the ID being shared by the first rendering asset and the second rendering asset and send the second message via the IO link, wherein the second message includes the ID. In one example, the ID is a hash ID.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: October 24, 2023
    Assignee: Intel Corporation
    Inventors: Changliang Wang, Mohammad R. Haghighat, Yong Yao, Xiaocheng Mao, Yifei Xue, Bin Yang, Jia Bao, Raul Diaz
  • Patent number: 11798218
    Abstract: A method of packing coverage in a graphics processing unit (GPU) may include receiving an indication for a portion of an image, determining, based on the indication, a packing technique for the portion of the image, and packing coverage for the portion of the image based on the packing technique. The indication may include one or more of: an importance, a quality, a level of interest, a level of detail, or a variable-rate shading (VRS) level. The indication may be received from an application. The packing technique may include array merging. The array merging may include quad merging. The packing technique may include pixel piling. The packing technique may be a first packing technique, and the method may further include determining, based on the indication, a second packing technique for the portion of the image, and packing coverage for the portion of the image based on the second packing technique.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: October 24, 2023
    Inventors: Keshavan Varadarajan, Veynu Narasiman, David C. Tannenbaum
  • Patent number: 11798234
    Abstract: An interaction method applied to virtual reality (VR). When providing a virtual environment using a VR technology, an electronic device determines whether a virtual mapping object of a virtual object and a real object overlap in a real environment, and when the virtual mapping object and the real object overlap, prompts a user that there is currently an overlapping area, and performs interaction failure processing on the overlapping area. The user can be prevented from colliding with the real object in the real environment, to ensure user safety. In addition, an interaction operation between the user and the virtual environment is not interrupted.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: October 24, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventor: Yilin Chen
  • Patent number: 11790254
    Abstract: The present invention provides a computerized method and system for detecting modeling content within a model file without rendering the model file, the method and system including loading the model file into a detection engine, the model file including software code therein. In the method and system, the detection engine scans the model file, detecting descriptor terms within software code. The method and system includes generating a description list for the model file based on the plurality of descriptor terms and executing a conversion engine to review the description list relative to a relational database, the conversion engine electronically generating file terms describing the modeling content within the model file based on input from the relational database. Whereby, the method and system generates a content list for the model file based on the file terms, the content list thereby associated with the model file.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: October 17, 2023
    Assignee: Shutterstock, Inc.
    Inventors: Matthew Wisdom, Mark C. Kurt, Christopher P Phillips
  • Patent number: 11790592
    Abstract: The present disclosure relates to a data process apparatus and a method thereof. The data process apparatus includes an internal memory unit and a shader level-1 cache. The internal memory unit is configured to store a to-be-cached matrix. The to-be-cached matrix includes at least a first element and a second element. The first element and the second element are stored in the internal memory unit in order of elements. The first element is located in a first row of the to-be-cached matrix, and the second element is located in next row of the to-be-cached matrix adjacent to the first row. The shader level-1 cache is connected to the internal memory unit, and configured to acquire the to-be-cached matrix to obtain a to-be-processed matrix stored in order of elements, and store the to-be-processed matrix.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: October 17, 2023
    Assignee: Glenfly Tech Co., Ltd.
    Inventors: Wenlin Hao, Fengxia Wu
  • Patent number: 11783530
    Abstract: Apparatus and method for grouping rays based on quantized ray directions. For example, one embodiment of an apparatus comprises: An apparatus comprising: a ray generator to generate a plurality of rays; ray direction evaluation circuitry/logic to generate approximate ray direction data for each of the plurality of rays; ray sorting circuitry/logic to sort the rays into a plurality of ray queues based, at least in part, on the approximate ray direction data.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: October 10, 2023
    Assignee: INTEL CORPORATION
    Inventors: Karol Szerszen, Prasoonkumar Surti, Gabor Liktor, Karthik Vaidyanathan, Sven Woop
  • Patent number: 11776679
    Abstract: A method is disclosed for generating pixel risk maps for diagnostic image reconstruction. The method produces uncertainty/variance maps by feeding into a trained encoder a short-scan image acquired from a medical imaging scan to generate latent code statistics including the mean ?y and variance ?y; selecting random samples based on the latent code statistics, z˜N(?y,?y2); feeding the random samples into a trained decoder to generate a pool of reconstructed images; and calculating, for each pixel of the pool of reconstructed images, the pixel mean and variance statistics across the pool of reconstructed images. The risk of each pixel may be calculated using the Stein's Unbiased Risk Estimator on the input density compensated data, that involves calculating the end-to-end divergence of the deep neural network.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: October 3, 2023
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Morteza Mardani Korani, David Donoho, John M. Pauly, Shreyas S. Vasanawala
  • Patent number: 11769294
    Abstract: Aspects of this disclosure relate to a process for rendering graphics that includes performing, with a hardware unit of a graphics processing unit (GPU) designated for vertex shading, a vertex shading operation to shade input vertices so as to output vertex shaded vertices, wherein the hardware unit adheres to an interface that receives a single vertex as an input and generates a single vertex as an output. The process also includes performing, with the hardware unit of the GPU designated for vertex shading, a hull shading operation to generate one or more control points based on one or more of the vertex shaded vertices, wherein the one or more hull shading operations operate on at least one of the one or more vertex shaded vertices to output the one or more control points.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: September 26, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Vineet Goel, Andrew Evan Gruber, Donghyun Kim
  • Patent number: 11763514
    Abstract: An example method of hardware-assisted graphics pipeline emulation comprises: computing, based on an input set of graphic primitives, a set of tessellation factors; computing, based on the input set of graphic primitives, a set of points specifying a plurality of patches; computing, based on the set of points, a tessellation count buffer; generating, based on the set of points and the tessellation count buffer, a tessellation offset buffer; performing, using the tessellation offset buffer, a tessellation setup stage; performing, by a graphics processing unit (GPU), a tessellation stage based on the set of tessellation factors, wherein the tessellation stage generates a plurality of output points corresponding to one or more patches of the plurality of patches; and computing, by a domain shader stage, a plurality of vertex positions defined by the plurality of output points.
    Type: Grant
    Filed: September 6, 2022
    Date of Patent: September 19, 2023
    Assignee: Parallels International GmbH
    Inventors: Evgeny Nikitenko, Alexey Ivanov, Nikolay Dobrovolskiy
  • Patent number: 11763695
    Abstract: A method and system for computer-implemented simulation of radar raw data, where the radar raw data are generated for a synthetic MIMO radar system including a transmitter array of several transmitters for transmitting radar signals and a receiver array of several receivers for receiving radar echoes of the radar signals. In this method, ray tracing of a radar signal sent from a preset transmitting position within the transmitter array and received at a preset receiving position within the receiver array is performed based on a 3D model of a virtual area adjacent to the MIMO radar system, where the ray tracing determines propagations of a plurality of rays within the radar signal from the preset transmitting position to the preset receiving position. The propagation of each ray is dependent on a first angle and a second angle describing the direction of a respective ray at the preset transmitting position.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: September 19, 2023
    Assignee: SIEMENS INDUSTRY SOFTWARE NV
    Inventor: Thijs Van Putten
  • Patent number: 11756254
    Abstract: Light contribution information can be determined and cached for use in rendering image frames for a scene. In at least one embodiment, a spatial hash data structure can be used to split the scene into regions, such as octahedral voxels. Using cast light rays, an average light contribution can be computed for each individual voxel. Those light values can then be used to build a cumulative distribution function for each voxel that can be used to select which lights to sample for a given frame during rendering. The sampling for a region or voxel can be based at least in part upon the number of contributing lights for that region, as well as the relative contributions of those lights. Such an approach can be very bandwidth and cache efficient, while providing high image quality.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: September 12, 2023
    Assignee: Nvidia Corporation
    Inventors: Blagovest Borislavov Taskov, Apollo Ellis
  • Patent number: 11756255
    Abstract: Accelerating structure for hybrid ray tracing is characterized by high locality, wherein scene changes are updated locally in one of its hierarchies, without effecting other locations in the structure. Reconstructions of accelerating structures of prior art are replaced by low-cost updates. The efficiency of traversals is improved by a double step traversal.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: September 12, 2023
    Assignee: Snap Inc.
    Inventors: Reuven Bakalash, Ron Weitzman
  • Patent number: 11748933
    Abstract: A GPU includes shader cores and a shader warp packer unit. The shader warp packer unit may receive a first primitive associated with a first partially covered quad, and a second primitive associated with a second partially covered quad. The shader warp packer unit may determine that the first partially covered quad and the second partially covered quad have non-overlapping coverage. The shader warp packer unit may pack the first partially covered quad and the second partially covered quad into a packed quad. The shader warp packer unit may send the packed quad to the shader cores. The first partially covered quad and the second partially covered quad may be spatially disjoint from each other. The shader cores may receive and process the packed quad with no loss of information relative to the shader cores individually processing the first partially covered quad and the second partially covered quad.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: September 5, 2023
    Inventors: Keshavan Varadarajan, David C. Tannenbaum, F N U Gurupad
  • Patent number: 11734879
    Abstract: Graphics processing systems can include lighting effects when rendering images. “Light probes” are directional representations of lighting at particular probe positions in the space of a scene which is being rendered. Light probes can be determined iteratively, which can allow them to be determined dynamically, in real-time over a sequence of frames. Once the light probes have been determined for a frame then the lighting at a pixel can be determined based on the lighting at the nearby light probe positions. Pixels can then be shaded based on the lighting determined for the pixel positions.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: August 22, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Jens Fursund, Luke T. Peterson
  • Patent number: 11734885
    Abstract: The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned geometry model can predict one or more adjusted depths for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.
    Type: Grant
    Filed: October 3, 2022
    Date of Patent: August 22, 2023
    Assignee: UATC, LLC
    Inventors: Sivabalan Manivasagam, Shenlong Wang, Wei-Chiu Ma, Raquel Urtasun
  • Patent number: 11724184
    Abstract: A graphics rendering system is disclosed for generating and streaming graphics data of a 3D environment from a server for rendering on a client in 2.5D. 2D textures can be transmitted in advance of frames showing the textures. Data transmitted for each frame can include 2D vertex positions of 2D meshes and depth data. The 2D vertex positions can be positions on a 2D projection as seen from a viewpoint within the 3D environment. Data for each frame can include changes to vertex positions and/or depth data. A prediction system can be used to predict when new objects will be displayed, and textures of those new objects can be transmitted in advance.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: August 15, 2023
    Assignee: ELECTRONIC ARTS INC.
    Inventors: Igor Borovikov, Mohsen Sardari
  • Patent number: 11726826
    Abstract: Examples are described here that can be used to allocate commands from multiple sources to performance by one or more segments of a processing device. For example, a processing device can be segmented into multiple portions and each portion is allocated to process commands from a particular source. In the event a single source provides commands, the entire processing device (all segments) can be allocated to process commands from the single source. When a second source provides commands, some segments can be allocated to perform commands from the first source and other segments can be allocated to perform commands from the second source. Accordingly, commands from multiple applications can be executed by a processing unit at the same time.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: August 15, 2023
    Assignee: Intel Corporation
    Inventors: James Valerio, Vasanth Ranganathan, Joydeep Ray, Rahul A. Kulkarni, Abhishek R. Appu, Jeffery S. Boles, Hema C. Nalluri
  • Patent number: 11721060
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system iteratively obtains ray requests, each of which identifies a ray and a node against which the ray is to be tested, and performs intersection testing based on the ray requests. The number of ray requests obtained in each iteration reduces responsive to an amount of memory occupied by information relating to the rays (undergoing intersection testing) increasing.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: August 8, 2023
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11715252
    Abstract: A GPU includes shader cores and a shader warp packer unit. The shader warp packer unit may receive a first primitive associated with a first partially covered quad, and a second primitive associated with a second partially covered quad. The shader warp packer unit may determine that the first partially covered quad and the second partially covered quad have non-overlapping coverage. The shader warp packer unit may pack the first partially covered quad and the second partially covered quad into a packed quad. The shader warp packer unit may send the packed quad to the shader cores. The first partially covered quad and the second partially covered quad may be spatially disjoint from each other. The shader cores may receive and process the packed quad with no loss of information relative to the shader cores individually processing the first partially covered quad and the second partially covered quad.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: August 1, 2023
    Inventors: Keshavan Varadarajan, David C. Tannenbaum, F N U Gurupad
  • Patent number: 11716797
    Abstract: A device corrects an indirect lighting color in response to changes in a vehicle interior finishing material. An input unit of the device receives a finishing material color of a vehicle interior and a target indirect lighting color. A light source control map of the device includes light source control signals of indirect lighting based on finishing material colors and target indirect lighting colors. A controller of the device generates a light source control signal according to the finishing material color and the target indirect lighting color input to the input unit from the light source control map. The controller also corrects the color of a light source of control target indirect lighting by the generated light source control signal.
    Type: Grant
    Filed: June 21, 2022
    Date of Patent: August 1, 2023
    Assignees: HYUNDAI MOTOR COMPANY, KIA CORPORATION
    Inventors: Cheol Min Park, Dae Seon Lee, Jung Hyun Cho, Kwang Il Chang, Nu Ri Jeon
  • Patent number: 11715272
    Abstract: In one embodiment, a method includes reconstructing a three-dimensional shape of a target object, creating a two-dimensional normal map for the three-dimensional shape of the target object, accessing image data and depth data associated with the target object, generating a first normal data associated with the target object using the image data and the depth data, updating the normal map using the first normal data, and re-rendering the three-dimensional shape of the target object based on the updated normal map.
    Type: Grant
    Filed: April 27, 2022
    Date of Patent: August 1, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Tony Tung, Zerong Zheng
  • Patent number: 11710263
    Abstract: A method of rasterising a line in computer graphics determines whether the line's start and/or end is inside a diamond test area within the pixel. If the end is not inside and the start is inside, the pixel is drawn as part of the line. If neither the start nor the end of the line are inside, it is determined whether the line crosses more than one extended diamond edge and if so, it is further determined (i) whether an extended line passing through the start and end is substantially vertical and touches the right point of the diamond area, (ii) if the extended line touches the bottom point of the diamond area, and (iii) whether the extended line is on a same side of each point of the diamond area. If any of (i), (ii) and (iii) is positive, the pixel is drawn as part of the line.
    Type: Grant
    Filed: May 14, 2022
    Date of Patent: July 25, 2023
    Assignee: Imagination Technologies Limited
    Inventor: Casper Van Benthem
  • Patent number: 11704860
    Abstract: One embodiment of a computer-implemented method for processing ray tracing operations in parallel includes receiving a plurality of rays and a corresponding set of importance sampling instructions for each ray included in the plurality of rays for processing, wherein each ray represents a path from a light source to at least one point within a three-dimensional (3D) environment, and each corresponding set of importance sampling instruction is based at least in part on one or more material properties associated with at least one surface of at least one object included in the 3D environment; assigning each ray included in the plurality of rays to a different processing core included in a plurality of processing cores; and for each ray included in the plurality of rays, causing the processing core assigned to the ray to execute the corresponding set of importance sampling instructions on the ray to generate a direction for a secondary ray that is produced when the ray intersects a surface of an object within the
    Type: Grant
    Filed: May 14, 2021
    Date of Patent: July 18, 2023
    Assignee: NVIDIA Corporation
    Inventors: Robert A. Alfieri, Peter S. Shirley