Lighting/shading Patents (Class 345/426)
  • Patent number: 11966785
    Abstract: A method for controlling hardware resource configuration for a processing system comprises obtaining performance monitoring data indicative of processing performance associated with workloads to be executed on the processing system, providing a trained machine learning model with input data depending on the performance monitoring data; and based on an inference made from the input data by the trained machine learning model, setting control information for configuring the processing system to control an amount of hardware resource allocated for use by at least one processor core. A corresponding method of training the model is provided. This is particularly useful for controlling inter-core borrowing of resource between processor cores in a multi-core processing system, where resource is borrowed between respective cores, e.g. cores on different layers of a 3D integrated circuit.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: April 23, 2024
    Assignee: Arm Limited
    Inventors: Dam Sunwoo, Supreet Jeloka, Saurabh Pijuskumar Sinha, Jaekyu Lee, Jose Alberto Joao, Krishnendra Nathella
  • Patent number: 11962952
    Abstract: A method for retrieval of multi spectral bidirectional reflectance distribution function (BRDF) parameters by using red-green-blue-depth (RGB-D) data includes capturing, by an RGB-D camera, at least one image of one or more objects in a scene. The captured at least one image of the one or more objects includes RGB-D data including color and geometry information of the objects. A processing unit reconstructs the captured at least one image of the one or more objects to one or more 3D reconstructions by using the RGB-D data. A deep neural network classifies the BRDF of a surface of the one or more objects based on the 3D reconstructions. The deep neural network includes an input layer, an output layer, and at least one hidden layer between the input layer and the output layer. The multi spectral BRDF parameters are retrieved by approximating the classified BRDF by using an iterative optimization method.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: April 16, 2024
    Assignee: Siemens Industry Software NV
    Inventors: Ahmet Bilgili, Serkan Ergun
  • Patent number: 11948485
    Abstract: An electronic apparatus and a method for controlling thereof are provided. The method includes acquiring a first Light field (LF) image of different viewpoints, inputting the first LF image to a first artificial intelligence model to acquire a pixel shift value for converting pixels in the first LF image, converting the pixels in the first LF image according to the pixel shift value to acquire a second LF image, inputting the first LF image and the second LF image to a second artificial intelligence model for converting the LF image to a layer image to acquire the layer image, inputting the acquired layer image to a simulation model for restoring the LF image to acquire a third LF image, and learning the first artificial intelligence model and the second artificial intelligence model based on the second LF image and the third LF image.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: April 2, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Bora Jin, Youngjin Yoon, Jihye Lee, Yeoul Lee, Sunil Lee, Jaesung Lee
  • Patent number: 11948246
    Abstract: Apparatuses, systems, and techniques to render computer graphics. In at least one embodiment, a first one or more lights are selected from among lights in a virtual scene to be rendered as a frame of graphics, and a second one or more lights are selected from among lights used to render one or more pixels in at least one of a prior frame or the current frame. A pixel of the current frame is rendered using the first and second one or more lights, and a light is selected for reuse in rendering a subsequent frame from among the first and second one or more lights.
    Type: Grant
    Filed: March 24, 2022
    Date of Patent: April 2, 2024
    Assignee: NVIDIA CORPORATION
    Inventor: Christopher Ryan Wyman
  • Patent number: 11941723
    Abstract: Systems, methods, and techniques dynamically utilize load balancing for workgroup assignments between a group of shader engines by a command processor of a graphics processing unit (GPU). Based on one or more commands received for execution, a plurality of workgroups is generated for assignment to a plurality of shader engines for processing, each shader engine including a respective quantity of active compute units. Each workgroup of the plurality of workgroups is dynamically assigned to a respective shader engine for execution based at least in part on indications of available resources respectively associated with each of the shader engines. In various embodiments, the indications of available resources may include physical parameters regarding each shader engine, as well as current status information regarding the processing of workgroups assigned to each shader engine.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: March 26, 2024
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Randy Ramsey, Yash Ukidave
  • Patent number: 11941743
    Abstract: A system and method for generating a set of samples stratified across two-dimensional elementary intervals of a two-dimensional space is disclosed within the application. A computer-implemented technique for generating the set of samples includes selecting an elementary interval associated with a stratification of the two-dimensional space, initializing at least one data structure that indicates valid regions within the elementary interface based on other samples previously placed within the two-dimensional space, and generating a sample in a valid region of the elementary interval utilizing the at least one data structure to identify the valid region prior to generating the sample. In some embodiments, the data structures comprise a pair of binary trees. The process can be repeated for each elementary interval of a selected stratification to generate the set of stratified two-dimensional samples.
    Type: Grant
    Filed: July 20, 2022
    Date of Patent: March 26, 2024
    Assignee: NVIDIA Corporation
    Inventor: Matthew Milton Pharr
  • Patent number: 11935177
    Abstract: Disclosed are apparatuses, systems, and techniques to render images with global illumination using efficient ray tracing, light source identification, and reservoir resampling that deploys temporal and spatial reservoirs.
    Type: Grant
    Filed: June 15, 2021
    Date of Patent: March 19, 2024
    Assignee: Nvidia Corporation
    Inventors: Yaobin Ouyang, Nan Lin, Jacopo Pantaleoni, Markus Kettunen, Shiqiu Liu
  • Patent number: 11928394
    Abstract: Systems and methods of the present disclosure enable automated roof planning using a processor. The processor receives a digital image of a roof of a structure and models each roof plane of the roof to generate a roof model. The processor determines dimensions of each roof plane based on the roof model. The processor retrieves roofing accessory data from a database, the roofing accessory data solar roofing accessory part identifiers and solar roofing accessory part performance characteristics for solar roofing accessories. The processor simulates multiple candidate roof layouts based on the dimensions of each roof plan and the solar roofing accessory parts and determines a utilization prediction for each candidate layout. Based on each utilization prediction, the processor determines a particular roof layout having selected solar roofing accessory parts, and generates a solar roof design, including a list of materials, for the particular roof layout.
    Type: Grant
    Filed: March 30, 2023
    Date of Patent: March 12, 2024
    Assignee: BMIC LLC
    Inventors: Zachary Richard Campau, Rich Robinson
  • Patent number: 11920934
    Abstract: A view of geometry captured in image data generated by an imaging sensor is compared with a description of the geometry in a volumetric data structure. The volumetric data structure describes the volume at a plurality of levels of detail and includes entries describing voxels defining subvolumes of the volume at multiple levels of detail. The volumetric data structure includes a first entry to describe voxels at a lowest one of the levels of detail and further includes a number of second entries to describe voxels at a higher, second level of detail, the voxels at the second level of detail representing subvolumes of the voxels at the first level of detail. Each of these entries include bits to indicate whether a corresponding one of the voxels is at least partially occupied with the geometry. One or more of these entries are used in the comparison with the image data.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: March 5, 2024
    Assignee: Movidius Limited
    Inventors: David Macdara Moloney, Jonathan David Byrne
  • Patent number: 11908079
    Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for variable rate tessellation. A graphics processor may receive data for geometry processing of a plurality of patches in a draw call. The graphics processor may reduce a tessellation factor of each of the plurality of patches based on a property of each of the plurality of patches. The reduced tessellation factor may correspond to a TRF. The property may correspond to a shading rate or a number of visible pixels. The graphics processor may apply the TRF for each of the plurality of patches. The graphics processor may render each of the plurality of patches based on the applied TRF for each of the plurality of patches.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: February 20, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Renju Boben, Kalyan Kumar Bhiravabhatla, Vishwanath Shashikant Nikam, Suvam Chatterjee, Ankit Kumar Singh, Abhishek Lal, Sampathkumar Periasamy
  • Patent number: 11908063
    Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: February 20, 2024
    Assignee: ADOBE INC.
    Inventors: Theo Thonat, Xin Sun, Tamy Boubekeur, Nathan Carr, Francois Beaune
  • Patent number: 11908062
    Abstract: A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: February 20, 2024
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventor: Bo Li
  • Patent number: 11910095
    Abstract: In an information processing apparatus, a captured image acquiring section acquires data of an image captured of a reference object while part of incident light applied thereto is being blocked. An incident light information acquiring section acquires, according to a predetermined model equation, a brightness distribution of partial incident light in each of light-blocked states on the basis of the image of the reference object, and acquires a brightness distribution of overall incident light by calculating brightness distributions of partial incident light. A target information acquiring section acquires the shape and material of a target by using the brightness distribution of overall incident light.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: February 20, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Takayuki Ishida, Shinya Wada
  • Patent number: 11906906
    Abstract: Disclosed is a method of metrology comprising using measurement illumination to measure a target, said measurement illumination comprising a plurality of illumination conditions. The method comprises performing a first measurement capture with a first subset of said plurality of illumination conditions, e.g., each comprising a positive weighting, to obtain a first parameter value and performing a second measurement capture with a second subset of said plurality of illumination conditions, e.g., each comprising a negative weighting, to obtain a second parameter value. An optimized parameter value is determined as a weighted combination of at least the first parameter value and the second parameter value.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: February 20, 2024
    Assignee: ASML Netherlands B.V.
    Inventors: Sebastianus Adrianus Goorden, Simon Reinald Huisman, Arjan Johannes Anton Beukman
  • Patent number: 11900498
    Abstract: Apparatus and method for stable and short latency sorting.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: February 13, 2024
    Assignee: Intel Corporation
    Inventors: Saikat Mandal, Prasoonkumar Surti, Sven Woop
  • Patent number: 11892632
    Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: February 6, 2024
    Assignee: APPLE INC.
    Inventors: Anselm Grundhoefer, Michael J. Rockwell
  • Patent number: 11893221
    Abstract: A method for generating a texture shader is described. A user interface for editing the texture shader is displayed. The texture shader has a plurality of parameters that affect rendering characteristics of the texture shader. Displaying includes displaying a widget for at least one parameter of the plurality of parameters, and applying the texture shader to an input image using current values of the plurality of parameters to generate a preview of the texture shader. A user input that changes a value of a parameter of the at least one parameter is received via at least one widget. The texture shader is applied to the input image using the changed value of the parameter to generate the preview of the texture shader. The preview of the texture shader applied to the input image is displayed.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: February 6, 2024
    Assignee: Lemon Inc.
    Inventors: Kexin Lin, Qianyi Li
  • Patent number: 11893917
    Abstract: An apparatus and method is provided including: modulating or modifying light output by one or more light sources, wherein the light output is for use in rendering content in a first direction using a display, wherein the display has at least one curved portion, wherein the modulating or modifying of the light output by the one or more light sources modulates or modifies said light within said at least one curved portion such that said content is rendered in the first direction.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: February 6, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Nicholas Jeffers, Ian Davis, Akshat Agarwal, Diarmuid O'Connell, Oliver Burns
  • Patent number: 11887244
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements for intersection testing. The system defines and updates progress information that identifies, for a ray, leaf nodes of the hierarchical acceleration structure which identify elements for which it is not yet known whether or not the ray interests.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: January 30, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11880929
    Abstract: An image processing apparatus (1) includes a numerical value receiving unit (10), a transparency determination unit (20), a display color determination unit (30), and a voxel display unit (40). The numerical value receiving unit (10) receives a numerical value. The transparency determination unit (20) determines a transparency of each one of a plurality of voxels each associated with a position in a three-dimensional space and associated with a value of a state quantity of the three-dimensional space at that position, based on the received numerical value and the value of the state quantity. The display color determination unit (30) determines a display color of each voxel according to display color information which defines the display color of the voxel in accordance with the value of the state quantity. The voxel display unit (40) displays the voxel for which the transparency and the display color have been determined on a display device (220).
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: January 23, 2024
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Futa Watanabe
  • Patent number: 11875513
    Abstract: A self-adaptive point cloud stripe division method. The method comprises: firstly, carrying out space division with a certain depth on a point cloud to obtain a plurality of local point clouds; then, counting the number of points in each of the local point clouds, comparing same with an upper and lower limit for the number of stripe points, and determining whether the number of points satisfies a requirement; and after a series of re-segmentation or re-fusion operations on the local point clouds, adjusting the number of points in each of the local point clouds until the number of points satisfies a range, thereby obtaining a final point cloud stripe. A plurality of local structures capable of being independently coded and decoded are obtained by means of division of a point cloud stripe, and this supports parallel processing, enhances system fault tolerance, and improves coding efficiency.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: January 16, 2024
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ge Li, Yiting Shao, Jiamin Jin
  • Patent number: 11877007
    Abstract: A method and apparatus for coding information of a point cloud that includes obtaining the point cloud including a set of points in a three-dimensional space; determining whether a current node in the set of points is isolated; and coding the current node in isolation mode based on a determination that the current node is isolated and coding the current node in non-isolation mode, based on a determination that the current node is not isolated.
    Type: Grant
    Filed: March 14, 2022
    Date of Patent: January 16, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11875453
    Abstract: In some embodiments, a given frame or picture may have different shading rates. In one embodiment in some areas of the frame or picture the shading rate may be less than once per pixel and in other places it may be once per pixel. Examples where the shading rate may be reduced include areas where there is motion and camera defocus, areas of peripheral blur, and in general, any case where the visibility is reduced anyway. The shading rate may be changed in a region, such as a shading quad, by changing the size of the region.
    Type: Grant
    Filed: April 5, 2021
    Date of Patent: January 16, 2024
    Assignee: Intel Corporation
    Inventors: Karthik Vaidyanathan, Marco Salvi, Robert M. Toth
  • Patent number: 11869139
    Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 9, 2024
    Assignee: Packsize LLC
    Inventors: Giulio Marin, Abbas Rafii, Carlo Dal Mutto, Kinh Tieu, Giridhar Murali, Alvise Memo
  • Patent number: 11869133
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system makes use of a serial-mode ray intersection process, in which, when a ray intersects a bounding volume, a limited number of new ray requests are generated.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: January 9, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11854141
    Abstract: Techniques are disclosed for improving the throughput of ray intersection or visibility queries performed by a ray tracing hardware accelerator. Throughput is improved, for example, by releasing allocated resources before ray visibility query results are reported by the hardware accelerator. The allocated resources are released when the ray visibility query results can be stored in a compressed format outside of the allocated resources. When reporting the ray visibility query results, the results are reconstructed based on the results stored in the compressed format. The compressed format storage can be used for ray visibility queries that return no intersections or terminate on any hit ray visibility query. One or more individual components of allocated resources can also be independently deallocated based on the type of data to be returned and/or results of the ray visibility query.
    Type: Grant
    Filed: October 18, 2022
    Date of Patent: December 26, 2023
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess, Ronald Charles Babich, Jr., William Parsons Newhall, Jr.
  • Patent number: 11854144
    Abstract: The embodiments of the present disclosure disclose subsurface scattering calculation method for translucent material rendering, which relates to the clipping and polynomial fitting of brute-force Monte Carlo photon tracking experimental results to accurately represent the energy attenuation of subsurface scattering in distance. On this basis, an average free path and a single scattering rate are used to determine the relationship of each term in the multinomial fitting formula so as to facilitate the calculation and adjustment of the reflection profile. In the end, through a new real-time importance sampling solution, the outgoing radiation from any point on the object surface is calculated by the Monte Carlo method. This importance sampling solution is also applicable to any other subsurface scattering calculation model. By combining this subsurface scattering calculation result with other results, such as highlight reflection, any translucent material object can be rendered accurately and efficiently.
    Type: Grant
    Filed: January 17, 2022
    Date of Patent: December 26, 2023
    Assignee: Beihang University
    Inventors: Yang Gao, Shiyu Liang, Aimin Hao, Hongyu Wu
  • Patent number: 11842505
    Abstract: An apparatus includes an acquisition unit configured to acquire target data, a determination unit configured to determine whether the target data has material appearance information of an object, and a control unit configured to display, on a display unit, an image corresponding to the target data based on a result of the determination by the determination unit, wherein, in a case where the target data has the material appearance information of the object, the control unit displays a moving image or consecutive still images, which includes a plurality of images under different viewing conditions, corresponding to the target data.
    Type: Grant
    Filed: September 21, 2021
    Date of Patent: December 12, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Takayuki Jinno
  • Patent number: 11830138
    Abstract: Various disclosed embodiments are directed to estimating that a first vertex of a patch will change from a first position to a second position (the second position being at least partially indicative of secondary motion) based at least in part on one or more features of: primary motion data, one or more material properties, and constraint data associated with the particular patch. Such estimation can be made for some or all of the patches of an entire volumetric mesh in order to accurately predict the overall secondary motion of an object. This, among other functionality described herein resolves the inaccuracies, computer resource consumption, and the user experience of existing technologies.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: November 28, 2023
    Assignee: ADOBE INC.
    Inventors: Duygu Ceylan Aksit, Mianlun Zheng, Yi Zhou
  • Patent number: 11829733
    Abstract: Implementing an application for a data processing engine (DPE) array can include detecting, using computer hardware, a component of a hardware library package instantiated by an application. The application is specified in source code and is configured to execute on a DPE array. An instance of the component is extracted from the application. The extracted instance specifies values of parameters for the instance of the component. The instance can be partitioned by generating program code defining one or more kernels corresponding to the instance of the component. The partitioning is based on a defined performance metric of the component and a defined performance requirement of the application. The application is transformed by replacing the instance of the component with the program code generated by the partitioning. The application, as transformed, is compiled into program code executable by the DPE array.
    Type: Grant
    Filed: November 22, 2021
    Date of Patent: November 28, 2023
    Assignee: Xilinx, Inc.
    Inventors: Sumanta Datta, Srijan Tiwary, Aman Gayasen
  • Patent number: 11823325
    Abstract: Techniques are described for using computing devices to perform automated operations related to, with respect to a computer model of a house or other building's interior, generating and displaying simulated lighting information in the model based on sunlight or other external light that is estimated to enter the building and be visible in particular rooms of the interior under specified conditions, such as using ambient occlusion and light transport matrix calculations. The computer model may be a 3D (three-dimensional) or 2.5D representation that is generated after the house is built and that shows physical components of the actual house's interior (e.g., walls), and may be displayed to a user of a client computing device in a displayed GUI (graphical user interface) via which the user specifies conditions for which the simulated lighting display is generated.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: November 21, 2023
    Assignee: MFTB Holdco, Inc.
    Inventors: Joshuah Vincent, Pierre Moulon, Ivaylo Boyadzhiev, Joshua David Maruska
  • Patent number: 11823324
    Abstract: A graphics processing system configured to use a rendering space which is subdivided into a plurality of tiles, includes geometry processing logic having geometry transform and sub-primitive logic configured to receive graphics data of input graphics data items, and to determine transformed positions within the rendering space of one or more sub-primitives derived from the input graphics data items using a plurality of shader stages; and a tiling unit configured to generate control stream data including sub-primitive indications to indicate which of the sub-primitives are to be used for rendering each tile. The geometry processing logic is configured to write to a memory, for each instance of a pre-determined shader stage, shader stage output data comprising data output from each instance of the pre-determined shader stage used to process the received graphics data.
    Type: Grant
    Filed: January 24, 2022
    Date of Patent: November 21, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Xile Yang, John W. Howson
  • Patent number: 11816788
    Abstract: Described herein are apparatuses, systems and methods for generating an interactive three-dimensional (“3D”) environment using virtual depth. A method comprises receiving a pre-rendered media file comprising a plurality of frames, receiving depth data related to the media file, wherein the depth data corresponds to each of the plurality of frames, creating an invisible three-dimensional (“3D”) framework of a first frame of the media file based on the corresponding depth data, and rendering a new first frame in real time to include the pre-rendered first frame, one or more virtual visible 3D objects and the invisible 3D framework.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: November 14, 2023
    Assignee: VIACOM INTERNATIONAL INC.
    Inventors: Tamer Eskander, Isaac Steele
  • Patent number: 11816781
    Abstract: A processor shares path tracing data across sampling locations to amortize computations across space and time. The processor maps a group of sampling locations of a frame that are adjacent to each other in world-space to a cell of a hash table. Each cell of the hash table stores a list of reservoirs that are each associated with a ray that intersects the group of sampling locations from world-space. The processor resamples the reservoirs at the hash table by combining and re-using reservoirs across neighboring sampling locations and corresponding sampling locations of the previous frame to select a set of samples mapped to the cell. The processor then performs resampling of the selected set of samples to obtain a representative light sample to determine a value for the cell and renders the frame based on the value of the cell.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: November 14, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventor: Guillaume Marie Boisse
  • Patent number: 11810239
    Abstract: Graphics processing system configured to perform ray tracing. Rays are bundled together and processed together. When differential data is needed by a shader, the data of a true ray in the bundle can be used rather than processing separate tracker rays.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: November 7, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Luke T. Peterson, James Jones, Aaron Dwyer
  • Patent number: 11810238
    Abstract: Ray tracing systems and computer-implemented methods for generating a hierarchical acceleration structure for intersection testing in a ray tracing system. Nodes of the hierarchical acceleration structure are determined, wherein each of the nodes represents a region in a scene, and wherein the nodes are linked to form the hierarchical acceleration structure. Data is stored representing the hierarchical acceleration structure including data defining the regions represented by a plurality of the nodes of the hierarchical acceleration structure. At least one node is an implicitly represented node, wherein data defining a region represented by an implicitly represented node is not explicitly included as part of the stored data but can be inferred from the stored data.
    Type: Grant
    Filed: June 23, 2022
    Date of Patent: November 7, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Gregory Clark, Steven J. Clohset
  • Patent number: 11798118
    Abstract: Systems, apparatuses and methods may provide for technology that sends a first message via an input output (IO) link, wherein the first message includes a first rendering asset and an identifier (ID) associated with the first rendering asset. The technology may also exclude a second rendering asset from a second message in response to the ID being shared by the first rendering asset and the second rendering asset and send the second message via the IO link, wherein the second message includes the ID. In one example, the ID is a hash ID.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: October 24, 2023
    Assignee: Intel Corporation
    Inventors: Changliang Wang, Mohammad R. Haghighat, Yong Yao, Xiaocheng Mao, Yifei Xue, Bin Yang, Jia Bao, Raul Diaz
  • Patent number: 11798234
    Abstract: An interaction method applied to virtual reality (VR). When providing a virtual environment using a VR technology, an electronic device determines whether a virtual mapping object of a virtual object and a real object overlap in a real environment, and when the virtual mapping object and the real object overlap, prompts a user that there is currently an overlapping area, and performs interaction failure processing on the overlapping area. The user can be prevented from colliding with the real object in the real environment, to ensure user safety. In addition, an interaction operation between the user and the virtual environment is not interrupted.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: October 24, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventor: Yilin Chen
  • Patent number: 11798218
    Abstract: A method of packing coverage in a graphics processing unit (GPU) may include receiving an indication for a portion of an image, determining, based on the indication, a packing technique for the portion of the image, and packing coverage for the portion of the image based on the packing technique. The indication may include one or more of: an importance, a quality, a level of interest, a level of detail, or a variable-rate shading (VRS) level. The indication may be received from an application. The packing technique may include array merging. The array merging may include quad merging. The packing technique may include pixel piling. The packing technique may be a first packing technique, and the method may further include determining, based on the indication, a second packing technique for the portion of the image, and packing coverage for the portion of the image based on the second packing technique.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: October 24, 2023
    Inventors: Keshavan Varadarajan, Veynu Narasiman, David C. Tannenbaum
  • Patent number: 11790592
    Abstract: The present disclosure relates to a data process apparatus and a method thereof. The data process apparatus includes an internal memory unit and a shader level-1 cache. The internal memory unit is configured to store a to-be-cached matrix. The to-be-cached matrix includes at least a first element and a second element. The first element and the second element are stored in the internal memory unit in order of elements. The first element is located in a first row of the to-be-cached matrix, and the second element is located in next row of the to-be-cached matrix adjacent to the first row. The shader level-1 cache is connected to the internal memory unit, and configured to acquire the to-be-cached matrix to obtain a to-be-processed matrix stored in order of elements, and store the to-be-processed matrix.
    Type: Grant
    Filed: February 15, 2022
    Date of Patent: October 17, 2023
    Assignee: Glenfly Tech Co., Ltd.
    Inventors: Wenlin Hao, Fengxia Wu
  • Patent number: 11790254
    Abstract: The present invention provides a computerized method and system for detecting modeling content within a model file without rendering the model file, the method and system including loading the model file into a detection engine, the model file including software code therein. In the method and system, the detection engine scans the model file, detecting descriptor terms within software code. The method and system includes generating a description list for the model file based on the plurality of descriptor terms and executing a conversion engine to review the description list relative to a relational database, the conversion engine electronically generating file terms describing the modeling content within the model file based on input from the relational database. Whereby, the method and system generates a content list for the model file based on the file terms, the content list thereby associated with the model file.
    Type: Grant
    Filed: December 4, 2020
    Date of Patent: October 17, 2023
    Assignee: Shutterstock, Inc.
    Inventors: Matthew Wisdom, Mark C. Kurt, Christopher P Phillips
  • Patent number: 11783530
    Abstract: Apparatus and method for grouping rays based on quantized ray directions. For example, one embodiment of an apparatus comprises: An apparatus comprising: a ray generator to generate a plurality of rays; ray direction evaluation circuitry/logic to generate approximate ray direction data for each of the plurality of rays; ray sorting circuitry/logic to sort the rays into a plurality of ray queues based, at least in part, on the approximate ray direction data.
    Type: Grant
    Filed: February 22, 2022
    Date of Patent: October 10, 2023
    Assignee: INTEL CORPORATION
    Inventors: Karol Szerszen, Prasoonkumar Surti, Gabor Liktor, Karthik Vaidyanathan, Sven Woop
  • Patent number: 11776679
    Abstract: A method is disclosed for generating pixel risk maps for diagnostic image reconstruction. The method produces uncertainty/variance maps by feeding into a trained encoder a short-scan image acquired from a medical imaging scan to generate latent code statistics including the mean ?y and variance ?y; selecting random samples based on the latent code statistics, z˜N(?y,?y2); feeding the random samples into a trained decoder to generate a pool of reconstructed images; and calculating, for each pixel of the pool of reconstructed images, the pixel mean and variance statistics across the pool of reconstructed images. The risk of each pixel may be calculated using the Stein's Unbiased Risk Estimator on the input density compensated data, that involves calculating the end-to-end divergence of the deep neural network.
    Type: Grant
    Filed: March 9, 2021
    Date of Patent: October 3, 2023
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Morteza Mardani Korani, David Donoho, John M. Pauly, Shreyas S. Vasanawala
  • Patent number: 11769294
    Abstract: Aspects of this disclosure relate to a process for rendering graphics that includes performing, with a hardware unit of a graphics processing unit (GPU) designated for vertex shading, a vertex shading operation to shade input vertices so as to output vertex shaded vertices, wherein the hardware unit adheres to an interface that receives a single vertex as an input and generates a single vertex as an output. The process also includes performing, with the hardware unit of the GPU designated for vertex shading, a hull shading operation to generate one or more control points based on one or more of the vertex shaded vertices, wherein the one or more hull shading operations operate on at least one of the one or more vertex shaded vertices to output the one or more control points.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: September 26, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Vineet Goel, Andrew Evan Gruber, Donghyun Kim
  • Patent number: 11763514
    Abstract: An example method of hardware-assisted graphics pipeline emulation comprises: computing, based on an input set of graphic primitives, a set of tessellation factors; computing, based on the input set of graphic primitives, a set of points specifying a plurality of patches; computing, based on the set of points, a tessellation count buffer; generating, based on the set of points and the tessellation count buffer, a tessellation offset buffer; performing, using the tessellation offset buffer, a tessellation setup stage; performing, by a graphics processing unit (GPU), a tessellation stage based on the set of tessellation factors, wherein the tessellation stage generates a plurality of output points corresponding to one or more patches of the plurality of patches; and computing, by a domain shader stage, a plurality of vertex positions defined by the plurality of output points.
    Type: Grant
    Filed: September 6, 2022
    Date of Patent: September 19, 2023
    Assignee: Parallels International GmbH
    Inventors: Evgeny Nikitenko, Alexey Ivanov, Nikolay Dobrovolskiy
  • Patent number: 11763695
    Abstract: A method and system for computer-implemented simulation of radar raw data, where the radar raw data are generated for a synthetic MIMO radar system including a transmitter array of several transmitters for transmitting radar signals and a receiver array of several receivers for receiving radar echoes of the radar signals. In this method, ray tracing of a radar signal sent from a preset transmitting position within the transmitter array and received at a preset receiving position within the receiver array is performed based on a 3D model of a virtual area adjacent to the MIMO radar system, where the ray tracing determines propagations of a plurality of rays within the radar signal from the preset transmitting position to the preset receiving position. The propagation of each ray is dependent on a first angle and a second angle describing the direction of a respective ray at the preset transmitting position.
    Type: Grant
    Filed: April 4, 2019
    Date of Patent: September 19, 2023
    Assignee: SIEMENS INDUSTRY SOFTWARE NV
    Inventor: Thijs Van Putten
  • Patent number: 11756254
    Abstract: Light contribution information can be determined and cached for use in rendering image frames for a scene. In at least one embodiment, a spatial hash data structure can be used to split the scene into regions, such as octahedral voxels. Using cast light rays, an average light contribution can be computed for each individual voxel. Those light values can then be used to build a cumulative distribution function for each voxel that can be used to select which lights to sample for a given frame during rendering. The sampling for a region or voxel can be based at least in part upon the number of contributing lights for that region, as well as the relative contributions of those lights. Such an approach can be very bandwidth and cache efficient, while providing high image quality.
    Type: Grant
    Filed: December 8, 2020
    Date of Patent: September 12, 2023
    Assignee: Nvidia Corporation
    Inventors: Blagovest Borislavov Taskov, Apollo Ellis
  • Patent number: 11756255
    Abstract: Accelerating structure for hybrid ray tracing is characterized by high locality, wherein scene changes are updated locally in one of its hierarchies, without effecting other locations in the structure. Reconstructions of accelerating structures of prior art are replaced by low-cost updates. The efficiency of traversals is improved by a double step traversal.
    Type: Grant
    Filed: August 25, 2021
    Date of Patent: September 12, 2023
    Assignee: Snap Inc.
    Inventors: Reuven Bakalash, Ron Weitzman
  • Patent number: 11748933
    Abstract: A GPU includes shader cores and a shader warp packer unit. The shader warp packer unit may receive a first primitive associated with a first partially covered quad, and a second primitive associated with a second partially covered quad. The shader warp packer unit may determine that the first partially covered quad and the second partially covered quad have non-overlapping coverage. The shader warp packer unit may pack the first partially covered quad and the second partially covered quad into a packed quad. The shader warp packer unit may send the packed quad to the shader cores. The first partially covered quad and the second partially covered quad may be spatially disjoint from each other. The shader cores may receive and process the packed quad with no loss of information relative to the shader cores individually processing the first partially covered quad and the second partially covered quad.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: September 5, 2023
    Inventors: Keshavan Varadarajan, David C. Tannenbaum, F N U Gurupad
  • Patent number: 11734879
    Abstract: Graphics processing systems can include lighting effects when rendering images. “Light probes” are directional representations of lighting at particular probe positions in the space of a scene which is being rendered. Light probes can be determined iteratively, which can allow them to be determined dynamically, in real-time over a sequence of frames. Once the light probes have been determined for a frame then the lighting at a pixel can be determined based on the lighting at the nearby light probe positions. Pixels can then be shaded based on the lighting determined for the pixel positions.
    Type: Grant
    Filed: August 19, 2021
    Date of Patent: August 22, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Jens Fursund, Luke T. Peterson