Lighting/shading Patents (Class 345/426)
  • Patent number: 12042727
    Abstract: The present invention provides an image processing method, wherein a computer executes: an acquisition step S10 of acquiring image information indicating, on a per-pixel basis, distance information indicating the distance from a camera and color information; a determination step S20 of determining, on a per-pixel basis and on the basis of the distance information of individual pixels, settings of a modulation filter that converts the color information of the individual pixels to modulate an image into the style of a painting; and a conversion step S30 of converting the color information on a per-pixel basis on the basis of the settings of the modulation filter determined for the individual pixels.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: July 23, 2024
    Assignee: CYGAMES, INC.
    Inventors: Akira Horibata, Kensaku Fujita, Sotaro Hori
  • Patent number: 12045451
    Abstract: An electronic device, with a touch-sensitive surface, displays a respective control, which is associated with respective contact intensity criteria, used to determine whether or not a function associated with the respective control will be performed. The device detects a gesture on the touch-sensitive surface, corresponding to an interaction with the respective control. In accordance with a determination that the gesture does not include a contact that meets the respective contact intensity criteria, the device changes the appearance of the respective control to indicate progress toward meeting the respective contact intensity criteria that is used to determine whether or not a function associated with the respective control will be performed. In response to detecting activation of the control, the device performs the function associated with the respective control in accordance with the detected gesture including a contact that meets the respective contact intensity criteria.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: July 23, 2024
    Assignee: APPLE INC.
    Inventors: May-Li Khoe, Matthew I. Brown, Bianca C. Costanzo, Avi E. Cieplinski, Jeffrey T. Bernstein, Julian K. Missig
  • Patent number: 12038328
    Abstract: Described herein is a method for generating a bi-directional texture function (BTF) of an object, the method including at least the following steps: measuring an initial BTF for the object using a camera-based measurement device, capturing spectral reflectance data for the object for a pre-given number of different measurement geometries using a spectrophotometer, and adapting the initial BTF to the captured spectral reflectance data), thus, gaining an optimized BTF. Also described herein are respective systems for generating a bi-directional texture function of an object.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: July 16, 2024
    Assignee: BASF COATINGS GMBH
    Inventors: Benjamin Lanfer, Guido Bischoff, Thomas Kantimm
  • Patent number: 12039654
    Abstract: Systems and methods for super sampling and viewport shifting of non-real time 3D applications are disclosed. In one embodiment, a graphics processing unit includes a processing resource to execute graphics commands to provide graphics for an application, a capture tool to capture the graphics commands, and a data generator to generate a dataset including at least one frame based on the captured graphics commands and to modify viewport settings for each frame of interest to generate a conditioned dataset.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: July 16, 2024
    Assignee: Intel Corporation
    Inventors: Joanna Douglas, Michal Taryma, Mario Garcia, Carlos Dominguez
  • Patent number: 12033230
    Abstract: One embodiment provides a method for recommending model characteristics to be used in developing a target geo-spatial physical model for a target geographic location utilizing historical lineage data corresponding to historical geo-spatial physical models, including: receiving information related to the target geographic location, wherein the information describes geographical and domain features of the target geographic location; identifying, using at least one similarity algorithm, at least one other geographic location that is similar to the target geographic location, wherein the at least one geographic location has at least one corresponding historical geo-spatial physical model; and recommending, using at least one machine-learning model and based upon the at least one other geographic location, initial model characteristics for developing and deploying the target geo-spatial physical model.
    Type: Grant
    Filed: February 18, 2020
    Date of Patent: July 9, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Andrew T. Penrose, Jitendra Singh, Himanshu Gupta, Vijay Arya
  • Patent number: 12025853
    Abstract: The invention relates to a 9 million pixel black light full-color lens comprising a first lens, a second lens, a third lens, a fourth lens, a fifth lens, a sixth lens, a diaphragm, a seventh lens, an eighth lens, a ninth lens, a tenth lens, an eleventh lens and an equivalent prism which are sequentially arranged from front to back along a light incident direction. The invention overcomes the poor resolution with visible light and infrared light, large chromatic aberration in imaging magnification and the like of the existing black light full-color lens, improves imaging effect (i.e. resolution) with visible light and infrared bands by adopting a structure of eleven spherical lenses, cooperated with the equivalent prism, simultaneously adopting a wide-spectrum optimization design for lenses, and provides a high-resolution video stream for image fusion, consequently a bright and colored image is output in a low illumination environment is obtained.
    Type: Grant
    Filed: June 8, 2021
    Date of Patent: July 2, 2024
    Assignee: FOCtek Photonics, Inc.
    Inventors: Xiaofeng Wen, Yongjie Lin, Jianfang Liu, Muwang Huang, Shaoqin Guo
  • Patent number: 12026849
    Abstract: According to example embodiments, an Image View Aggregator identifies a frontal view of an item within an image. The Image View Aggregator identifies at least one reflection view of the item within the image. Each reflection view of the item having been captured off a corresponding reflective physical surface. The Image View Aggregator extracts the frontal view of the item and each reflection view of the item from the image. The Image View Aggregator generates a representation of the item based at least on the extracted frontal view of the item and each extracted reflection view of the item.
    Type: Grant
    Filed: October 5, 2022
    Date of Patent: July 2, 2024
    Assignee: eBay Inc.
    Inventor: Sergio Pinzon Gonzales, Jr.
  • Patent number: 12026822
    Abstract: In various examples, the actual spatial properties of a virtual environment are used to produce, for a pixel, an anisotropic filter kernel for a filter having dimensions and weights that accurately reflect the spatial characteristics of the virtual environment. Geometry of the virtual environment may be computed based at least in part on a projection of a light source onto a surface through an occluder, in order to determine a footprint that reflects a contribution of the light source to lighting conditions of the pixel associated with a point on the surface. The footprint may define a size, orientation, and/or shape of the anisotropic filter kernel and corresponding filter weights. The anisotropic filter kernel may be applied to the pixel to produce a graphically-rendered image of the virtual environment.
    Type: Grant
    Filed: June 21, 2022
    Date of Patent: July 2, 2024
    Assignee: NVIDIA Corporation
    Inventor: Shiqui Liu
  • Patent number: 12026825
    Abstract: Apparatus and method for efficient BVH construction. For example, one embodiment of an apparatus comprises: a memory to store graphics data for a scene including a plurality of primitives in a scene at a first precision; a geometry quantizer to read vertices of the primitives at the first precision and to adaptively quantize the vertices of the primitives to a second precision associated with a first local coordinate grid of a first BVH node positioned within a global coordinate grid, the second precision lower than the first precision; a BVH builder to determine coordinates of child nodes of the first BVH node by performing non-spatial-split binning or spatial-split binning for the first BVH node using primitives associated with the first BVH node, the BVH builder to determine final coordinates for the child nodes based, at least in part, on an evaluation of surface areas of different bounding boxes generated for each of the child node.
    Type: Grant
    Filed: April 25, 2023
    Date of Patent: July 2, 2024
    Assignee: Intel Corporation
    Inventors: Michael Doyle, Karthik Vaidyanathan
  • Patent number: 12026833
    Abstract: Systems and methods are described for utilizing an image processing system with at least one processing device to perform operations including receiving a plurality of input images of a user, generating a three-dimensional mesh proxy based on a first set of features extracted from the plurality of input images and a second set of features extracted from the plurality of input images. The method may further include generating a neural texture based on a three-dimensional mesh proxy and the plurality of input images, generating a representation of the user including at least a neural texture, and sampling at least one portion of the neural texture from the three-dimensional mesh proxy. In response to providing the at least one sampled portion to a neural renderer, the method may include receiving, from the neural renderer, a synthesized image of the user that is previously not captured by the image processing system.
    Type: Grant
    Filed: October 28, 2020
    Date of Patent: July 2, 2024
    Assignee: Google LLC
    Inventors: Ricardo Martin Brualla, Moustafa Meshry, Daniel Goldman, Rohit Kumar Pandey, Sofien Bouaziz, Ke Li
  • Patent number: 12020364
    Abstract: Techniques are provided for modifying coloring of images utilizing machine learning. A trained model is generated utilizing machine learning with training data that includes images of a plurality of different scenes with different illumination characteristics. New original images of a scene may each be downsampled and transformed to a corresponding output image utilizing the trained model. A color transformation from each original image to its corresponding output image may be determined. In an embodiment, the color transformation is determined utilizing a spline fitting approach. The determined color transformations may be applied to each of the original images to generate corrected images. Specifically, the color transformation that is applied to a particular original image is the color transformation determined for the input image that corresponds to the particular original image. The corrected images are utilized to generate a digital model of the scene, and the digital model has accurate model texture.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: June 25, 2024
    Assignee: Bentley Systems, Incorporated
    Inventors: Alexandrina Orzan, Hugo Lavezac, Prince Ngattai Lam, Luc Robert
  • Patent number: 12014456
    Abstract: A method of operating a graphics processor when rendering a frame representing a view of a scene using a ray tracing process in which part of the processing for a ray tracing operation is offloaded to a texture mapper unit of the graphics processor. Thus, when the graphics processor's execution unit is executing a program to perform a ray tracing operation the execution unit is able to message the texture mapper unit to perform one or more processing operations for the ray tracing operation. This operation can be triggered by including an appropriate instruction to message the texture mapper unit within the ray tracing program.
    Type: Grant
    Filed: July 22, 2022
    Date of Patent: June 18, 2024
    Assignee: Arm Limited
    Inventors: Edvard Fielding, Carmelo Giliberto
  • Patent number: 12008708
    Abstract: A method for creating a second series of individual images with a first series of individual images, the individual images of the first or the second series of individual images having been captured with an objective, includes determining the entrance pupil and the field of vision of the objective for the individual images of the first series and creating or adapting the individual images of the second series in accordance with the entrance pupil and the field of vision of the objective of the individual image in question of the first series.
    Type: Grant
    Filed: January 27, 2021
    Date of Patent: June 11, 2024
    Assignee: Carl Zeiss AG
    Inventors: Michael Wick, Christian Wojek, Vladan Blahnik, Torsten Sievers
  • Patent number: 12008703
    Abstract: A computer-implemented method of creating a bounding volume hierarchy (BVH) for a model defined with respect to a local coordinate system for the model. The method includes defining BVH branch nodes within the model, establishing a plurality of local transformation matrices for the BVH; and for each BVH branch node, determining a first bounding volume and associating the branch node with one of the plurality of local transformation matrices that maps between the first bounding volume and a second bounding volume in the local coordinate system.
    Type: Grant
    Filed: July 14, 2021
    Date of Patent: June 11, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Simon Fenney
  • Patent number: 12008917
    Abstract: A patient simulation system for healthcare training is provided. The system includes one or more interchangeable shells comprising a physical anatomical model of at least a portion of a patient's body, the shell adapted to be illuminated from within the shell to provide one or more dynamic images viewable on the outer surface of the shells; wherein the system comprises one or more imaging devices enclosed within the shell and adapted to render the one or more dynamic images on an inner surface of the shell and viewable on the outer surface of the shells; one or more interface devices located about the patient shells to receive input and provide output; and one or more computing units in communication with the image units and interface devices, the computing units adapted to provide an interactive simulation for healthcare training. In other embodiments, the shell is adapted to be illuminated from outside the shell.
    Type: Grant
    Filed: February 10, 2020
    Date of Patent: June 11, 2024
    Assignee: UNIVERSITY OF CENTRAL FLORIDA RESEARCH FOUNDATION, INC.
    Inventors: Gregory F. Welch, Gerd Bruder, Salam Daher, Jason Eric Hochreiter, Mindi A. Anderson, Laura Gonzalez, Desiree A. Diaz
  • Patent number: 12002144
    Abstract: This technology relates to rendering content from discrete applications. In this regard, one or more computing devices may receive a global scene graph containing resources provided by two or more discrete processes, wherein the global scene graph is instantiated by a first process of the two or more discrete processes. The one or more computing devices may render and output for display, the global scene graph in accordance with the resources contained there.
    Type: Grant
    Filed: April 14, 2023
    Date of Patent: June 4, 2024
    Assignee: Google LLC
    Inventors: Joshua Gargus, Jeffrey Brown, Michael Jurka
  • Patent number: 12002150
    Abstract: Methods and systems are provided for rendering photo-realistic images of a subject or an object using a differentiable neural network for predicting indirect light behavior. In one example, the differentiable neural network outputs a volumetric light map comprising a plurality of spherical harmonic representations. Further, using a reflectance neural network, roughness and scattering coefficients associated with the subject or the object is computed. The volumetric light map, as well as the roughness and scattering coefficients are the utilized for rendering a final image under one or more of a desired lighting condition, desired camera view angle, and/or with a desired visual effect (e.g., expression change).
    Type: Grant
    Filed: May 3, 2022
    Date of Patent: June 4, 2024
    Assignee: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Yajie Zhao, Jing Yang, Hanyuan Xiao
  • Patent number: 11995759
    Abstract: In examples, the number of rays used to sample lighting conditions of a light source in a virtual environment with respect to particular locations in the virtual environment may be adapted to scene conditions. An additional ray(s) may be used for locations that tend to be associated with visual artifacts in rendered images. A determination may be made on whether to cast an additional ray(s) to a light source for a location and/or a quantity of rays to cast. To make the determination variables such as visibilities and/or hit distances of ray-traced samples of the light source may be analyzed for related locations in the virtual environment, such as those in a region around the location (e.g., within an N-by-N kernel centered at the location). Factors may include variability in visibilities and/or hit distances, differences between visibilities and/or hit distances relative to the location, and magnitudes of hit distances.
    Type: Grant
    Filed: September 7, 2021
    Date of Patent: May 28, 2024
    Assignee: NVIDIA Corporation
    Inventor: Jonathan Paul Story
  • Patent number: 11989870
    Abstract: A method for detecting objects on systems, includes providing a three-dimensional representation of the system, wherein the position and orientation of the representation and the system are known, and capturing a first image and a second image of the system, the two images being captured from different positions above the system. For a plurality of sections of the system, a respective comparison of the first and the second image is carried out using a parallax effect. If the images in a region surrounding the system match, an object is detected on the system.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: May 21, 2024
    Assignee: Siemens Energy Global GmbH & Co. KG
    Inventors: Josef Alois Birchbauer, Vlad Comanelea-Serban, Olaf Kähler
  • Patent number: 11989823
    Abstract: The invention discloses a method for rendering on the basis of hemispherical orthogonal function, the method comprising the following steps: selecting rendering fragments and establishing a local coordinate system; acquiring a bidirectional reflectance distribution function of a material; if global illumination is an orthogonal function, determining a rotation matrix of an orthogonal function coefficient according to the rotation angles of the global coordinate system and the local coordinate system, and calculating a local orthogonal function illumination coefficient; converting the local orthogonal function illumination coefficient into a hemispherical orthogonal function illumination coefficient; sampling to obtain the spatial distribution of a bidirectional reflection distribution function of a rendered material; obtaining a hemispherical orthogonal function of the bidirectional reflection distribution function of the rendered material; and using the dot product of a hemispherical orthogonal function coef
    Type: Grant
    Filed: September 14, 2020
    Date of Patent: May 21, 2024
    Assignee: NANJING INSTITUTE OF ASTRONOMICAL OPTICS & TECHNOLOGY, NATIONAL ASTRONOMICAL OBSERVATORIES, CAS
    Inventors: Yi Zheng, Kai Wei, Bin Liang, Ying Li, Changpeng Ding
  • Patent number: 11989971
    Abstract: Techniques are disclosed for capturing facial appearance properties. In some examples, a facial capture system includes light source(s) that produce linearly polarized light, at least one camera that is cross-polarized with respect to the polarization of light produced by the light source(s), and at least one other camera that is not cross-polarized with respect to the polarization of the light produced by the light source(s). Images captured by the cross-polarized camera(s) are used to determine facial appearance properties other than specular intensity, such as diffuse albedo, while images captured by the camera(s) that are not cross-polarized are used to determine facial appearance properties including specular intensity. In addition, a coarse-to-fine optimization procedure is disclosed for determining appearance and detailed geometry maps based on images captured by the cross-polarized camera(s) and the camera(s) that are not cross-polarized.
    Type: Grant
    Filed: December 2, 2021
    Date of Patent: May 21, 2024
    Assignee: Disney Enterprises, Inc.
    Inventors: Jeremy Riviere, Paulo Fabiano Urnau Gotardo, Abhijeet Ghosh, Derek Edward Bradley, Dominik Thabo Beeler
  • Patent number: 11978156
    Abstract: In a tile-based graphics processor when rendering a tile of a render output, which sub-regions, of a plurality of sub-regions that the tile has been divided into for fragment tracking purposes, fragments generated by the rasterisation stage fall within is determined. Then, for at least one sub-region of the plurality of sub-regions that the tile has been divided into, the processing of fragments for the sub-region of the tile is tracked to determine when the processing of all fragments for the sub-region of the tile has been finished. The writing of rendered fragment data for the sub-region of the tile from the tile buffer to memory is controlled on the basis of the tracking of the processing of fragments for the sub-region of the tile.
    Type: Grant
    Filed: March 18, 2022
    Date of Patent: May 7, 2024
    Assignee: Arm Limited
    Inventor: Ole Magnus Ruud
  • Patent number: 11972586
    Abstract: A method to dynamically and adaptively sample the depths of a scene using the principle of triangulation light curtains is described. The approach directly detects the presence or absence of obstacles (or scene points) at specified 3D lines in a scene by sampling the scene. The scene can be sampled sparsely, non-uniformly, or densely at specified regions. The depth sampling can be varied in real-time, enabling quick object discovery or detailed exploration of areas of interest. Once an object is discovered in the scene, adaptive light curtains comprising dense sampling of a region of the scene containing the object, can be used to better define the position, shape and size of the discovered object.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: April 30, 2024
    Assignee: Carnegie Mellon University
    Inventors: Srinivasa Narasimhan, Joseph Bartels, William L Whittaker, Jian Wang
  • Patent number: 11966785
    Abstract: A method for controlling hardware resource configuration for a processing system comprises obtaining performance monitoring data indicative of processing performance associated with workloads to be executed on the processing system, providing a trained machine learning model with input data depending on the performance monitoring data; and based on an inference made from the input data by the trained machine learning model, setting control information for configuring the processing system to control an amount of hardware resource allocated for use by at least one processor core. A corresponding method of training the model is provided. This is particularly useful for controlling inter-core borrowing of resource between processor cores in a multi-core processing system, where resource is borrowed between respective cores, e.g. cores on different layers of a 3D integrated circuit.
    Type: Grant
    Filed: July 30, 2020
    Date of Patent: April 23, 2024
    Assignee: Arm Limited
    Inventors: Dam Sunwoo, Supreet Jeloka, Saurabh Pijuskumar Sinha, Jaekyu Lee, Jose Alberto Joao, Krishnendra Nathella
  • Patent number: 11962952
    Abstract: A method for retrieval of multi spectral bidirectional reflectance distribution function (BRDF) parameters by using red-green-blue-depth (RGB-D) data includes capturing, by an RGB-D camera, at least one image of one or more objects in a scene. The captured at least one image of the one or more objects includes RGB-D data including color and geometry information of the objects. A processing unit reconstructs the captured at least one image of the one or more objects to one or more 3D reconstructions by using the RGB-D data. A deep neural network classifies the BRDF of a surface of the one or more objects based on the 3D reconstructions. The deep neural network includes an input layer, an output layer, and at least one hidden layer between the input layer and the output layer. The multi spectral BRDF parameters are retrieved by approximating the classified BRDF by using an iterative optimization method.
    Type: Grant
    Filed: August 16, 2019
    Date of Patent: April 16, 2024
    Assignee: Siemens Industry Software NV
    Inventors: Ahmet Bilgili, Serkan Ergun
  • Patent number: 11948485
    Abstract: An electronic apparatus and a method for controlling thereof are provided. The method includes acquiring a first Light field (LF) image of different viewpoints, inputting the first LF image to a first artificial intelligence model to acquire a pixel shift value for converting pixels in the first LF image, converting the pixels in the first LF image according to the pixel shift value to acquire a second LF image, inputting the first LF image and the second LF image to a second artificial intelligence model for converting the LF image to a layer image to acquire the layer image, inputting the acquired layer image to a simulation model for restoring the LF image to acquire a third LF image, and learning the first artificial intelligence model and the second artificial intelligence model based on the second LF image and the third LF image.
    Type: Grant
    Filed: January 3, 2022
    Date of Patent: April 2, 2024
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Bora Jin, Youngjin Yoon, Jihye Lee, Yeoul Lee, Sunil Lee, Jaesung Lee
  • Patent number: 11948246
    Abstract: Apparatuses, systems, and techniques to render computer graphics. In at least one embodiment, a first one or more lights are selected from among lights in a virtual scene to be rendered as a frame of graphics, and a second one or more lights are selected from among lights used to render one or more pixels in at least one of a prior frame or the current frame. A pixel of the current frame is rendered using the first and second one or more lights, and a light is selected for reuse in rendering a subsequent frame from among the first and second one or more lights.
    Type: Grant
    Filed: March 24, 2022
    Date of Patent: April 2, 2024
    Assignee: NVIDIA CORPORATION
    Inventor: Christopher Ryan Wyman
  • Patent number: 11941723
    Abstract: Systems, methods, and techniques dynamically utilize load balancing for workgroup assignments between a group of shader engines by a command processor of a graphics processing unit (GPU). Based on one or more commands received for execution, a plurality of workgroups is generated for assignment to a plurality of shader engines for processing, each shader engine including a respective quantity of active compute units. Each workgroup of the plurality of workgroups is dynamically assigned to a respective shader engine for execution based at least in part on indications of available resources respectively associated with each of the shader engines. In various embodiments, the indications of available resources may include physical parameters regarding each shader engine, as well as current status information regarding the processing of workgroups assigned to each shader engine.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: March 26, 2024
    Assignee: Advanced Micro Devices, Inc.
    Inventors: Randy Ramsey, Yash Ukidave
  • Patent number: 11941743
    Abstract: A system and method for generating a set of samples stratified across two-dimensional elementary intervals of a two-dimensional space is disclosed within the application. A computer-implemented technique for generating the set of samples includes selecting an elementary interval associated with a stratification of the two-dimensional space, initializing at least one data structure that indicates valid regions within the elementary interface based on other samples previously placed within the two-dimensional space, and generating a sample in a valid region of the elementary interval utilizing the at least one data structure to identify the valid region prior to generating the sample. In some embodiments, the data structures comprise a pair of binary trees. The process can be repeated for each elementary interval of a selected stratification to generate the set of stratified two-dimensional samples.
    Type: Grant
    Filed: July 20, 2022
    Date of Patent: March 26, 2024
    Assignee: NVIDIA Corporation
    Inventor: Matthew Milton Pharr
  • Patent number: 11935177
    Abstract: Disclosed are apparatuses, systems, and techniques to render images with global illumination using efficient ray tracing, light source identification, and reservoir resampling that deploys temporal and spatial reservoirs.
    Type: Grant
    Filed: June 15, 2021
    Date of Patent: March 19, 2024
    Assignee: Nvidia Corporation
    Inventors: Yaobin Ouyang, Nan Lin, Jacopo Pantaleoni, Markus Kettunen, Shiqiu Liu
  • Patent number: 11928394
    Abstract: Systems and methods of the present disclosure enable automated roof planning using a processor. The processor receives a digital image of a roof of a structure and models each roof plane of the roof to generate a roof model. The processor determines dimensions of each roof plane based on the roof model. The processor retrieves roofing accessory data from a database, the roofing accessory data solar roofing accessory part identifiers and solar roofing accessory part performance characteristics for solar roofing accessories. The processor simulates multiple candidate roof layouts based on the dimensions of each roof plan and the solar roofing accessory parts and determines a utilization prediction for each candidate layout. Based on each utilization prediction, the processor determines a particular roof layout having selected solar roofing accessory parts, and generates a solar roof design, including a list of materials, for the particular roof layout.
    Type: Grant
    Filed: March 30, 2023
    Date of Patent: March 12, 2024
    Assignee: BMIC LLC
    Inventors: Zachary Richard Campau, Rich Robinson
  • Patent number: 11920934
    Abstract: A view of geometry captured in image data generated by an imaging sensor is compared with a description of the geometry in a volumetric data structure. The volumetric data structure describes the volume at a plurality of levels of detail and includes entries describing voxels defining subvolumes of the volume at multiple levels of detail. The volumetric data structure includes a first entry to describe voxels at a lowest one of the levels of detail and further includes a number of second entries to describe voxels at a higher, second level of detail, the voxels at the second level of detail representing subvolumes of the voxels at the first level of detail. Each of these entries include bits to indicate whether a corresponding one of the voxels is at least partially occupied with the geometry. One or more of these entries are used in the comparison with the image data.
    Type: Grant
    Filed: June 14, 2021
    Date of Patent: March 5, 2024
    Assignee: Movidius Limited
    Inventors: David Macdara Moloney, Jonathan David Byrne
  • Patent number: 11910095
    Abstract: In an information processing apparatus, a captured image acquiring section acquires data of an image captured of a reference object while part of incident light applied thereto is being blocked. An incident light information acquiring section acquires, according to a predetermined model equation, a brightness distribution of partial incident light in each of light-blocked states on the basis of the image of the reference object, and acquires a brightness distribution of overall incident light by calculating brightness distributions of partial incident light. A target information acquiring section acquires the shape and material of a target by using the brightness distribution of overall incident light.
    Type: Grant
    Filed: November 21, 2019
    Date of Patent: February 20, 2024
    Assignee: Sony Interactive Entertainment Inc.
    Inventors: Takayuki Ishida, Shinya Wada
  • Patent number: 11908079
    Abstract: This disclosure provides systems, devices, apparatus, and methods, including computer programs encoded on storage media, for variable rate tessellation. A graphics processor may receive data for geometry processing of a plurality of patches in a draw call. The graphics processor may reduce a tessellation factor of each of the plurality of patches based on a property of each of the plurality of patches. The reduced tessellation factor may correspond to a TRF. The property may correspond to a shading rate or a number of visible pixels. The graphics processor may apply the TRF for each of the plurality of patches. The graphics processor may render each of the plurality of patches based on the applied TRF for each of the plurality of patches.
    Type: Grant
    Filed: April 8, 2022
    Date of Patent: February 20, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Renju Boben, Kalyan Kumar Bhiravabhatla, Vishwanath Shashikant Nikam, Suvam Chatterjee, Ankit Kumar Singh, Abhishek Lal, Sampathkumar Periasamy
  • Patent number: 11908063
    Abstract: Aspects and features of the present disclosure provide a direct ray tracing operator with a low memory footprint for surfaces enriched with displacement maps. A graphics editing application can be used to manipulate displayed representations of a 3D object that include surfaces with displacement textures. The application creates an independent map of a displaced surface. The application ray-traces bounding volumes on the fly and uses the intersection of a query ray with a bounding volume to produce rendering information for a displaced surface. The rendering information can be used to generate displaced surfaces for various base surfaces without significant re-computation so that updated images can be rendered quickly, in real time or near real time.
    Type: Grant
    Filed: July 1, 2021
    Date of Patent: February 20, 2024
    Assignee: ADOBE INC.
    Inventors: Theo Thonat, Xin Sun, Tamy Boubekeur, Nathan Carr, Francois Beaune
  • Patent number: 11906906
    Abstract: Disclosed is a method of metrology comprising using measurement illumination to measure a target, said measurement illumination comprising a plurality of illumination conditions. The method comprises performing a first measurement capture with a first subset of said plurality of illumination conditions, e.g., each comprising a positive weighting, to obtain a first parameter value and performing a second measurement capture with a second subset of said plurality of illumination conditions, e.g., each comprising a negative weighting, to obtain a second parameter value. An optimized parameter value is determined as a weighted combination of at least the first parameter value and the second parameter value.
    Type: Grant
    Filed: December 29, 2021
    Date of Patent: February 20, 2024
    Assignee: ASML Netherlands B.V.
    Inventors: Sebastianus Adrianus Goorden, Simon Reinald Huisman, Arjan Johannes Anton Beukman
  • Patent number: 11908062
    Abstract: A method for real-time shadow rendering using cached shadow maps and deferred shading by a video processor of a game console or the like includes, for at least each key frame of video output, determining a viewpoint for a current key frame based on user input, filtering a texel of a frame-specific shadow map based on a dynamic mask wherein the texel is filtered, for a shadowed light, from a static shadow map and a dynamic shadow map or from the static shadow map only, based on the dynamic mask value for the texel, and rendering the current key frame based on the frame-specific shadow map and a deferred-shadow rendering algorithm. The method enables efficient rendering of thousands of shadowed lights in large environments by consumer-grade game consoles.
    Type: Grant
    Filed: July 27, 2020
    Date of Patent: February 20, 2024
    Assignee: WARNER BROS. ENTERTAINMENT INC.
    Inventor: Bo Li
  • Patent number: 11900498
    Abstract: Apparatus and method for stable and short latency sorting.
    Type: Grant
    Filed: March 19, 2020
    Date of Patent: February 13, 2024
    Assignee: Intel Corporation
    Inventors: Saikat Mandal, Prasoonkumar Surti, Sven Woop
  • Patent number: 11893917
    Abstract: An apparatus and method is provided including: modulating or modifying light output by one or more light sources, wherein the light output is for use in rendering content in a first direction using a display, wherein the display has at least one curved portion, wherein the modulating or modifying of the light output by the one or more light sources modulates or modifies said light within said at least one curved portion such that said content is rendered in the first direction.
    Type: Grant
    Filed: June 22, 2021
    Date of Patent: February 6, 2024
    Assignee: Nokia Technologies Oy
    Inventors: Nicholas Jeffers, Ian Davis, Akshat Agarwal, Diarmuid O'Connell, Oliver Burns
  • Patent number: 11892632
    Abstract: A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: February 6, 2024
    Assignee: APPLE INC.
    Inventors: Anselm Grundhoefer, Michael J. Rockwell
  • Patent number: 11893221
    Abstract: A method for generating a texture shader is described. A user interface for editing the texture shader is displayed. The texture shader has a plurality of parameters that affect rendering characteristics of the texture shader. Displaying includes displaying a widget for at least one parameter of the plurality of parameters, and applying the texture shader to an input image using current values of the plurality of parameters to generate a preview of the texture shader. A user input that changes a value of a parameter of the at least one parameter is received via at least one widget. The texture shader is applied to the input image using the changed value of the parameter to generate the preview of the texture shader. The preview of the texture shader applied to the input image is displayed.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: February 6, 2024
    Assignee: Lemon Inc.
    Inventors: Kexin Lin, Qianyi Li
  • Patent number: 11887244
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements for intersection testing. The system defines and updates progress information that identifies, for a ray, leaf nodes of the hierarchical acceleration structure which identify elements for which it is not yet known whether or not the ray interests.
    Type: Grant
    Filed: December 10, 2021
    Date of Patent: January 30, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11880929
    Abstract: An image processing apparatus (1) includes a numerical value receiving unit (10), a transparency determination unit (20), a display color determination unit (30), and a voxel display unit (40). The numerical value receiving unit (10) receives a numerical value. The transparency determination unit (20) determines a transparency of each one of a plurality of voxels each associated with a position in a three-dimensional space and associated with a value of a state quantity of the three-dimensional space at that position, based on the received numerical value and the value of the state quantity. The display color determination unit (30) determines a display color of each voxel according to display color information which defines the display color of the voxel in accordance with the value of the state quantity. The voxel display unit (40) displays the voxel for which the transparency and the display color have been determined on a display device (220).
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: January 23, 2024
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventor: Futa Watanabe
  • Patent number: 11875513
    Abstract: A self-adaptive point cloud stripe division method. The method comprises: firstly, carrying out space division with a certain depth on a point cloud to obtain a plurality of local point clouds; then, counting the number of points in each of the local point clouds, comparing same with an upper and lower limit for the number of stripe points, and determining whether the number of points satisfies a requirement; and after a series of re-segmentation or re-fusion operations on the local point clouds, adjusting the number of points in each of the local point clouds until the number of points satisfies a range, thereby obtaining a final point cloud stripe. A plurality of local structures capable of being independently coded and decoded are obtained by means of division of a point cloud stripe, and this supports parallel processing, enhances system fault tolerance, and improves coding efficiency.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: January 16, 2024
    Assignee: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
    Inventors: Ge Li, Yiting Shao, Jiamin Jin
  • Patent number: 11877007
    Abstract: A method and apparatus for coding information of a point cloud that includes obtaining the point cloud including a set of points in a three-dimensional space; determining whether a current node in the set of points is isolated; and coding the current node in isolation mode based on a determination that the current node is isolated and coding the current node in non-isolation mode, based on a determination that the current node is not isolated.
    Type: Grant
    Filed: March 14, 2022
    Date of Patent: January 16, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiang Zhang, Wen Gao, Shan Liu
  • Patent number: 11875453
    Abstract: In some embodiments, a given frame or picture may have different shading rates. In one embodiment in some areas of the frame or picture the shading rate may be less than once per pixel and in other places it may be once per pixel. Examples where the shading rate may be reduced include areas where there is motion and camera defocus, areas of peripheral blur, and in general, any case where the visibility is reduced anyway. The shading rate may be changed in a region, such as a shading quad, by changing the size of the region.
    Type: Grant
    Filed: April 5, 2021
    Date of Patent: January 16, 2024
    Assignee: Intel Corporation
    Inventors: Karthik Vaidyanathan, Marco Salvi, Robert M. Toth
  • Patent number: 11869133
    Abstract: A system and method for performing intersection testing of rays in a ray tracing system. The ray tracing system uses a hierarchical acceleration structure comprising a plurality of nodes, each identifying one or more elements able to be intersected by a ray. The system makes use of a serial-mode ray intersection process, in which, when a ray intersects a bounding volume, a limited number of new ray requests are generated.
    Type: Grant
    Filed: September 30, 2021
    Date of Patent: January 9, 2024
    Assignee: Imagination Technologies Limited
    Inventor: Daniel Barnard
  • Patent number: 11869139
    Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.
    Type: Grant
    Filed: January 5, 2023
    Date of Patent: January 9, 2024
    Assignee: Packsize LLC
    Inventors: Giulio Marin, Abbas Rafii, Carlo Dal Mutto, Kinh Tieu, Giridhar Murali, Alvise Memo
  • Patent number: 11854144
    Abstract: The embodiments of the present disclosure disclose subsurface scattering calculation method for translucent material rendering, which relates to the clipping and polynomial fitting of brute-force Monte Carlo photon tracking experimental results to accurately represent the energy attenuation of subsurface scattering in distance. On this basis, an average free path and a single scattering rate are used to determine the relationship of each term in the multinomial fitting formula so as to facilitate the calculation and adjustment of the reflection profile. In the end, through a new real-time importance sampling solution, the outgoing radiation from any point on the object surface is calculated by the Monte Carlo method. This importance sampling solution is also applicable to any other subsurface scattering calculation model. By combining this subsurface scattering calculation result with other results, such as highlight reflection, any translucent material object can be rendered accurately and efficiently.
    Type: Grant
    Filed: January 17, 2022
    Date of Patent: December 26, 2023
    Assignee: Beihang University
    Inventors: Yang Gao, Shiyu Liang, Aimin Hao, Hongyu Wu
  • Patent number: 11854141
    Abstract: Techniques are disclosed for improving the throughput of ray intersection or visibility queries performed by a ray tracing hardware accelerator. Throughput is improved, for example, by releasing allocated resources before ray visibility query results are reported by the hardware accelerator. The allocated resources are released when the ray visibility query results can be stored in a compressed format outside of the allocated resources. When reporting the ray visibility query results, the results are reconstructed based on the results stored in the compressed format. The compressed format storage can be used for ray visibility queries that return no intersections or terminate on any hit ray visibility query. One or more individual components of allocated resources can also be independently deallocated based on the type of data to be returned and/or results of the ray visibility query.
    Type: Grant
    Filed: October 18, 2022
    Date of Patent: December 26, 2023
    Assignee: NVIDIA Corporation
    Inventors: Gregory Muthler, John Burgess, Ronald Charles Babich, Jr., William Parsons Newhall, Jr.