Patents by Inventor Jacopo Pantaleoni

Jacopo Pantaleoni has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961176
    Abstract: Disclosed approaches provide for interactions of secondary rays of light transport paths in a virtual environment to share lighting contributions when determining lighting conditions for a light transport path. Interactions may be shared based on similarities in characteristics (e.g., hit locations), which may define a region in which interactions may share lighting condition data. The region may correspond to a texel of a texture map and lighting contribution data for interactions may be accumulated to the texel spatially and/or temporally, then used to compute composite lighting contribution data that estimates radiance at an interaction. Approaches are also provided for reprojecting lighting contributions of interactions to pixels to share lighting contribution data from secondary bounces of light transport paths while avoiding potential over blurring.
    Type: Grant
    Filed: February 7, 2022
    Date of Patent: April 16, 2024
    Assignee: NVIDIA Corporation
    Inventor: Jacopo Pantaleoni
  • Patent number: 11935177
    Abstract: Disclosed are apparatuses, systems, and techniques to render images with global illumination using efficient ray tracing, light source identification, and reservoir resampling that deploys temporal and spatial reservoirs.
    Type: Grant
    Filed: June 15, 2021
    Date of Patent: March 19, 2024
    Assignee: Nvidia Corporation
    Inventors: Yaobin Ouyang, Nan Lin, Jacopo Pantaleoni, Markus Kettunen, Shiqiu Liu
  • Patent number: 11925860
    Abstract: This application discloses techniques for generating and querying projective hash maps. More specifically, projective hash maps can be used for spatial hashing of data related to N-dimensional points. Each point is projected onto a projection surface to convert the three-dimensional (3D) coordinates for the point to two-dimensional (2D) coordinates associated with the projection surface. Hash values based on the 2D coordinates are then used as an index to store data in the projective hash map. Utilizing the 2D coordinates rather than the 3D coordinates allows for more efficient searches to be performed to locate points in the 3D space. In particular, projective hash maps can be utilized by graphics applications for generating images, and the improved efficiency can, for example, enable a game streaming application on a server to render images transmitted to a user device via a network at faster frame rates.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: March 12, 2024
    Assignee: NVIDIA Corporation
    Inventors: Marco Salvi, Jacopo Pantaleoni, Aaron Eliot Lefohn, Christopher Ryan Wyman, Pascal Gautron
  • Publication number: 20230360311
    Abstract: Disclosed are apparatuses, systems, and techniques to render images with global illumination using efficient ray tracing, light source identification, and reservoir resampling that deploys temporal and spatial reservoirs.
    Type: Application
    Filed: June 15, 2021
    Publication date: November 9, 2023
    Inventors: Yaobin Ouyang, Nan Lin, Jacopo Pantaleoni, Markus Kettunen, Shiqiu Liu
  • Publication number: 20230289924
    Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
    Type: Application
    Filed: May 15, 2023
    Publication date: September 14, 2023
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Patent number: 11688042
    Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: June 27, 2023
    Assignee: NVIDIA Corporation
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Patent number: 11663701
    Abstract: This disclosure presents a method and computer program product to denoise a ray traced scene. An apparatus for processing a ray traced scene is also disclosed. In one example, the method includes: (1) generating filtered scene data by filtering modified scene data from original scene data utilizing a spatial filter, and (2) providing a denoised ray traced scene by adjusting the filtered scene data utilizing a temporal filter. The modified and adjusted scene data can be sent to a rendering processor or system to complete rendering to generate a final scene.
    Type: Grant
    Filed: April 27, 2021
    Date of Patent: May 30, 2023
    Assignee: NVIDIA Corporation
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Patent number: 11593988
    Abstract: In various examples, transmittance may be computed using a power-series expansion of an exponential integral of a density function. A term of the power-series expansion may be evaluated as a combination of values of the term for different orderings of samples in the power-series expansion. A sample may be computed from a combination of values at spaced intervals along the function and a discontinuity may be compensated for based at least on determining a version of the function that includes an alignment of a first point with a second point of the function. Rather than arbitrarily or manually selecting a pivot used to expand the power-series, the pivot may be computed as an average of values of the function. The transmittance estimation may be computed from the power-series expansion using a value used to compute the pivot (for a biased estimate) or using all different values (for an unbiased estimate).
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: February 28, 2023
    Assignee: NVIDIA Corporation
    Inventors: Eugene d″Eon, Jan Novak, Jacopo Pantaleoni, Niko Markus Kettunen
  • Publication number: 20220395748
    Abstract: This application discloses techniques for generating and querying projective hash maps. More specifically, projective hash maps can be used for spatial hashing of data related to N-dimensional points. Each point is projected onto a projection surface to convert the three-dimensional (3D) coordinates for the point to two-dimensional (2D) coordinates associated with the projection surface. Hash values based on the 2D coordinates are then used as an index to store data in the projective hash map. Utilizing the 2D coordinates rather than the 3D coordinates allows for more efficient searches to be performed to locate points in the 3D space. In particular, projective hash maps can be utilized by graphics applications for generating images, and the improved efficiency can, for example, enable a game streaming application on a server to render images transmitted to a user device via a network at faster frame rates.
    Type: Application
    Filed: June 9, 2021
    Publication date: December 15, 2022
    Inventors: Marco Salvi, Jacopo Pantaleoni, Aaron Eliot Lefohn, Christopher Ryan Wyman, Pascal Gautron
  • Publication number: 20220254099
    Abstract: In various examples, transmittance may be computed using a power-series expansion of an exponential integral of a density function. A term of the power-series expansion may be evaluated as a combination of values of the term for different orderings of samples in the power-series expansion. A sample may be computed from a combination of values at spaced intervals along the function and a discontinuity may be compensated for based at least on determining a version of the function that includes an alignment of a first point with a second point of the function. Rather than arbitrarily or manually selecting a pivot used to expand the power-series, the pivot may be computed as an average of values of the function. The transmittance estimation may be computed from the power-series expansion using a value used to compute the pivot (for a biased estimate) or using all different values (for an unbiased estimate).
    Type: Application
    Filed: February 8, 2021
    Publication date: August 11, 2022
    Inventors: Eugene d''Eon, Jan Novak, Jacopo Pantaleoni, Niko Markus Kettunen
  • Publication number: 20220165016
    Abstract: Disclosed approaches provide for interactions of secondary rays of light transport paths in a virtual environment to share lighting contributions when determining lighting conditions for a light transport path. Interactions may be shared based on similarities in characteristics (e.g., hit locations), which may define a region in which interactions may share lighting condition data. The region may correspond to a texel of a texture map and lighting contribution data for interactions may be accumulated to the texel spatially and/or temporally, then used to compute composite lighting contribution data that estimates radiance at an interaction. Approaches are also provided for reprojecting lighting contributions of interactions to pixels to share lighting contribution data from secondary bounces of light transport paths while avoiding potential over blurring.
    Type: Application
    Filed: February 7, 2022
    Publication date: May 26, 2022
    Inventor: Jacopo Pantaleoni
  • Patent number: 11244493
    Abstract: Disclosed approaches provide for interactions of secondary rays of light transport paths in a virtual environment to share lighting contributions when determining lighting conditions for a light transport path. Interactions may be shared based on similarities in characteristics (e.g., hit locations), which may define a region in which interactions may share lighting condition data. The region may correspond to a texel of a texture map and lighting contribution data for interactions may be accumulated to the texel spatially and/or temporally, then used to compute composite lighting contribution data that estimates radiance at an interaction. Approaches are also provided for reprojecting lighting contributions of interactions to pixels to share lighting contribution data from secondary bounces of light transport paths while avoiding potential over blurring.
    Type: Grant
    Filed: July 26, 2019
    Date of Patent: February 8, 2022
    Assignee: NVIDIA Corporation
    Inventor: Jacopo Pantaleoni
  • Publication number: 20210358198
    Abstract: Disclosed approaches provide for interactions of light transport paths in a virtual environment to share directional radiance when rendering a scene. Directional radiance that may be shared includes outgoing directional radiance of interactions, incoming directional radiance of interactions, and/or information derived therefrom. The shared directional radiance may be used for various purposes, such as computing lighting contributions at one or more interactions of a light transport path, and/or for path guiding. Directional radiance of an interaction may be shared with another interaction when the interaction is sufficiently similar (e.g., in radiance direction) to serve as an approximation of a sample for the other interaction. Sharing directional radiance may provide for online learning of directional radiance, which may build finite element approximations of light fields at the interactions.
    Type: Application
    Filed: May 14, 2021
    Publication date: November 18, 2021
    Inventor: Jacopo Pantaleoni
  • Publication number: 20210342980
    Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
    Type: Application
    Filed: July 15, 2021
    Publication date: November 4, 2021
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Patent number: 11113792
    Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
    Type: Grant
    Filed: August 14, 2019
    Date of Patent: September 7, 2021
    Assignee: NVIDIA CORPORATION
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Publication number: 20210264571
    Abstract: This disclosure presents a method and computer program product to denoise a ray traced scene. An apparatus for processing a ray traced scene is also disclosed. In one example, the method includes: (1) generating filtered scene data by filtering modified scene data from original scene data utilizing a spatial filter, and (2) providing a denoised ray traced scene by adjusting the filtered scene data utilizing a temporal filter. The modified and adjusted scene data can be sent to a rendering processor or system to complete rendering to generate a final scene.
    Type: Application
    Filed: April 27, 2021
    Publication date: August 26, 2021
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Patent number: 10991079
    Abstract: This disclosure presents a method to denoise a ray traced scene where the ray tracing uses a minimal number of rays. The method can use temporal reprojections to compute a weighted average to the scene data. A spatial filter can be run on the scene data, using the temporal reprojection count to reduce the size of the utilized spatial filter radius. In some aspects, additional temporal filters can be applied to the scene data. In some aspects, global illumination temporal reprojection history counts can be used to modify the spatial filter radius. In some aspects, caustic photon tracing can be conducted to compute a logarithmic cost, which can then be utilized to reduce the denoising radius used by the spatial filter. The modified and adjusted scene data can be sent to a rendering process to complete the rendering to generate a final scene.
    Type: Grant
    Filed: August 2, 2019
    Date of Patent: April 27, 2021
    Assignee: Nvidia Corporation
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Publication number: 20200058105
    Abstract: Various approaches are disclosed to temporally and spatially filter noisy image data—generated using one or more ray-tracing effects—in a graphically rendered image. Rather than fully sampling data values using spatial filters, the data values may be sparsely sampled using filter taps within the spatial filters. To account for the sparse sampling, locations of filter taps may be jittered spatially and/or temporally. For filtering efficiency, a size of a spatial filter may be reduced when historical data values are used to temporally filter pixels. Further, data values filtered using a temporal filter may be clamped to avoid ghosting. For further filtering efficiency, a spatial filter may be applied as a separable filter in which the filtering for a filter direction may be performed over multiple iterations using reducing filter widths, decreasing the chance of visual artifacts when the spatial filter does not follow a true Gaussian distribution.
    Type: Application
    Filed: August 14, 2019
    Publication date: February 20, 2020
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Publication number: 20200058103
    Abstract: This disclosure presents a method to denoise a ray traced scene where the ray tracing uses a minimal number of rays. The method can use temporal reprojections to compute a weighted average to the scene data. A spatial filter can be run on the scene data, using the temporal reprojection count to reduce the size of the utilized spatial filter radius. In some aspects, additional temporal filters can be applied to the scene data. In some aspects, global illumination temporal reprojection history counts can be used to modify the spatial filter radius. In some aspects, caustic photon tracing can be conducted to compute a logarithmic cost, which can then be utilized to reduce the denoising radius used by the spatial filter. The modified and adjusted scene data can be sent to a rendering process to complete the rendering to generate a final scene.
    Type: Application
    Filed: August 2, 2019
    Publication date: February 20, 2020
    Inventors: Shiqiu Liu, Jacopo Pantaleoni
  • Publication number: 20200035014
    Abstract: Disclosed approaches provide for interactions of secondary rays of light transport paths in a virtual environment to share lighting contributions when determining lighting conditions for a light transport path. Interactions may be shared based on similarities in characteristics (e.g., hit locations), which may define a region in which interactions may share lighting condition data. The region may correspond to a texel of a texture map and lighting contribution data for interactions may be accumulated to the texel spatially and/or temporally, then used to compute composite lighting contribution data that estimates radiance at an interaction. Approaches are also provided for reprojecting lighting contributions of interactions to pixels to share lighting contribution data from secondary bounces of light transport paths while avoiding potential over blurring.
    Type: Application
    Filed: July 26, 2019
    Publication date: January 30, 2020
    Inventor: Jacopo Pantaleoni