Patents by Inventor Bryan Christopher Catanzaro

Bryan Christopher Catanzaro has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240095880
    Abstract: Apparatuses, systems, and techniques to use one or more neural networks to generate an upsampled version of one or more images based, at least in part, on a denoised version of said one or more images. At least one embodiment pertains to generating an upsampled high-resolution image from a noisy version and denoised version of a low-resolution image. At least one embodiment pertains to separating components of a low-resolution image before denoising an image.
    Type: Application
    Filed: September 19, 2022
    Publication date: March 21, 2024
    Inventors: Shiqiu Liu, Jussi Rasanen, Michael Ranzinger, Guilin Liu, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20240098216
    Abstract: Apparatuses, systems, and techniques to process image frames. In at least one embodiment, one or more neural networks are used to blend two or more video frames between a first video frame and a second video frame. In at least one embodiment, a blended video frame is used to generate an intermediate video frame between the first video frame and the second video frame.
    Type: Application
    Filed: September 20, 2022
    Publication date: March 21, 2024
    Inventors: Robert Thomas Pottorff, Karan Sapra, Zhekun Luo, Andrew J. Tao, Bryan Christopher Catanzaro
  • Publication number: 20230186428
    Abstract: Apparatuses, systems, and techniques for texture synthesis from small input textures in images using convolutional neural networks. In at least one embodiment, one or more convolutional layers are used in conjunction with one or more transposed convolution operations to generate a large textured output image from a small input textured image while preserving global features and texture, according to various novel techniques described herein.
    Type: Application
    Filed: February 6, 2023
    Publication date: June 15, 2023
    Inventors: Guilin Liu, Andrew Tao, Bryan Christopher Catanzaro, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum Reda, Karan Sapra, Brandon Rowlett
  • Publication number: 20220222778
    Abstract: Apparatuses, systems, and techniques are presented to generate images. In at least one embodiment, one or more neural networks are used to generate one or more images using one or more pixel weights determined based, at least in part, on one or more sub-pixel offset values.
    Type: Application
    Filed: March 31, 2022
    Publication date: July 14, 2022
    Inventors: Shiqiu Liu, Robert Thomas Pottorff, Guilin Liu, Karan Sapra, Jon Barker, David Tarjan, Pekka Janis, Edvard Olav Valter Fagerholm, Lei Yang, Kevin Jonathan Shih, Marco Salvi, Timo Roman, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20220180528
    Abstract: Apparatuses, systems, and techniques to perform unsupervised keypoint or landmark learning using one or more neural networks. In at least one embodiment, one or more neural networks use pose and appearance information to construct a foreground and a background, which are then used to reconstruct an input image and determine loss values to train the one or more neural networks.
    Type: Application
    Filed: February 23, 2022
    Publication date: June 9, 2022
    Inventors: Aysegul Dundar, Kevin Jonathan Shih, Animesh Garg, Robert Thomas Pottorff, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20220101494
    Abstract: Apparatuses, systems, and techniques to scale textured images using a Fourier transform in conjunction with one or more neural networks. In at least one embodiment, a neural network generates an expanded image from an input image by applying a Fourier transform to one or more feature maps generated by said neural network and up-scaling one or more resulting frequency domain feature maps before generating an expanded output image based on up-scaled feature maps.
    Type: Application
    Filed: September 30, 2020
    Publication date: March 31, 2022
    Inventors: Morteza Mardani Korani, Guilin Liu, Aysegul Dundar, Shiqiu Liu, Andrew J. Tao, Bryan Christopher Catanzaro
  • Publication number: 20220038653
    Abstract: Apparatuses, systems, and techniques to generate interpolated video frames. In at least one embodiment, an interpolated video frame is generated based, at least in part, on one of a plurality of possible motions of one or more objects from a first video frame to a second video frame.
    Type: Application
    Filed: July 30, 2020
    Publication date: February 3, 2022
    Inventors: Fitsum Reda, Karan Sapra, Robert Thomas Pottorff, Shiqiu Liu, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20220038654
    Abstract: Apparatuses, systems, and techniques to generate interpolated video frames. In at least one embodiment, an interpolated video frame is generated based, at least in part, on a first set of pixel data sampled from a first video frame, and a second set of pixel data sampled from a second video frame based, at least in part, on a set of forward pointing motion vectors from the first video frame to the second video frame.
    Type: Application
    Filed: July 30, 2020
    Publication date: February 3, 2022
    Inventors: Fitsum Reda, Karan Sapra, Robert Thomas Pottorff, Shiqiu Liu, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20220012536
    Abstract: A method, computer readable medium, and system are disclosed for creating an image utilizing a map representing different classes of specific pixels within a scene. One or more computing systems use the map to create a preliminary image. This preliminary image is then compared to an original image that was used to create the map. A determination is made whether the preliminary image matches the original image, and results of the determination are used to adjust the computing systems that created the preliminary image, which improves a performance of such computing systems. The adjusted computing systems are then used to create images based on different input maps representing various object classes of specific pixels within a scene.
    Type: Application
    Filed: September 23, 2021
    Publication date: January 13, 2022
    Inventors: Ting-Chun Wang, Ming-Yu Liu, Bryan Christopher Catanzaro, Jan Kautz, Andrew J. Tao
  • Publication number: 20210279841
    Abstract: Apparatuses, systems, and techniques for texture synthesis from small input textures in images using convolutional neural networks. In at least one embodiment, one or more convolutional layers are used in conjunction with one or more transposed convolution operations to generate a large textured output image from a small input textured image while preserving global features and texture, according to various novel techniques described herein.
    Type: Application
    Filed: March 9, 2020
    Publication date: September 9, 2021
    Inventors: Guilin Liu, Andrew Tao, Bryan Christopher Catanzaro, Ting-Chun Wang, Zhiding Yu, Shiqiu Liu, Fitsum Reda, Karan Sapra, Brandon Rowlett
  • Publication number: 20190147296
    Abstract: A method, computer readable medium, and system are disclosed for creating an image utilizing a map representing different classes of specific pixels within a scene. One or more computing systems use the map to create a preliminary image. This preliminary image is then compared to an original image that was used to create the map. A determination is made whether the preliminary image matches the original image, and results of the determination are used to adjust the computing systems that created the preliminary image, which improves a performance of such computing systems. The adjusted computing systems are then used to create images based on different input maps representing various object classes of specific pixels within a scene.
    Type: Application
    Filed: November 13, 2018
    Publication date: May 16, 2019
    Inventors: Ting-Chun Wang, Ming-Yu Liu, Bryan Christopher Catanzaro, Jan Kautz, Andrew J. Tao
  • Publication number: 20140149480
    Abstract: A system, method, and computer program product are provided for transposing a matrix. In use, a matrix is identified. Additionally, the matrix is transposed utilizing row-wise operations and column-wise operations, where the row-wise operations and the column-wise operations are performed independently.
    Type: Application
    Filed: October 24, 2013
    Publication date: May 29, 2014
    Applicant: NVIDIA Corporation
    Inventors: Bryan Christopher Catanzaro, Manjunath Kudlur