Patents by Inventor Steve Bako

Steve Bako has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10846828
    Abstract: The present disclosure relates to using a neural network to efficiently denoise images that were generated by a ray tracer. The neural network can be trained using noisy images generated with noisy samples and corresponding denoised or high-sampled images (e.g., many random samples). An input feature to the neural network can include color from pixels of an image. Other input features to the neural network, which would not be known in normal image processing, can include shading normal, depth, albedo, and other characteristics available from a computer-generated scene. After the neural network is trained, a noisy image that the neural network has not seen before can have noise removed without needing manual intervention.
    Type: Grant
    Filed: April 22, 2019
    Date of Patent: November 24, 2020
    Assignee: Pixar
    Inventors: Mark Meyer, Anthony DeRose, Steve Bako
  • Patent number: 10832091
    Abstract: A method of rendering an image includes Monte Carlo rendering a scene to produce a noisy image. The noisy image is processed to render an output image. The processing applies a machine learning model that utilizes colors and/or features from the rendering system for denoising the noisy image and/or to for adaptively placing samples during rendering.
    Type: Grant
    Filed: December 13, 2018
    Date of Patent: November 10, 2020
    Assignee: The Regents of the University of California
    Inventors: Pradeep Sen, Steve Bako, Nima Khademi Kalantari
  • Publication number: 20190251668
    Abstract: The present disclosure relates to using a neural network to efficiently denoise images that were generated by a ray tracer. The neural network can be trained using noisy images generated with noisy samples and corresponding denoised or high-sampled images (e.g., many random samples). An input feature to the neural network can include color from pixels of an image. Other input features to the neural network, which would not be known in normal image processing, can include shading normal, depth, albedo, and other characteristics available from a computer-generated scene. After the neural network is trained, a noisy image that the neural network has not seen before can have noise removed without needing manual intervention.
    Type: Application
    Filed: April 22, 2019
    Publication date: August 15, 2019
    Applicant: PIXAR
    Inventors: Mark Meyer, Anthony DeRose, Steve Bako
  • Patent number: 10311552
    Abstract: The present disclosure relates to using a neural network to efficiently denoise images that were generated by a ray tracer. The neural network can be trained using noisy images generated with noisy samples and corresponding denoised or high-sampled images (e.g., many random samples). An input feature to the neural network can include color from pixels of an image. Other input features to the neural network, which would not be known in normal image processing, can include shading normal, depth, albedo, and other characteristics available from a computer-generated scene. After the neural network is trained, a noisy image that the neural network has not seen before can have noise removed without needing manual intervention.
    Type: Grant
    Filed: June 22, 2017
    Date of Patent: June 4, 2019
    Assignee: Pixar
    Inventors: Mark Meyer, Anthony DeRose, Steve Bako
  • Publication number: 20190122076
    Abstract: A method of rendering an image includes Monte Carlo rendering a scene to produce a noisy image. The noisy image is processed to render an output image. The processing applies a machine learning model that utilizes colors and/or features from the rendering system for denoising the noisy image and/or to for adaptively placing samples during rendering.
    Type: Application
    Filed: December 13, 2018
    Publication date: April 25, 2019
    Inventors: Pradeep Sen, Steve Bako, Nima Khademi Kalantari
  • Patent number: 10192146
    Abstract: A method of rendering an image includes Monte Carlo rendering a scene to produce a noisy image. The noisy image is processed to render an output image. The processing applies a machine learning model that utilizes colors and/or features from the rendering system for denoising the noisy image and/or to for adaptively placing samples during rendering.
    Type: Grant
    Filed: December 13, 2017
    Date of Patent: January 29, 2019
    Assignee: The Regents of the University of California
    Inventors: Pradeep Sen, Steve Bako, Nima Khademi Kalantari
  • Publication number: 20180293710
    Abstract: The present disclosure relates to using a neural network to efficiently denoise images that were generated by a ray tracer. The neural network can be trained using noisy images generated with noisy samples and corresponding denoised or high-sampled images (e.g., many random samples). An input feature to the neural network can include color from pixels of an image. Other input features to the neural network, which would not be known in normal image processing, can include shading normal, depth, albedo, and other characteristics available from a computer-generated scene. After the neural network is trained, a noisy image that the neural network has not seen before can have noise removed without needing manual intervention.
    Type: Application
    Filed: June 22, 2017
    Publication date: October 11, 2018
    Applicant: PIXAR
    Inventors: Mark Meyer, Anthony DeRose, Steve Bako
  • Publication number: 20180114096
    Abstract: A method of rendering an image includes Monte Carlo rendering a scene to produce a noisy image. The noisy image is processed to render an output image. The processing applies a machine learning model that utilizes colors and/or features from the rendering system for denoising the noisy image and/or to for adaptively placing samples during rendering.
    Type: Application
    Filed: December 13, 2017
    Publication date: April 26, 2018
    Inventors: Pradeep Sen, Steve Bako, Nima Khademi Kalantari
  • Publication number: 20160321523
    Abstract: A method of producing noise-free images is disclosed. The method includes using machine learning incorporating a filter to output filter parameters using the training images. The machine learning may include training a neural network. The filter parameters are applied to Monte Carlo rendered training images that have noise to generate noise-free images. The training may include determining, computing and extracting features of the training images; computing filter parameters; applying an error metric; and applying backpropgation. The neural network may be a multilayer perceptron. The machine learning model is applied to new noisy Monte Carlo rendered images to create noise-free images. This may include applying the filter to the noisy Monte Carlo rendered images using the filter parameters to create the noise-free images.
    Type: Application
    Filed: May 2, 2016
    Publication date: November 3, 2016
    Inventors: Pradeep Sen, Nima Khademi Kalantari, Steve Bako