Patents by Inventor Jonathan Barron

Jonathan Barron has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12136203
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Grant
    Filed: August 22, 2023
    Date of Patent: November 5, 2024
    Assignee: Google LLC
    Inventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
  • Publication number: 20230401681
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Application
    Filed: August 22, 2023
    Publication date: December 14, 2023
    Inventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
  • Patent number: 11776095
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Grant
    Filed: April 1, 2019
    Date of Patent: October 3, 2023
    Assignee: Google LLC
    Inventors: Tiancheng Sun, Yun-ta Tsai, Jonathan Barron
  • Patent number: 11640999
    Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.
    Type: Grant
    Filed: June 17, 2022
    Date of Patent: May 2, 2023
    Assignee: Moxtek, Inc.
    Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
  • Patent number: 11490070
    Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: November 1, 2022
    Assignee: Google LLC
    Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
  • Publication number: 20220320353
    Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.
    Type: Application
    Filed: June 17, 2022
    Publication date: October 6, 2022
    Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
  • Patent number: 11398573
    Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.
    Type: Grant
    Filed: September 6, 2019
    Date of Patent: July 26, 2022
    Assignee: Moxtek, Inc
    Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
  • Patent number: 11113832
    Abstract: Example embodiments allow for training of artificial neural networks (ANNs) to generate depth maps based on images. The ANNs are trained based on a plurality of sets of images, where each set of images represents a single scene and the images in such a set of images differ with respect to image aperture and/or focal distance. An untrained ANN generates a depth map based on one or more images in a set of images. This depth map is used to generate, using the image(s) in the set, a predicted image that corresponds, with respect to image aperture and/or focal distance, to one of the images in the set. Differences between the predicted image and the corresponding image are used to update the ANN. ANNs tramed in this manner are especially suited for generating depth maps used to perform simulated image blur on small-aperture images.
    Type: Grant
    Filed: November 3, 2017
    Date of Patent: September 7, 2021
    Assignee: Google LLC
    Inventors: Neal Wadhwa, Jonathan Barron, Rahul Garg, Pratul Srinivasan
  • Publication number: 20210274151
    Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
    Type: Application
    Filed: May 17, 2021
    Publication date: September 2, 2021
    Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
  • Publication number: 20210264576
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Application
    Filed: April 1, 2019
    Publication date: August 26, 2021
    Inventors: Tiancheng SUN, Yun-ta TSAI, Jonathan BARRON
  • Publication number: 20210183089
    Abstract: Example embodiments allow for training of artificial neural networks (ANNs) to generate depth maps based on images. The ANNs are trained based on a plurality of sets of images, where each set of images represents a single scene and the images in such a set of images differ with respect to image aperture and/or focal distance. An untrained ANN generates a depth map based on one or more images in a set of images. This depth map is used to generate, using the image(s) in the set, a predicted image that corresponds, with respect to image aperture and/or focal distance, to one of the images in the set. Differences between the predicted image and the corresponding image are used to update the ANN. ANNs tramed in this manner are especially suited for generating depth maps used to perform simulated image blur on small-aperture images.
    Type: Application
    Filed: November 3, 2017
    Publication date: June 17, 2021
    Inventors: Neal Wadhwa, Jonathan Barron, Rahul Garg, Pratul Srinivasan
  • Patent number: 11039122
    Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: June 15, 2021
    Assignee: Google LLC
    Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
  • Patent number: 10949958
    Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map. These methods for estimating illumination chrominance values for input images have reduced computational costs and increased speed relative to other methods for determining image illuminant chrominance values.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: March 16, 2021
    Assignee: Google LLC
    Inventors: Jonathan Barron, Yun-Ta Tsai
  • Publication number: 20200105948
    Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.
    Type: Application
    Filed: September 6, 2019
    Publication date: April 2, 2020
    Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
  • Publication number: 20200077076
    Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.
    Type: Application
    Filed: September 4, 2018
    Publication date: March 5, 2020
    Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
  • Patent number: 10579908
    Abstract: Systems and methods described herein may relate to image transformation utilizing a plurality of deep neural networks. An example method includes receiving, at a mobile device, a plurality of image processing parameters. The method also includes causing an image sensor of the mobile device to capture an initial image and receiving, at a coefficient prediction neural network at the mobile device, an input image based on the initial image. The method further includes determining, using the coefficient prediction neural network, an image transformation model based on the input image and at least a portion of the plurality of image processing parameters. The method additionally includes receiving, at a rendering neural network at the mobile device, the initial image and the image transformation model. Yet further, the method includes generating, by the rendering neural network, a rendered image based on the initial image, according to the image transformation model.
    Type: Grant
    Filed: December 15, 2017
    Date of Patent: March 3, 2020
    Assignee: Google LLC
    Inventors: Jiawen Chen, Samuel Hasinoff, Michael Gharbi, Jonathan Barron
  • Publication number: 20200051225
    Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map.
    Type: Application
    Filed: November 14, 2017
    Publication date: February 13, 2020
    Inventors: Jonathan Barron, Yun-Ta Tsai
  • Publication number: 20190188535
    Abstract: Systems and methods described herein may relate to image transformation utilizing a plurality of deep neural networks. An example method includes receiving, at a mobile device, a plurality of image processing parameters. The method also includes causing an image sensor of the mobile device to capture an initial image and receiving, at a coefficient prediction neural network at the mobile device, an input image based on the initial image. The method further includes determining, using the coefficient prediction neural network, an image transformation model based on the input image and at least a portion of the plurality of image processing parameters. The method additionally includes receiving, at a rendering neural network at the mobile device, the initial image and the image transformation model. Yet further, the method includes generating, by the rendering neural network, a rendered image based on the initial image, according to the image transformation model.
    Type: Application
    Filed: December 15, 2017
    Publication date: June 20, 2019
    Inventors: Jiawen Chen, Samuel Hasinoff, Michael Gharbi, Jonathan Barron