Patents by Inventor Jonathan Barron
Jonathan Barron has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12136203Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: GrantFiled: August 22, 2023Date of Patent: November 5, 2024Assignee: Google LLCInventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
-
Publication number: 20230401681Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: ApplicationFiled: August 22, 2023Publication date: December 14, 2023Inventors: Tiancheng Sun, Yun-Ta Tsai, Jonathan Barron
-
Patent number: 11776095Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: GrantFiled: April 1, 2019Date of Patent: October 3, 2023Assignee: Google LLCInventors: Tiancheng Sun, Yun-ta Tsai, Jonathan Barron
-
Patent number: 11640999Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.Type: GrantFiled: June 17, 2022Date of Patent: May 2, 2023Assignee: Moxtek, Inc.Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
-
Patent number: 11490070Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.Type: GrantFiled: May 17, 2021Date of Patent: November 1, 2022Assignee: Google LLCInventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
-
Publication number: 20220320353Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.Type: ApplicationFiled: June 17, 2022Publication date: October 6, 2022Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
-
Patent number: 11398573Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.Type: GrantFiled: September 6, 2019Date of Patent: July 26, 2022Assignee: Moxtek, IncInventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
-
Patent number: 11113832Abstract: Example embodiments allow for training of artificial neural networks (ANNs) to generate depth maps based on images. The ANNs are trained based on a plurality of sets of images, where each set of images represents a single scene and the images in such a set of images differ with respect to image aperture and/or focal distance. An untrained ANN generates a depth map based on one or more images in a set of images. This depth map is used to generate, using the image(s) in the set, a predicted image that corresponds, with respect to image aperture and/or focal distance, to one of the images in the set. Differences between the predicted image and the corresponding image are used to update the ANN. ANNs tramed in this manner are especially suited for generating depth maps used to perform simulated image blur on small-aperture images.Type: GrantFiled: November 3, 2017Date of Patent: September 7, 2021Assignee: Google LLCInventors: Neal Wadhwa, Jonathan Barron, Rahul Garg, Pratul Srinivasan
-
Publication number: 20210274151Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.Type: ApplicationFiled: May 17, 2021Publication date: September 2, 2021Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
-
Publication number: 20210264576Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: ApplicationFiled: April 1, 2019Publication date: August 26, 2021Inventors: Tiancheng SUN, Yun-ta TSAI, Jonathan BARRON
-
Publication number: 20210183089Abstract: Example embodiments allow for training of artificial neural networks (ANNs) to generate depth maps based on images. The ANNs are trained based on a plurality of sets of images, where each set of images represents a single scene and the images in such a set of images differ with respect to image aperture and/or focal distance. An untrained ANN generates a depth map based on one or more images in a set of images. This depth map is used to generate, using the image(s) in the set, a predicted image that corresponds, with respect to image aperture and/or focal distance, to one of the images in the set. Differences between the predicted image and the corresponding image are used to update the ANN. ANNs tramed in this manner are especially suited for generating depth maps used to perform simulated image blur on small-aperture images.Type: ApplicationFiled: November 3, 2017Publication date: June 17, 2021Inventors: Neal Wadhwa, Jonathan Barron, Rahul Garg, Pratul Srinivasan
-
Patent number: 11039122Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.Type: GrantFiled: September 4, 2018Date of Patent: June 15, 2021Assignee: Google LLCInventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
-
Patent number: 10949958Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map. These methods for estimating illumination chrominance values for input images have reduced computational costs and increased speed relative to other methods for determining image illuminant chrominance values.Type: GrantFiled: November 14, 2017Date of Patent: March 16, 2021Assignee: Google LLCInventors: Jonathan Barron, Yun-Ta Tsai
-
Publication number: 20200105948Abstract: An x-ray detector can be small and have efficient cooling. In one embodiment, the x-ray detector can comprise a thermoelectric cooler (TEC) with upper electrical connections, a support, a cap, and a silicon drift detector (SDD). A planar side of the support can be directly affixed to upper electrical connections of the TEC. The support can have a non-planar side, opposite of the planar side, with a raised structure. A bottom face of the cap can be affixed to the raised structure, forming a cavity between the cap and the non-planar side of the support. The SDD can be affixed to a top face of the cap. In another embodiment, the non-planar side of the support can face the TEC. In another embodiment, a PIN photodiode can be directly affixed to a plate and the plate directly affixed to upper electrical connections of the TEC.Type: ApplicationFiled: September 6, 2019Publication date: April 2, 2020Inventors: Jason Maynard, Shawn S. Chin, Jonathan Barron, David S. Hoffman
-
Publication number: 20200077076Abstract: Scenes can be imaged under low-light conditions using flash photography. However, the flash can be irritating to individuals being photographed, especially when those individuals' eyes have adapted to the dark. Additionally, portions of images generated using a flash can appear washed-out or otherwise negatively affected by the flash. These issues can be addressed by using a flash at an invisible wavelength, e.g., an infrared and/or ultraviolet flash. At the same time a scene is being imaged, at the invisible wavelength of the invisible flash, the scene can also be imaged at visible wavelengths. This can include simultaneously using both a standard RGB camera and a modified visible-plus-invisible-wavelengths camera (e.g., an “IR-G-UV” camera). The visible and invisible image data can then be combined to generate an improved visible-light image of the scene, e.g., that approximates a visible light image of the scene, had the scene been illuminated during daytime light conditions.Type: ApplicationFiled: September 4, 2018Publication date: March 5, 2020Inventors: Tianfan Xue, Jian Wang, Jiawen Chen, Jonathan Barron
-
Patent number: 10579908Abstract: Systems and methods described herein may relate to image transformation utilizing a plurality of deep neural networks. An example method includes receiving, at a mobile device, a plurality of image processing parameters. The method also includes causing an image sensor of the mobile device to capture an initial image and receiving, at a coefficient prediction neural network at the mobile device, an input image based on the initial image. The method further includes determining, using the coefficient prediction neural network, an image transformation model based on the input image and at least a portion of the plurality of image processing parameters. The method additionally includes receiving, at a rendering neural network at the mobile device, the initial image and the image transformation model. Yet further, the method includes generating, by the rendering neural network, a rendered image based on the initial image, according to the image transformation model.Type: GrantFiled: December 15, 2017Date of Patent: March 3, 2020Assignee: Google LLCInventors: Jiawen Chen, Samuel Hasinoff, Michael Gharbi, Jonathan Barron
-
Publication number: 20200051225Abstract: Methods for white-balancing images are provided. These methods include determining, for an input image, a chrominance histogram for the pixels of the input image. The determined histogram is a toroidal chrominance histogram, with an underlying, toroidal chrominance space that corresponds to a wrapped version, of a standard flat chrominance space. The toroidal chrominance histogram is- then convolved with a fitter to generate a two-dimensional heat map that is then used to determine art estimated chrominance of i|lummaiioB present id the input image; This can include fitting a bivariate von Mises distribution, or some other circular and/or toroidal, probability distribution, to the determined two-dimensional heat map.Type: ApplicationFiled: November 14, 2017Publication date: February 13, 2020Inventors: Jonathan Barron, Yun-Ta Tsai
-
Publication number: 20190188535Abstract: Systems and methods described herein may relate to image transformation utilizing a plurality of deep neural networks. An example method includes receiving, at a mobile device, a plurality of image processing parameters. The method also includes causing an image sensor of the mobile device to capture an initial image and receiving, at a coefficient prediction neural network at the mobile device, an input image based on the initial image. The method further includes determining, using the coefficient prediction neural network, an image transformation model based on the input image and at least a portion of the plurality of image processing parameters. The method additionally includes receiving, at a rendering neural network at the mobile device, the initial image and the image transformation model. Yet further, the method includes generating, by the rendering neural network, a rendered image based on the initial image, according to the image transformation model.Type: ApplicationFiled: December 15, 2017Publication date: June 20, 2019Inventors: Jiawen Chen, Samuel Hasinoff, Michael Gharbi, Jonathan Barron