Patents by Inventor Marc Levoy
Marc Levoy has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240395035Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: ApplicationFiled: July 31, 2024Publication date: November 28, 2024Inventors: Ryan Geiss, Ruido Yang, Marc Levoy
-
Patent number: 12056925Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: GrantFiled: January 15, 2019Date of Patent: August 6, 2024Assignee: Google LLCInventors: Ryan Geiss, Ruiduo Yang, Marc Levoy
-
Patent number: 11599747Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: GrantFiled: November 6, 2020Date of Patent: March 7, 2023Assignee: Google LLCInventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Publication number: 20220076018Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: ApplicationFiled: January 15, 2019Publication date: March 10, 2022Inventors: Ryan Geiss, Ruiduo Yang, Marc Levoy
-
Patent number: 11210799Abstract: A camera may capture an image of a scene and use the image to generate a first and a second subpixel image of the scene. The pair of subpixel images may be represented by a first set of subpixels and a second set of subpixels from the image respectively. Each pixel of the image may include two green subpixels that are respectively represented in the first and second subpixel images. The camera may determine a disparity between a portion of the scene as represented by the pair of subpixel images and may estimate a depth map of the scene that indicates a depth of the portion relative to other portions of the scene based on the disparity and a baseline distance between the two green subpixels. A new version of the image may be generated with a focus upon the portion and with the other portions of the scene blurred.Type: GrantFiled: December 5, 2017Date of Patent: December 28, 2021Assignee: Google LLCInventors: David Jacobs, Rahul Garg, Yael Pritch Knaan, Neal Wadhwa, Marc Levoy
-
Publication number: 20210056349Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: ApplicationFiled: November 6, 2020Publication date: February 25, 2021Inventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Patent number: 10860889Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: GrantFiled: January 11, 2019Date of Patent: December 8, 2020Assignee: Google LLCInventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Publication number: 20200242788Abstract: A camera may capture an image of a scene and use the image to generate a first and a second subpixel image of the scene. The pair of subpixel images may be represented by a first set of subpixels and a second set of subpixels from the image respectively. Each pixel of the image may include two green subpixels that are respectively represented in the first and second subpixel images. The camera may determine a disparity between a portion of the scene as represented by the pair of subpixel images and may estimate a depth map of the scene that indicates a depth of the portion relative to other portions of the scene based on the disparity and a baseline distance between the two green subpixels. A new version of the image may be generated with a focus upon the portion and with the other portions of the scene blurred.Type: ApplicationFiled: December 5, 2017Publication date: July 30, 2020Inventors: David Jacobs, Rahul Garg, Yael Pritch Knaan, Neal Wadhwa, Marc Levoy
-
Publication number: 20200226419Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: ApplicationFiled: January 11, 2019Publication date: July 16, 2020Inventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Patent number: 9615012Abstract: A device may operate a first image-capture system to capture first image data of a scene. While the first image-capture system is capturing the first image data, the device may operate a second image-capture system to determine an updated value for the first image setting, and send an instruction to the first image-capture system that indicates to use the updated value for the first image setting to continue to capture the first image data.Type: GrantFiled: September 30, 2013Date of Patent: April 4, 2017Assignee: Google Inc.Inventors: Ryan Burgess Geiss, Marc Levoy, Roman Lewkow
-
Patent number: 9013592Abstract: An apparatus, method and computer program product for presenting burst images are provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location.Type: GrantFiled: July 17, 2013Date of Patent: April 21, 2015Assignee: Nokia CorporationInventors: Marc Levoy, Natasha Gelfand, Wei-Chao Chen, Kari Antero Pulli
-
Publication number: 20150092066Abstract: A device may operate a first image-capture system to capture first image data of a scene. While the first image-capture system is capturing the first image data, the device may operate a second image-capture system to determine an updated value for the first image setting, and send an instruction to the first image-capture system that indicates to use the updated value for the first image setting to continue to capture the first image data.Type: ApplicationFiled: September 30, 2013Publication date: April 2, 2015Applicant: Google Inc.Inventors: Ryan Burgess Geiss, Marc Levoy, Roman Lewkow
-
Publication number: 20130300910Abstract: An apparatus, method and computer program product for presenting burst images are provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location.Type: ApplicationFiled: July 17, 2013Publication date: November 14, 2013Inventors: Marc Levoy, Natasha Gelfand, Wei-Chao Chen, Kari Antero Pulli
-
Patent number: 8497920Abstract: An apparatus for presenting burst images is provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter, such as, but not limited to, exposure, focus, and/or time, or to the state of a target, such as the varying facial expression of a person. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location.Type: GrantFiled: June 11, 2008Date of Patent: July 30, 2013Assignee: Nokia CorporationInventors: Marc Levoy, Natasha Gelfand, Wei-Chao Chen, Kari Antero Pulli
-
Patent number: 8411962Abstract: A computing device may select a source tile from a source image. From the source tile, the computing device may select a first rectangular feature and a second rectangular feature. Based on the first and second rectangular features, the computing device may calculate a source feature vector. The computing device may also select a search area of a target image, and a target tile within the within the search area. Based on the target tile, the computing device may calculate a target feature vector. The computing device may determine that a difference between the source feature vector and the target feature vector is below an error threshold, and based on this determination, further determine a mapping between the source image and the target image. The computing device may then apply the mapping to the source image to produce a transformed source image.Type: GrantFiled: April 27, 2012Date of Patent: April 2, 2013Assignee: Google Inc.Inventors: Ryan Geiss, Marc Levoy
-
Patent number: 8218963Abstract: Using photographic flash for candid shots often results in an unevenly lit scene, in which objects in the back appear dark. A spatially adaptive photographic flash (100) is disclosed, in which the intensity of illumination (21, 23) varies depending on the depth and reflectivity (30, 101) of features in the scene. Adaption to changes in depth are used in a single-shot method. Adaption to changes in reflectivity are used in a multishot method. The single-shot method requires only a depth image (30), whereas the multi-shot method requires at least one color image (40) in addition to the depth data (30).Type: GrantFiled: February 4, 2009Date of Patent: July 10, 2012Assignee: ETH ZuerichInventors: Rolf Adelsberger, Markus Gross, Marc Levoy, Remo Ziegler
-
Patent number: 8200020Abstract: A computing device may select a source tile from a source image. From the source tile, the computing device may select a first rectangular feature and a second rectangular feature. Based on the first and second rectangular features, the computing device may calculate a source feature vector. The computing device may also select a search area of a target image, and a target tile within the within the search area. Based on the target tile, the computing device may calculate a target feature vector. The computing device may determine that a difference between the source feature vector and the target feature vector is below an error threshold, and based on this determination, further determine a mapping between the source image and the target image. The computing device may then apply the mapping to the source image to produce a transformed source image.Type: GrantFiled: November 28, 2011Date of Patent: June 12, 2012Assignee: Google Inc.Inventors: Ryan Geiss, Marc Levoy
-
Patent number: 8174739Abstract: Systems and methods using polarized filtering for glare removal to improve the process of scanning documents, particularly bound documents with glossy content, are disclosed. The system may generally include a lighting source for illuminating a document, a lighting source polarizer attached to the lighting source to polarize light therefrom, a camera for capturing images of the document, and a camera polarizer attached to the camera. The camera polarizer and the lighting source polarizer may be positioned relative to each other so as to facilitate blocking light reflections causing glare off of the document resulting from the lighting source and arriving at the camera. The system may include multiple lighting sources, some or all of which may have a lighting source polarizer attached thereto.Type: GrantFiled: July 14, 2009Date of Patent: May 8, 2012Assignee: Google Inc.Inventors: Robert A. Proudfoot, Marc Levoy
-
Publication number: 20110123183Abstract: Using photographic flash for candid shots often results in an unevenly lit scene, in which objects in the back appear dark. A spatially adaptive photographic flash (100) is disclosed, in which the intensity of illumination (21, 23) varies depending on the depth and reflectivity (30, 101) of features in the scene. Adaption to changes in depth are used in a single-shot method. Adaption to changes in reflectivity are used in a multishot method. The single-shot method requires only a depth image (30), whereas the multi-shot method requires at least one color image (40) in addition to the depth data (30).Type: ApplicationFiled: February 4, 2009Publication date: May 26, 2011Applicant: Eth ZurichInventors: Rolf Adelsberger, Markus Gross, Marc Levoy, Remo Ziegler
-
Patent number: D985011Type: GrantFiled: October 10, 2019Date of Patent: May 2, 2023Assignee: GOOGLE LLCInventors: Michelle Chen, Ryan Geiss, Marc Levoy, Kelly Tsai, Chorong Johnston, Alexander Schiffhauer, Samuel Hasinoff