Patents by Inventor Marc A. Levoy
Marc A. Levoy has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240395035Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: ApplicationFiled: July 31, 2024Publication date: November 28, 2024Inventors: Ryan Geiss, Ruido Yang, Marc Levoy
-
Patent number: 12056925Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: GrantFiled: January 15, 2019Date of Patent: August 6, 2024Assignee: Google LLCInventors: Ryan Geiss, Ruiduo Yang, Marc Levoy
-
Patent number: 11599747Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: GrantFiled: November 6, 2020Date of Patent: March 7, 2023Assignee: Google LLCInventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Publication number: 20220343525Abstract: Example implementations relate to joint depth prediction from dual cameras and dual pixels. An example method may involve obtaining a first set of depth information representing a scene from a first source and a second set of depth information representing the scene from a second source. The method may further involve determining, using a neural network, a joint depth map that conveys respective depths for elements in the scene. The neural network may determine the joint depth map based on a combination of the first set of depth information and the second set of depth information. In addition, the method may involve modifying an image representing the scene based on the joint depth map. For example, background portions of the image may be partially blurred based on the joint depth map.Type: ApplicationFiled: April 27, 2020Publication date: October 27, 2022Inventors: Rahul GARG, Neal WADHWA, Sean FANELLO, Christian HAENE, Yinda ZHANG, Sergio Orts ESCOLANO, Yael Pritch KNAAN, Marc LEVOY, Shahram IZADI
-
Publication number: 20220076018Abstract: Apparatus and methods related to photography are provided. A computing device can receive an input image. An object detector of the computing device can determine an object region of interest of the input image that is associated with an object detected in the input image. A trained machine learning algorithm can determine an output photographic region of interest for the input image based on the object region of interest and the input image. The machine learning algorithm can be trained to identify an output photographic region of interest that is suitable for use by a photographic function for image generation. The computing device can generate an output related to the output photographic region of interest.Type: ApplicationFiled: January 15, 2019Publication date: March 10, 2022Inventors: Ryan Geiss, Ruiduo Yang, Marc Levoy
-
Patent number: 11210799Abstract: A camera may capture an image of a scene and use the image to generate a first and a second subpixel image of the scene. The pair of subpixel images may be represented by a first set of subpixels and a second set of subpixels from the image respectively. Each pixel of the image may include two green subpixels that are respectively represented in the first and second subpixel images. The camera may determine a disparity between a portion of the scene as represented by the pair of subpixel images and may estimate a depth map of the scene that indicates a depth of the portion relative to other portions of the scene based on the disparity and a baseline distance between the two green subpixels. A new version of the image may be generated with a focus upon the portion and with the other portions of the scene blurred.Type: GrantFiled: December 5, 2017Date of Patent: December 28, 2021Assignee: Google LLCInventors: David Jacobs, Rahul Garg, Yael Pritch Knaan, Neal Wadhwa, Marc Levoy
-
Publication number: 20210056349Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: ApplicationFiled: November 6, 2020Publication date: February 25, 2021Inventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Patent number: 10860889Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: GrantFiled: January 11, 2019Date of Patent: December 8, 2020Assignee: Google LLCInventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Publication number: 20200242788Abstract: A camera may capture an image of a scene and use the image to generate a first and a second subpixel image of the scene. The pair of subpixel images may be represented by a first set of subpixels and a second set of subpixels from the image respectively. Each pixel of the image may include two green subpixels that are respectively represented in the first and second subpixel images. The camera may determine a disparity between a portion of the scene as represented by the pair of subpixel images and may estimate a depth map of the scene that indicates a depth of the portion relative to other portions of the scene based on the disparity and a baseline distance between the two green subpixels. A new version of the image may be generated with a focus upon the portion and with the other portions of the scene blurred.Type: ApplicationFiled: December 5, 2017Publication date: July 30, 2020Inventors: David Jacobs, Rahul Garg, Yael Pritch Knaan, Neal Wadhwa, Marc Levoy
-
Publication number: 20200226419Abstract: Apparatus and methods related to using machine learning to determine depth maps for dual pixel images of objects are provided. A computing device can receive a dual pixel image of at least a foreground object. The dual pixel image can include a plurality of dual pixels. A dual pixel of the plurality of dual pixels can include a left-side pixel and a right-side pixel that both represent light incident on a single dual pixel element used to capture the dual pixel image. The computing device can be used to train a machine learning system to determine a depth map associated with the dual pixel image. The computing device can provide the trained machine learning system.Type: ApplicationFiled: January 11, 2019Publication date: July 16, 2020Inventors: Yael Pritch Knaan, Marc Levoy, Neal Wadhwa, Rahul Garg, Sameer Ansari, Jiawen Chen
-
Patent number: 9615012Abstract: A device may operate a first image-capture system to capture first image data of a scene. While the first image-capture system is capturing the first image data, the device may operate a second image-capture system to determine an updated value for the first image setting, and send an instruction to the first image-capture system that indicates to use the updated value for the first image setting to continue to capture the first image data.Type: GrantFiled: September 30, 2013Date of Patent: April 4, 2017Assignee: Google Inc.Inventors: Ryan Burgess Geiss, Marc Levoy, Roman Lewkow
-
Patent number: 9013592Abstract: An apparatus, method and computer program product for presenting burst images are provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location.Type: GrantFiled: July 17, 2013Date of Patent: April 21, 2015Assignee: Nokia CorporationInventors: Marc Levoy, Natasha Gelfand, Wei-Chao Chen, Kari Antero Pulli
-
Publication number: 20150092066Abstract: A device may operate a first image-capture system to capture first image data of a scene. While the first image-capture system is capturing the first image data, the device may operate a second image-capture system to determine an updated value for the first image setting, and send an instruction to the first image-capture system that indicates to use the updated value for the first image setting to continue to capture the first image data.Type: ApplicationFiled: September 30, 2013Publication date: April 2, 2015Applicant: Google Inc.Inventors: Ryan Burgess Geiss, Marc Levoy, Roman Lewkow
-
Patent number: 8953064Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: September 16, 2014Date of Patent: February 10, 2015Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20150029388Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal, plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: September 16, 2014Publication date: January 29, 2015Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Patent number: 8866957Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: August 26, 2013Date of Patent: October 21, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Partrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20140049663Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: August 26, 2013Publication date: February 20, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20140028892Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: August 26, 2013Publication date: January 30, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20130300910Abstract: An apparatus, method and computer program product for presenting burst images are provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location.Type: ApplicationFiled: July 17, 2013Publication date: November 14, 2013Inventors: Marc Levoy, Natasha Gelfand, Wei-Chao Chen, Kari Antero Pulli
-
Patent number: D985011Type: GrantFiled: October 10, 2019Date of Patent: May 2, 2023Assignee: GOOGLE LLCInventors: Michelle Chen, Ryan Geiss, Marc Levoy, Kelly Tsai, Chorong Johnston, Alexander Schiffhauer, Samuel Hasinoff