Patents by Inventor Marc S. Levoy

Marc S. Levoy has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11800235
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Grant
    Filed: August 19, 2019
    Date of Patent: October 24, 2023
    Assignee: Google LLC
    Inventors: Ryan Geiss, Marc S. Levoy, Samuel William Hasinoff, Tianfan Xue
  • Publication number: 20220256068
    Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.
    Type: Application
    Filed: August 19, 2019
    Publication date: August 11, 2022
    Inventors: Ryan GEISS, Marc S. LEVOY, Samuel William HASINOFF, Tianfan XUE
  • Patent number: 10317597
    Abstract: Various aspects of the present disclosure are directed toward optics and imaging. As may be implemented with one or more embodiments, an apparatus includes one or more phase masks that operate with an objective lens and a microlens array to alter a phase characteristic of light travelling in a path from a specimen, through the objective lens and microlens array and to a photosensor array. Using this approach, the specimen can be imaged with spatial resolution characteristics provided via the altered phase characteristic, which can facilitate construction of an image with enhanced resolution.
    Type: Grant
    Filed: August 17, 2015
    Date of Patent: June 11, 2019
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Noy Cohen, Marc S. Levoy, Michael J. Broxton, Logan Grosenick, Samuel Yang, Aaron Andalman, Karl A. Disseroth, Mark A. Horowitz
  • Patent number: 9807287
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Grant
    Filed: June 30, 2015
    Date of Patent: October 31, 2017
    Assignee: Board of Trustees of the Leland Stanford Junior University
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 9658443
    Abstract: Images are detected in a manner that addresses various challenges as discussed herein. As may be consistent with one or more embodiments, aspects are directed to an apparatus having sets of photosensors that detect light rays received at different angles from a specimen via a microlens array, with the light rays detected by each set of photosensors representing an aliased view of the specimen. An output indicative of aliased views of the specimen is provided. Certain embodiments further include a logic circuit that processes the output and generates a deconvolved volume image by combining aliased views of the specimen as detected by the photosensors.
    Type: Grant
    Filed: March 13, 2014
    Date of Patent: May 23, 2017
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Michael J. Broxton, Marc S. Levoy, Noy Cohen, Logan Grosenick, Samuel Yang, Karl A. Deisseroth
  • Patent number: 9479685
    Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.
    Type: Grant
    Filed: December 17, 2014
    Date of Patent: October 25, 2016
    Assignee: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
  • Publication number: 20160062100
    Abstract: Various aspects of the present disclosure are directed toward optics and imaging. As may be implemented with one or more embodiments, an apparatus includes one or more phase masks that operate with an objective lens and a microlens array to alter a phase characteristic of light travelling in a path from a specimen, through the objective lens and microlens array and to a photosensor array. Using this approach, the specimen can be imaged with spatial resolution characteristics provided via the altered phase characteristic, which can facilitate construction of an image with enhanced resolution.
    Type: Application
    Filed: August 17, 2015
    Publication date: March 3, 2016
    Inventors: Noy Cohen, Marc S. Levoy, Michael J. Broxton, Logan Grosenick, Samuel Yang, Aaron Andalman, Karl A. Deisseroth, Mark A. Horowitz
  • Publication number: 20150326848
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Application
    Filed: June 30, 2015
    Publication date: November 12, 2015
    Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 9143693
    Abstract: Imaging systems can often gather higher quality information about a field of view than the unaided human eye. For example, telescopes may magnify very distant objects, microscopes may magnify very small objects, and high frame-rate cameras may capture fast motion. The present disclosure includes devices and methods that provide real-time vision enhancement without the delay of replaying from storage media. The disclosed devices and methods may include a live view display and image and other information enhancements, which utilize in-line computation and constant control. The disclosure includes techniques for enabling push-button slow motion effects through buffer management and the adjustment of a display frame rate.
    Type: Grant
    Filed: June 10, 2014
    Date of Patent: September 22, 2015
    Assignee: Google Inc.
    Inventors: Changyin Zhou, Jiawen Chen, Marc S Levoy
  • Patent number: 9100557
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Grant
    Filed: March 19, 2014
    Date of Patent: August 4, 2015
    Assignee: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Publication number: 20150156402
    Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.
    Type: Application
    Filed: December 17, 2014
    Publication date: June 4, 2015
    Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
  • Publication number: 20140204184
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Application
    Filed: March 19, 2014
    Publication date: July 24, 2014
    Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 8717489
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Grant
    Filed: July 5, 2012
    Date of Patent: May 6, 2014
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 8698944
    Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.
    Type: Grant
    Filed: August 26, 2013
    Date of Patent: April 15, 2014
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
  • Patent number: 8648958
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Grant
    Filed: July 5, 2012
    Date of Patent: February 11, 2014
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 8547475
    Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.
    Type: Grant
    Filed: December 17, 2012
    Date of Patent: October 1, 2013
    Assignee: The Board of Trustees of the Leland Stanford Junior Univeristy
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Publication number: 20130033626
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Application
    Filed: July 5, 2012
    Publication date: February 7, 2013
    Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Patent number: 8358354
    Abstract: Digital images are computed using an approach for correcting lens aberration. According to an example embodiment of the present invention, a digital imaging arrangement implements microlenses to direct light to photosensors that detect the light and generate data corresponding to the detected light. The generated data is used to compute an output image, where each output image pixel value corresponds to a selective weighting and summation of a subset of the detected photosensor values. The weighting is a function of characteristics of the imaging arrangement. In some applications, the weighting reduces the contribution of data from photosensors that contribute higher amounts of optical aberration to the corresponding output image pixel.
    Type: Grant
    Filed: May 8, 2012
    Date of Patent: January 22, 2013
    Assignee: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S Levoy
  • Publication number: 20120300097
    Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).
    Type: Application
    Filed: July 5, 2012
    Publication date: November 29, 2012
    Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
  • Publication number: 20120229682
    Abstract: Digital images are computed using an approach for correcting lens aberration. According to an example embodiment of the present invention, a digital imaging arrangement implements microlenses to direct light to photosensors that detect the light and generate data corresponding to the detected light. The generated data is used to compute an output image, where each output image pixel value corresponds to a selective weighting and summation of a subset of the detected photosensor values. The weighting is a function of characteristics of the imaging arrangement. In some applications, the weighting reduces the contribution of data from photosensors that contribute higher amounts of optical aberration to the corresponding output image pixel.
    Type: Application
    Filed: May 8, 2012
    Publication date: September 13, 2012
    Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
    Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy