Patents by Inventor Marc S. Levoy
Marc S. Levoy has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11800235Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: GrantFiled: August 19, 2019Date of Patent: October 24, 2023Assignee: Google LLCInventors: Ryan Geiss, Marc S. Levoy, Samuel William Hasinoff, Tianfan Xue
-
Publication number: 20220256068Abstract: Apparatus and methods related to applying lighting models to images of objects are provided. A neural network can be trained to apply a lighting model to an input image. The training of the neural network can utilize confidence learning that is based on light predictions and prediction confidence values associated with lighting of the input image. A computing device can receive an input image of an object and data about a particular lighting model to be applied to the input image. The computing device can determine an output image of the object by using the trained neural network to apply the particular lighting model to the input image of the object.Type: ApplicationFiled: August 19, 2019Publication date: August 11, 2022Inventors: Ryan GEISS, Marc S. LEVOY, Samuel William HASINOFF, Tianfan XUE
-
Patent number: 10317597Abstract: Various aspects of the present disclosure are directed toward optics and imaging. As may be implemented with one or more embodiments, an apparatus includes one or more phase masks that operate with an objective lens and a microlens array to alter a phase characteristic of light travelling in a path from a specimen, through the objective lens and microlens array and to a photosensor array. Using this approach, the specimen can be imaged with spatial resolution characteristics provided via the altered phase characteristic, which can facilitate construction of an image with enhanced resolution.Type: GrantFiled: August 17, 2015Date of Patent: June 11, 2019Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Noy Cohen, Marc S. Levoy, Michael J. Broxton, Logan Grosenick, Samuel Yang, Aaron Andalman, Karl A. Disseroth, Mark A. Horowitz
-
Patent number: 9807287Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: June 30, 2015Date of Patent: October 31, 2017Assignee: Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 9658443Abstract: Images are detected in a manner that addresses various challenges as discussed herein. As may be consistent with one or more embodiments, aspects are directed to an apparatus having sets of photosensors that detect light rays received at different angles from a specimen via a microlens array, with the light rays detected by each set of photosensors representing an aliased view of the specimen. An output indicative of aliased views of the specimen is provided. Certain embodiments further include a logic circuit that processes the output and generates a deconvolved volume image by combining aliased views of the specimen as detected by the photosensors.Type: GrantFiled: March 13, 2014Date of Patent: May 23, 2017Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Michael J. Broxton, Marc S. Levoy, Noy Cohen, Logan Grosenick, Samuel Yang, Karl A. Deisseroth
-
Patent number: 9479685Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: December 17, 2014Date of Patent: October 25, 2016Assignee: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
-
Publication number: 20160062100Abstract: Various aspects of the present disclosure are directed toward optics and imaging. As may be implemented with one or more embodiments, an apparatus includes one or more phase masks that operate with an objective lens and a microlens array to alter a phase characteristic of light travelling in a path from a specimen, through the objective lens and microlens array and to a photosensor array. Using this approach, the specimen can be imaged with spatial resolution characteristics provided via the altered phase characteristic, which can facilitate construction of an image with enhanced resolution.Type: ApplicationFiled: August 17, 2015Publication date: March 3, 2016Inventors: Noy Cohen, Marc S. Levoy, Michael J. Broxton, Logan Grosenick, Samuel Yang, Aaron Andalman, Karl A. Deisseroth, Mark A. Horowitz
-
Publication number: 20150326848Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: ApplicationFiled: June 30, 2015Publication date: November 12, 2015Inventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 9143693Abstract: Imaging systems can often gather higher quality information about a field of view than the unaided human eye. For example, telescopes may magnify very distant objects, microscopes may magnify very small objects, and high frame-rate cameras may capture fast motion. The present disclosure includes devices and methods that provide real-time vision enhancement without the delay of replaying from storage media. The disclosed devices and methods may include a live view display and image and other information enhancements, which utilize in-line computation and constant control. The disclosure includes techniques for enabling push-button slow motion effects through buffer management and the adjustment of a display frame rate.Type: GrantFiled: June 10, 2014Date of Patent: September 22, 2015Assignee: Google Inc.Inventors: Changyin Zhou, Jiawen Chen, Marc S Levoy
-
Patent number: 9100557Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: March 19, 2014Date of Patent: August 4, 2015Assignee: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Publication number: 20150156402Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: December 17, 2014Publication date: June 4, 2015Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
-
Publication number: 20140204184Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: ApplicationFiled: March 19, 2014Publication date: July 24, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 8717489Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: July 5, 2012Date of Patent: May 6, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 8698944Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: August 26, 2013Date of Patent: April 15, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Ren Ng, Patrick Hanrahan, Marc S. Levoy, Mark A. Horowitz
-
Patent number: 8648958Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: July 5, 2012Date of Patent: February 11, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 8547475Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: December 17, 2012Date of Patent: October 1, 2013Assignee: The Board of Trustees of the Leland Stanford Junior UniveristyInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Publication number: 20130033626Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: ApplicationFiled: July 5, 2012Publication date: February 7, 2013Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 8358354Abstract: Digital images are computed using an approach for correcting lens aberration. According to an example embodiment of the present invention, a digital imaging arrangement implements microlenses to direct light to photosensors that detect the light and generate data corresponding to the detected light. The generated data is used to compute an output image, where each output image pixel value corresponds to a selective weighting and summation of a subset of the detected photosensor values. The weighting is a function of characteristics of the imaging arrangement. In some applications, the weighting reduces the contribution of data from photosensors that contribute higher amounts of optical aberration to the corresponding output image pixel.Type: GrantFiled: May 8, 2012Date of Patent: January 22, 2013Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S Levoy
-
Publication number: 20120300097Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: ApplicationFiled: July 5, 2012Publication date: November 29, 2012Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Publication number: 20120229682Abstract: Digital images are computed using an approach for correcting lens aberration. According to an example embodiment of the present invention, a digital imaging arrangement implements microlenses to direct light to photosensors that detect the light and generate data corresponding to the detected light. The generated data is used to compute an output image, where each output image pixel value corresponds to a selective weighting and summation of a subset of the detected photosensor values. The weighting is a function of characteristics of the imaging arrangement. In some applications, the weighting reduces the contribution of data from photosensors that contribute higher amounts of optical aberration to the corresponding output image pixel.Type: ApplicationFiled: May 8, 2012Publication date: September 13, 2012Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy