Patents by Inventor Yi-Ren Ng
Yi-Ren Ng has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20150029388Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal, plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: September 16, 2014Publication date: January 29, 2015Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20150029386Abstract: Light-field image data is processed in a manner that reduces projection artifacts in the presence of variation in microlens position by calibrating microlens positions. Approximate centers of disks in a light-field image are identified, and gridded calibration is performed, by fitting lines to disk centers along orthogonal directions, and then fitting a rigid grid to the light-field image. For each grid region, a corresponding disk center is computed, and a displacement vector is generated. For each grid region, the final disk center is computed as the vector sum of the grid region's geometric center and displacement vector. Calibration data, including displacement vectors, is then used in calibrating disk centers for more accurate projection of light-field images. In at least one embodiment, the imaging geometry is arranged so that disks are separated by a gap, so as to limit or eliminate ghosting.Type: ApplicationFiled: August 11, 2014Publication date: January 29, 2015Inventors: Colvin Pitts, Timothy James Knight, Chia-Kai Liang, Yi-Ren Ng
-
Patent number: 8908058Abstract: According to various embodiments, multiple frames, each having image data and metadata, can be aggregated into pictures. The frames may come from different image capture devices, enabling aggregation of image data from multiple sources. Aggregation can be automatic, or it can be performed in response to user input specifying particular combinations of frames to be aggregated. In various embodiments, pictures are mutable, whereas immutability of the constituent frames is enforced. In various embodiments, certain metadata elements that are not essential to rendering can be selectively removed from frames, so as to address privacy concerns. In various embodiments, frames can be authenticated by the use of digests generated by a hash function.Type: GrantFiled: June 8, 2011Date of Patent: December 9, 2014Assignee: Lytro, Inc.Inventors: Kurt Barton Akeley, Yi-Ren Ng, Kenneth Wayne Waters, Kayvon Fatahalian, Timothy James Knight, Yuriy Aleksandrovich Romanenko
-
Patent number: 8866957Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: GrantFiled: August 26, 2013Date of Patent: October 21, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Partrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20140300646Abstract: According to various embodiments, a dolly zoom effect is generated using light field image data. The dolly zoom effect simulates an in-camera technique wherein a camera moves toward or away from the subject in such a way that the subject is kept at the same size throughout the effect. The effect causes the relative size of foreground background elements to change while foreground elements such as the subject remain the same size. By varying a parameter while projecting the light field image, the size of each object in the projection image scales depending on its relative depth as compared with the depth of the target subject, thus simulating the dolly zoom effect without any need to physically move the camera.Type: ApplicationFiled: June 23, 2014Publication date: October 9, 2014Inventors: Colvin Pitts, Timothy James Knight, Chia-Kai Liang, Yi-Ren Ng
-
Patent number: 8831377Abstract: Light-field image data is processed in a manner that reduces projection artifacts in the presence of variation in microlens position by calibrating microlens positions. Initially, approximate centers of disks in a light-field image are identified. Gridded calibration is then performed, by fitting lines to disk centers along orthogonal directions, and then fitting a rigid grid to the light-field image. For each grid region, a corresponding disk center is computed by passing values for pixels within that grid region into weighted-center equations. A displacement vector is then generated, based on the distance from the geometric center of the grid region to the computed disk center. For each grid region, the final disk center is computed as the vector sum of the grid region's geometric center and displacement vector. Calibration data, including displacement vectors, is then used in calibrating disk centers for more accurate projection of light-field images.Type: GrantFiled: February 22, 2013Date of Patent: September 9, 2014Assignee: Lytro, Inc.Inventors: Colvin Pitts, Timothy James Knight, Chia-Kai Liang, Yi-Ren Ng
-
Publication number: 20140240463Abstract: A video refocusing system operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.Type: ApplicationFiled: May 8, 2014Publication date: August 28, 2014Applicant: Lytro, Inc.Inventors: Colvin Pitts, Yi-Ren Ng
-
Patent number: 8811769Abstract: According to various embodiments, the system and method of the present invention process light-field image data in a manner that reduces artifacts and that yields 2-D images with extended depth of field, and with variable placement of the center of perspective. Center of perspective can be varied based on user input or on pre-specified parameters. Various techniques for improving the presentation of light-field images with variable center of perspective are described, and for performing other effects in connection with projection of light-field images.Type: GrantFiled: November 28, 2012Date of Patent: August 19, 2014Assignee: Lytro, Inc.Inventors: Colvin Pitts, Timothy James Knight, Chia-Kai Liang, Yi-Ren Ng
-
Publication number: 20140211077Abstract: A light field data acquisition device includes optics and a light field sensor to acquire light field image data of a scene. In at least one embodiment, the light field sensor is located at a substantially fixed, predetermined distance relative to the focal point of the optics. In response to user input, the light field acquires the light field image data of the scene, and a storage device stores the acquired data. Such acquired data can subsequently be used to generate a plurality of images of the scene using different virtual focus depths.Type: ApplicationFiled: April 3, 2014Publication date: July 31, 2014Inventors: Yi-Ren Ng, Colvin Pitts, Timothy Knight
-
Publication number: 20140204184Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: ApplicationFiled: March 19, 2014Publication date: July 24, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren NG, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Patent number: 8768102Abstract: According to various embodiments of the invention, improved downsampling techniques are employed, which can be applied to light field images and which preserve the ability to refocus (and otherwise manipulate) such images. Groups of pixels, rather than individual pixels, are downsampled; such groups of pixels can be defined, for example, as disks of pixels. Such downsampling is accomplished, for example, by aggregating values for pixels having similar relative positions within adjacent disks (or other defined regions or pixel groups) of the image. When applied to light field images, the downsampling techniques of the present invention reduce spatial resolution without sacrificing angular resolution. This ensures that the refocusing capability of the resulting light field image is not reduced and/or adversely impacted.Type: GrantFiled: January 31, 2012Date of Patent: July 1, 2014Assignee: Lytro, Inc.Inventors: Yi-Ren Ng, Kurt Barton Akeley, Timothy James Knight, Colvin Pitts
-
Patent number: 8760566Abstract: The present invention operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.Type: GrantFiled: September 20, 2013Date of Patent: June 24, 2014Assignee: Lytro, Inc.Inventors: Colvin Pitts, Yi-Ren Ng
-
Patent number: 8749620Abstract: A 3D stereo image of a scene is generated by generating first image data of the scene using light field data representing light rays from a first direction, and second image data of the scene using light field data representing light rays from a second direction. The 3D stereo image of the scene is then generated using the first image data and the second image data. A microlens array may be used to direct light rays onto a photosensor array, wherein each microlens of the microlens array includes a physical aperture which correlates to a plurality of associated photosensors, a first virtual aperture which correlates to a first subset of the associated photosensors, and a second virtual aperture which correlates to a second subset of the associated photosensors. Each virtual aperture thus provides light rays from a different direction for use in generating the 3D stereo image.Type: GrantFiled: February 15, 2011Date of Patent: June 10, 2014Assignee: Lytro, Inc.Inventors: Timothy J. Knight, Colvin Pitts, Yi-Ren Ng, Alex Fishman
-
Patent number: 8724014Abstract: A light field data acquisition device includes optics and a light field sensor to acquire light field image data of a scene. In at least one embodiment, the light field sensor is located at a substantially fixed, predetermined distance relative to the focal point of the optics. In response to user input, the light field acquires the light field image data of the scene, and a storage device stores the acquired data. Such acquired data can subsequently be used to generate a plurality of images of the scene using different virtual focus depths.Type: GrantFiled: September 4, 2012Date of Patent: May 13, 2014Assignee: Lytro, Inc.Inventors: Yi-Ren Ng, Colvin Pitts, Timothy Knight
-
Publication number: 20140129988Abstract: According to various embodiments of the invention, parallax and/or three-dimensional effects are added to thumbnail image displays. In at least one embodiment, such effects are applied in a manner that causes the thumbnail images to appear to respond to their display environment. For example, a parallax effect can be applied that responds to current cursor position, scroll position, scroll velocity, orientation of the display device (detected, for example, by position- and/or motion-sensing mechanisms), and/or any other environmental conditions. As another example, thumbnail images can be refocused, and/or a viewpoint for an image can be adjusted, in response to a user clicking on or tapping on particular elements within such images.Type: ApplicationFiled: November 6, 2012Publication date: May 8, 2014Applicant: LYTRO, INC.Inventors: Chia-Kai Liang, Michael Knott, Mugur Marculescu, Jason Wilson, Yi-Ren Ng
-
Patent number: 8717489Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: July 5, 2012Date of Patent: May 6, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Publication number: 20140049663Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: August 26, 2013Publication date: February 20, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Patent number: 8648958Abstract: Various approaches to imaging involve selecting directional and spatial resolution. According to an example embodiment, images are computed using an imaging arrangement to facilitate selective directional and spatial aspects of the detection and processing of light data. Light passed through a main lens is directed to photosensors via a plurality of microlenses. The separation between the microlenses and photosensors is set to facilitate directional and/or spatial resolution in recorded light data, and facilitating refocusing power and/or image resolution in images computed from the recorded light data. In one implementation, the separation is varied between zero and one focal length of the microlenses to respectively facilitate spatial and directional resolution (with increasing directional resolution, hence refocusing power, as the separation approaches one focal length).Type: GrantFiled: July 5, 2012Date of Patent: February 11, 2014Assignee: The Board of Trustees of the Leland Stanford Junior UniversityInventors: Yi-Ren Ng, Patrick M. Hanrahan, Mark A. Horowitz, Marc S. Levoy
-
Publication number: 20140028892Abstract: Image data is processed to facilitate focusing and/or optical correction. According to an example embodiment of the present invention, an imaging arrangement collects light data corresponding to light passing through a particular focal plane. The light data is collected using an approach that facilitates the determination of the direction from which various portions of the light incident upon a portion of the focal plane emanate from. Using this directional information in connection with value of the light as detected by photosensors, an image represented by the light is selectively focused and/or corrected.Type: ApplicationFiled: August 26, 2013Publication date: January 30, 2014Applicant: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITYInventors: Yi-Ren Ng, Patrick M. Hanrahan, Marc A. Levoy, Mark A. Horowitz
-
Publication number: 20140016019Abstract: The present invention operates in connection with refocusable video data, information, images and/or frames, which may be light field video data, information, images and/or frames, that may be focused and/or refocused after acquisition or recording. A video acquisition device acquires first refocusable light field video data of a scene, stores first refocusable video data representative of the first refocusable light field video data, acquires second refocusable light field video data of the scene after acquiring the first refocusable light field video data, determines a first virtual focus parameter (such as a virtual focus depth) using the second refocusable light field video data, generates first video data using the stored first refocusable video data and the first virtual focus parameter, wherein the first video data includes a focus depth that is different from an optical focus depth of the first refocusable light field video data, and outputs the first video data.Type: ApplicationFiled: September 20, 2013Publication date: January 16, 2014Applicant: LYTRO, INC.Inventors: Colvin Pitts, Yi-Ren Ng