Patents by Inventor Shree K. Nayar

Shree K. Nayar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10148893
    Abstract: Systems, methods, and media for high dynamic range imaging are provided, the systems comprising: an image sensor; and a hardware processor configured to: cause the image sensor to capture first image data having a first exposure time, second image data having a second exposure time, and third image data having a third exposure time that is substantially equal to the sum of the first exposure time and the second exposure time; generate combined image data using the first image data and the second image data.
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: December 4, 2018
    Assignee: Sony Corporation
    Inventors: Mohit Gupta, Tomoo Mitsunaga, Daisuke Iso, Shree K. Nayar
  • Publication number: 20180343407
    Abstract: Circuits for self-powered image sensors are provided. In some embodiments, an image sensor is provided, the image comprising: a plurality of pixels, each of the plurality of pixels comprising: a photodiode having an anode and a cathode connected to a constant voltage level; a first transistor having: a first input connected to the anode of the photodiode; a first output connected to a reset bus; and a first control configured to receive a discharge signal; and a second transistor having: a second input connected to the anode of the photodiode; a second output connected to a pixel output bus; and a second control configured to receive a select signal; and a third transistor having: a third input coupled to each first output via the reset bus; a third output configured to be coupled to an energy storage device; and a third control configured to receive an energy harvest signal.
    Type: Application
    Filed: July 16, 2018
    Publication date: November 29, 2018
    Applicant: The Trustees of Columbia University in the City of New York
    Inventors: Shree K. Nayar, Daniel Sims, Mikhail Fridberg
  • Publication number: 20180309970
    Abstract: In accordance with some embodiments, systems, methods and media for encoding and decoding signals used in time-of-flight imaging are provided. In some embodiments, a method for estimating the depth of a scene is provided, comprising: causing a light source to emit modulated light toward the scene based on a modulation function; causing the image sensor to generate a first value based on the modulated light and a first demodulation function of K modulation functions, including at least one trapezoid wave; causing the image sensor to generate a second value; causing the image sensor to generate a third value; and determining a depth estimate for the portion of the scene based on the first value, the second value, and the third value.
    Type: Application
    Filed: April 20, 2017
    Publication date: October 25, 2018
    Inventors: Mohit Gupta, Eric Breitbach, Andreas Velten, Shree K. Nayar
  • Patent number: 10070067
    Abstract: Systems, methods, and media for extracting information and a display image from two captured images are provided, in some embodiments, systems for extracting information and a display image from two captured images are provided, the systems comprising: a rolling shutter sensor; and a hardware processor coupled to the rolling shutter sensor that is configured to: cause the rolling shutter sensor to capture two captured images; receive the two captured images; and extract the information, and the display image from the two captured images, wherein the information is represented in the captured images as a flicker pattern.
    Type: Grant
    Filed: April 15, 2015
    Date of Patent: September 4, 2018
    Assignee: Sony Corporation
    Inventors: Kensei Jo, Mohit Gupta, Shree K. Nayar
  • Publication number: 20180234672
    Abstract: Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
    Type: Application
    Filed: April 11, 2018
    Publication date: August 16, 2018
    Applicant: Sony Corporation
    Inventors: Yasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree K. Nayar
  • Patent number: 10027914
    Abstract: Circuits for self-powered image sensors are provided. In some embodiments, an image sensor is provided, the image comprising: a plurality of pixels, each of the plurality of pixels comprising: a photodiode having an anode and a cathode connected to a ground voltage; a first transistor having: a first input connected to the anode of the photodiode; a first output connected to a reset bus; and a first control configured to receive a discharge signal; and a second transistor having: a second input connected to the anode of the photodiode; a second output connected to a pixel output bus; and a second control configured to receive a select signal; and a third transistor having: a third input coupled to each first output via the reset bus; a third output configured to be coupled to an energy storage device; and a third control configured to receive an energy harvest signal.
    Type: Grant
    Filed: January 7, 2016
    Date of Patent: July 17, 2018
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Shree K. Nayar, Daniel Sims, Mikhail Fridberg
  • Patent number: 9979945
    Abstract: Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
    Type: Grant
    Filed: January 13, 2017
    Date of Patent: May 22, 2018
    Assignee: Sony Corporation
    Inventors: Yasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree K. Nayar
  • Publication number: 20180054595
    Abstract: Systems, methods and media for providing modular cameras are provided. In some embodiments, a modular imaging device is provided, comprising: a base module comprising: a user device interface configured to receive signals from a user device; a first magnet; a first plurality of electrical contacts; and one or more circuits that are configured to receive information transmitted to the base module from the user device via the user device interface; and an image sensor module comprising: a second plurality of electrical contacts; a second magnet; a third plurality of electrical contacts; an image sensor; and one or more circuits that are configured to: receive a first control signal; cause the image sensor to capture image data; and transmit the captured image data.
    Type: Application
    Filed: February 19, 2016
    Publication date: February 22, 2018
    Inventors: Makoto Odamaki, Shree K. Nayar
  • Publication number: 20180020175
    Abstract: Circuits for self-powered image sensors are provided. In some embodiments, an image sensor is provided, the image comprising: a plurality of pixels, each of the plurality of pixels comprising: a photodiode having an anode and a cathode connected to a ground voltage; a first transistor having: a first input connected to the anode of the photodiode; a first output connected to a reset bus; and a first control configured to receive a discharge signal; and a second transistor having: a second input connected to the anode of the photodiode; a second output connected to a pixel output bus; and a second control configured to receive a select signal; and a third transistor having: a third input coupled to each first output via the reset bus; a third output configured to be coupled to an energy storage device; and a third control configured to receive an energy harvest signal.
    Type: Application
    Filed: January 7, 2016
    Publication date: January 18, 2018
    Inventors: Shree K. Nayar, Daniel Sims, Mikhail Fridberg
  • Patent number: 9857168
    Abstract: Systems, methods, and media for performing shape measurement are provided. In some embodiments, systems for performing shape measurement are provided, the systems comprising: a projector that projects onto a scene a plurality of illumination patterns, wherein each of the illumination patterns has a given frequency, each of the illumination patterns is projected onto the scene during a separate period of time, three different illumination patterns are projected with a first given frequency, and only one or two different illumination patterns are projected with a second given frequency; a camera that detects an image of the scene during each of the plurality of periods of time; and a hardware processor that is configured to: determine the given frequencies of the plurality of illumination patterns; and measure a shape of an object in the scene.
    Type: Grant
    Filed: February 12, 2015
    Date of Patent: January 2, 2018
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Mohit Gupta, Shree K Nayar
  • Patent number: 9752869
    Abstract: Systems for performing machine vision using diffuse structured light comprising: a linear diffuser having an axis of diffusion; a light source that projects an illumination pattern through the linear diffuser and onto a scene, wherein the illumination pattern has transiationai symmetry in a. direction of translation that is aligned with the axis of diffusion; and an image sensor that detects tight reflecting from the scene and that outputs signals corresponding to the detected light. Methods for performing machine vision using diffuse structured light comprising: projecting an illumination pattern from a light source through a linear diffuser and onto a scene, wherein the linear diffuser has an axis of diffusion and the illumination pattern has transiationai symmetry in a direction of translation that is aligned with the axis of diffusion; and detecting light reflecting from, the scene using an image sensor that outputs signals corresponding to the detected light.
    Type: Grant
    Filed: August 15, 2012
    Date of Patent: September 5, 2017
    Assignee: The Trustees of Columbia University in the City of New York
    Inventor: Shree K. Nayar
  • Patent number: 9736425
    Abstract: Methods and systems for coded rolling shutter are provided. In accordance with some embodiments, methods and system are provided that control the readout timing and exposure length for each row of a pixel array in an image sensor, thereby flexibly sampling the three-dimensional space-time value of a scene and capturing sub-images that effectively encode motion and dynamic range information within a single captured image.
    Type: Grant
    Filed: August 3, 2015
    Date of Patent: August 15, 2017
    Assignees: Sony Corporation, The Trustees of Columbia University in the City of New York
    Inventors: Jinwei Gu, Yasunobu Hitomi, Tomoo Mitsunaga, Shree K. Nayar
  • Publication number: 20170230562
    Abstract: Systems, methods, and media for high dynamic range imaging are provided, the systems comprising: an image sensor; and a hardware processor configured to: cause the image sensor to capture first image data having a first exposure time, second image data having a second exposure time, and third image data having a third exposure time that is substantially equal to the sum of the first exposure time and the second exposure time; generate combined image data using the first image data and the second image data.
    Type: Application
    Filed: March 7, 2017
    Publication date: August 10, 2017
    Applicant: Sony Corporation
    Inventors: Mohit Gupta, Tomoo Mitsunaga, Daisuke Iso, Shree K. Nayar
  • Publication number: 20170134706
    Abstract: Systems, methods, and media for reconstructing a space-time volume from a coded image are provided. In accordance with some embodiments, systems for reconstructing a space-time volume from a coded image are provided, the systems comprising: an image sensor that outputs image data; and at least one processor that: causes a projection of the space-time volume to be captured in a single image of the image data in accordance with a coded shutter function; receives the image data; and performs a reconstruction process on the image data to provide a space-time volume corresponding to the image data.
    Type: Application
    Filed: January 13, 2017
    Publication date: May 11, 2017
    Applicant: Sony Corporation
    Inventors: Yasunobu Hitomi, Jinwei Gu, Mohit Gupta, Tomoo Mitsunaga, Shree K. Nayar
  • Patent number: 9648248
    Abstract: Systems, methods, and media for high dynamic range imaging are provided, the systems comprising: an image sensor; and a hardware processor configured to: cause the image sensor to capture first image data having a first exposure time, second image data having a second exposure time, and third image data having a third exposure time that is substantially equal to the sum of the first exposure time and the second exposure time; generate combined image data using the first image data and the second image data.
    Type: Grant
    Filed: November 27, 2013
    Date of Patent: May 9, 2017
    Assignee: Sony Corporation
    Inventors: Mohit Gupta, Tomoo Mitsunaga, Daisuke Iso, Shree K Nayar
  • Publication number: 20170085787
    Abstract: Systems, methods, and media for recording an image of a scene are provided. In accordance with some embodiments, systems for recording an image of a scene are provided, comprising: a diffuser that diffuses light representing the scene and that has a scattering function that is independent of aperture coordinates; a sensor that receives diffused light representing the scene and generates data representing an image; and a hardware processor that uses a point spread function to deblur the image.
    Type: Application
    Filed: August 1, 2016
    Publication date: March 23, 2017
    Inventors: Oliver Cossairt, Changyin Zhou, Shree K. Nayar
  • Patent number: 9473700
    Abstract: Camera systems and methods for gigapixel computational imaging are provided. In some embodiments, the camera system comprises: a ball lens, an array of image sensors disposed at a distance from the ball lens, the array of image sensors configured to acquire images from light that passes through the ball lens; and a processor configured to deblur and stitch the images captured by the array of image sensors to generate a gigapixel image.
    Type: Grant
    Filed: November 3, 2011
    Date of Patent: October 18, 2016
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Oliver S. Cossairt, Daniel Miau, Shree K. Nayar
  • Patent number: 9407833
    Abstract: Systems, methods, and media for recording an image of a scene ate provided. In accordance with some embodiments, systems for recording an image of a scene are provided. comprising. a diffuser {hat diffuses light representing the scene and that has a scattering function that is independent of aperture coordinates, a sensor that receives diffused light representing the scene and generates data representing an image; and a hardware processes that uses a point spread function to deblur the image.
    Type: Grant
    Filed: January 24, 2011
    Date of Patent: August 2, 2016
    Assignee: The Trustees of Columbia University in the City of New York
    Inventors: Oliver Cossairt, Changyin Zhou, Shree K. Nayar
  • Publication number: 20160187626
    Abstract: Systems and methods for panoramic imaging are disclosed herein. An exemplary system of the disclosed subject matter for panoramic imaging includes a fisheye lens, a mirror optically coupled to the fisheye lens, and a detector for capturing light incident on the fisheye lens and reflected from the mirror. In some embodiments, the mirror is a spherical mirror.
    Type: Application
    Filed: January 11, 2016
    Publication date: June 30, 2016
    Applicant: THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK
    Inventors: Gurunandan Krishnan, Shree K. Nayar
  • Patent number: 9363447
    Abstract: Apparatus and methods are provided for obtaining high dynamic range images using a low dynamic range image sensor. The scene is exposed to the image sensor in a spatially varying manner. A variable-transmittance mask, which is interposed between the scene and the image sensor, imposes a spatially varying attenuation on the scene light incident on the image sensor. The mask includes light transmitting cells whose transmittance is controlled by application of suitable control signals. The mask is configured to generate a spatially varying light attenuation pattern across the image sensor. The image frame sensed by the image sensor is normalized with respect to the spatially varying light attenuation pattern. The normalized image data can be interpolated to account for image sensor pixels that are either under or over exposed to enhance the dynamic range of the image sensor.
    Type: Grant
    Filed: December 23, 2014
    Date of Patent: June 7, 2016
    Assignees: The Trustees of Columbia University in the City of New York, Sony Corporation
    Inventors: Shree K. Nayar, Tomoo Mitsunaga