Patents by Inventor Boxin Shi

Boxin Shi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11303793
    Abstract: An imaging system includes an event camera configured to capture a first image of a scene. The system also includes a shutter camera collocated with the event camera, where the shutter camera is configured to capture a second image of the scene. The system also includes a processor operatively coupled to the event camera and the shutter camera. The processor is configured to apply guided event filtering (GEF) on the first image and the second image. The processor is also configured to generate a third image based on filtering of the first image and the second image.
    Type: Grant
    Filed: April 12, 2021
    Date of Patent: April 12, 2022
    Assignees: Northwestern University, Peking University
    Inventors: Oliver Strider Cossairt, Boxin Shi, Zihao Wang, Peiqi Duan, Aggelos K. Katsaggelos, Tiejun Huang
  • Publication number: 20210321052
    Abstract: An imaging system includes an event camera configured to capture a first image of a scene. The system also includes a shutter camera collocated with the event camera, where the shutter camera is configured to capture a second image of the scene. The system also includes a processor operatively coupled to the event camera and the shutter camera. The processor is configured to apply guided event filtering (GEF) on the first image and the second image. The processor is also configured to generate a third image based on filtering of the first image and the second image.
    Type: Application
    Filed: April 12, 2021
    Publication date: October 14, 2021
    Inventors: Oliver Strider Cossairt, Boxin Shi, Zihao Wang, Peiqi Duan, Aggelos K. Katsaggelos, Tiejun Huang
  • Patent number: 10557705
    Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.
    Type: Grant
    Filed: February 19, 2019
    Date of Patent: February 11, 2020
    Assignee: Massachusetts Institute of Technology
    Inventors: Achuta Kadambi, Vage Taamazyan, Boxin Shi, Ramesh Raskar
  • Publication number: 20190186901
    Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.
    Type: Application
    Filed: February 19, 2019
    Publication date: June 20, 2019
    Inventors: Achuta Kadambi, Vage Taamazyan, Boxin Shi, Ramesh Raskar
  • Patent number: 10260866
    Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.
    Type: Grant
    Filed: December 27, 2015
    Date of Patent: April 16, 2019
    Assignee: Massachusetts Institute of Technology
    Inventors: Achuta Kadambi, Vage Taamazyan, Boxin Shi, Ramesh Raskar
  • Patent number: 9897699
    Abstract: A time-of-flight camera images an object around a corner or through a diffuser. In the case of imaging around a corner, light from a hidden target object reflects off a diffuse surface and travels to the camera. Points on the diffuse surface function as a virtual sensors. In the case of imaging through a diffuser, light from the target object is transmitted through a diffusive media and travels to the camera. Points on a surface of the diffuse media that is visible to the camera function as virtual sensors. In both cases, a computer represents phase and intensity measurements taken by the camera as a system of linear equations and solves a linear inverse problem to (i) recover an image of the target object; or (ii) to compute a 3D position for each point in a set of points on an exterior surface of the target object.
    Type: Grant
    Filed: July 9, 2015
    Date of Patent: February 20, 2018
    Assignee: Massachusetts Institute of Technology
    Inventors: Achuta Kadambi, Hang Zhao, Boxin Shi, Ayush Bhandari, Ramesh Raskar
  • Patent number: 9482622
    Abstract: In illustrative implementations of this invention, light sources illuminate a surface with multi-spectral, multi-directional illumination that varies in direction, wavelength, coherence and collimation. One or more cameras capture images of the surface while the surface is illuminated under different lighting conditions. One or more computers take, as input, data indicative of or derived from the images, and determine a classification of the surface. Based on the computed classification, the computers output signals to control an I/O device, such that content displayed by the I/O device depends, at least in part, on the computed classification. In illustrative implementations, this invention accurately classifies a wide range of surfaces, including transparent surfaces, specular surfaces, and surfaces with few features.
    Type: Grant
    Filed: April 2, 2015
    Date of Patent: November 1, 2016
    Assignee: Massachusetts Institute of Technology
    Inventors: Munehiko Sato, Ramesh Raskar, Boxin Shi, Alex Olwal
  • Publication number: 20160261844
    Abstract: A 3D imaging system uses a depth sensor to produce a coarse depth map, and then uses the coarse depth map as a constraint in order to correct ambiguous surface normals computed from polarization cues. The imaging system outputs an enhanced depth map that has a greater depth resolution than the coarse depth map. The enhanced depth map is also much more accurate than could be obtained from the depth sensor alone. In many cases, the imaging system extracts the polarization cues from three polarized images. Thus, in many implementations, the system takes only three extra images—in addition to data used to generate the coarse depth map—in order to dramatically enhance the coarse depth map.
    Type: Application
    Filed: December 27, 2015
    Publication date: September 8, 2016
    Inventors: Achuta Kadambi, Vage Taamazyan, Boxin Shi, Ramesh Raskar
  • Publication number: 20160014393
    Abstract: A time-of-flight camera images an object around a corner or through a diffuser. In the case of imaging around a corner, light from a hidden target object reflects off a diffuse surface and travels to the camera. Points on the diffuse surface function as a virtual sensors. In the case of imaging through a diffuser, light from the target object is transmitted through a diffusive media and travels to the camera. Points on a surface of the diffuse media that is visible to the camera function as virtual sensors. In both cases, a computer represents phase and intensity measurements taken by the camera as a system of linear equations and solves a linear inverse problem to (i) recover an image of the target object; or (ii) to compute a 3D position for each point in a set of points on an exterior surface of the target object.
    Type: Application
    Filed: July 9, 2015
    Publication date: January 14, 2016
    Applicant: Massachusetts Institute of Technology
    Inventors: Achuta Kadambi, Hang Zhao, Boxin Shi, Ayush Bhandari, Ramesh Raskar
  • Publication number: 20150330905
    Abstract: In illustrative implementations of this invention, light sources illuminate a surface with multi-spectral, multi-directional illumination that varies in direction, wavelength, coherence and collimation. One or more cameras capture images of the surface while the surface is illuminated under different lighting conditions. One or more computers take, as input, data indicative of or derived from the images, and determine a classification of the surface. Based on the computed classification, the computers output signals to control an I/O device, such that content displayed by the I/O device depends, at least in part, on the computed classification. In illustrative implementations, this invention accurately classifies a wide range of surfaces, including transparent surfaces, specular surfaces, and surfaces with few features.
    Type: Application
    Filed: April 2, 2015
    Publication date: November 19, 2015
    Applicant: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
    Inventors: Munehiko Sato, Ramesh Raskar, Boxin Shi, Alex Olwal