Patents by Inventor Yibing Michelle Wang

Yibing Michelle Wang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20210041226
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Application
    Filed: October 21, 2020
    Publication date: February 11, 2021
    Inventor: Yibing Michelle WANG
  • Publication number: 20210041225
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Application
    Filed: October 21, 2020
    Publication date: February 11, 2021
    Inventor: Yibing Michelle WANG
  • Patent number: 10893227
    Abstract: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: January 12, 2021
    Inventors: Yibing Michelle Wang, Ilia Ovsiannikov
  • Patent number: 10885648
    Abstract: A method of reconstructing a three dimensional image using a structured light pattern system is provided as follows. A class identifier of an observed pixel on a captured image by a camera is extracted. The observed pixel has a coordinate (x, y) on the captured image. A first relative position of the x coordinate of the observed pixel in a tile domain of the captured image is calculated. A second relative position of one of a plurality of dots in a tile domain of a reference image using the extracted class identifier is calculated. A disparity of the observed pixel using the first relative position and the second relative position is calculated.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: January 5, 2021
    Inventors: Lilong Shi, Yibing Michelle Wang
  • Patent number: 10883822
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: April 17, 2020
    Date of Patent: January 5, 2021
    Inventor: Yibing Michelle Wang
  • Patent number: 10883821
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: April 1, 2020
    Date of Patent: January 5, 2021
    Inventor: Yibing Michelle Wang
  • Publication number: 20200400794
    Abstract: A time-resolving sensor includes a single-photon avalanche diode (SPAD), a logic circuit and differential time-to-charge converter (DTCC) circuit. The SPAD is responsive to a shutter signal to generate an output signal based on detecting an incident photon. The logic circuit generates first and second enable signals. The DTCC includes a capacitor device, first and second switching devices, and an output circuit. The first switching device is responsive to the first enable signal to transfer a charge on the capacitor device to the first floating diffusion. The second switching device is responsive to the second enable signal to transfer a remaining charge on the capacitor device to the second floating diffusion. The output circuit outputs a first voltage that is based on the first charge on the first floating diffusion and a second voltage that is based on the second charge on the second floating diffusion.
    Type: Application
    Filed: September 8, 2020
    Publication date: December 24, 2020
    Inventor: Yibing Michelle WANG
  • Publication number: 20200370881
    Abstract: An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.
    Type: Application
    Filed: August 7, 2020
    Publication date: November 26, 2020
    Inventors: Yibing Michelle WANG, Kwang Oh KIM
  • Patent number: 10830577
    Abstract: An imaging unit includes a light source and a pixel array. The light source projects a line of light that is scanned in a first direction across a field of view of the light source. The line of light oriented in a second direction that is substantially perpendicular to the first direction. The pixel array is arranged in at least one row of pixels that extends in a direction that is substantially parallel to the second direction. At least one pixel in a row is capable of generating two-dimensional color information of an object in the field of view based on a first light reflected from the object and is capable of generating three-dimensional (3D) depth information of the object based on the line of light reflecting from the object. The 3D-depth information includes time-of-flight information.
    Type: Grant
    Filed: October 7, 2019
    Date of Patent: November 10, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yibing Michelle Wang, Kwang Oh Kim
  • Publication number: 20200349244
    Abstract: A computing device includes a system that authenticates a user of the computing device. A first sensor obtains a first representation of a physical characteristic of the user that is compared to a registered representation of the physical characteristic of the user. A first level of access to the computing device is enabled based on the first representation of the physical characteristic matching the second representation of the physical characteristic. A second sensor obtains a first representation of a liveness characteristic of the user that indicates that the user is alive. The first representation of the liveness characteristic is compared to a registered representation of the liveness characteristic of the user. A second level of access to the computing device is enabled based on the first representation of the liveness characteristic of the user matching the second representation of the liveness characteristic of the user.
    Type: Application
    Filed: July 23, 2019
    Publication date: November 5, 2020
    Inventors: Kwang Oh KIM, Yibing Michelle WANG, Kamil BOJANCZYK
  • Patent number: 10802118
    Abstract: A time-resolving sensor includes a single-photon avalanche diode (SPAD), a logic circuit and differential time-to-charge converter (DTCC) circuit. The SPAD is responsive to a shutter signal to generate an output signal based on detecting an incident photon. The logic circuit generates first and second enable signals. The DTCC includes a capacitor device, first and second switching devices, and an output circuit. The first switching device is responsive to the first enable signal to transfer a charge on the capacitor device to the first floating diffusion. The second switching device is responsive to the second enable signal to transfer a remaining charge on the capacitor device to the second floating diffusion. The output circuit outputs a first voltage that is based on the first charge on the first floating diffusion and a second voltage that is based on the second charge on the second floating diffusion.
    Type: Grant
    Filed: December 13, 2019
    Date of Patent: October 13, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Yibing Michelle Wang
  • Publication number: 20200303437
    Abstract: A pixel of an image sensor includes a pinned photodiode (PPD), a switching device and an output circuit. A first terminal of the switching device is coupled to the PPD. A second terminal of the switching device is coupled to a floating diffusion (FD). A third terminal of the switching device is coupled to a first enable signal and a second enable signal. The switching device is responsive to the first enable signal to transfer a first charge on the PPD to the FD, and responsive to the second enable signal to transfer a second charge on the PPD to the FD. The output circuit outputs a first voltage based on the first charge and outputs a second voltage based on the second charge in which the first voltage corresponds to a time of flight of one or more detected photons and the second voltage corresponds to a greyscale image.
    Type: Application
    Filed: May 10, 2019
    Publication date: September 24, 2020
    Inventors: Yibing Michelle WANG, Lilong SHI, Kwang Oh KIM, Chunji WANG
  • Publication number: 20200264288
    Abstract: A system and a method determines a traveling time for a light pulse between a light pulse source and a pixel of a light sensor array based on a “Find Frequent Items in a Data Steam” technique. In one embodiment, raw timestamp data output from a pixel as a data stream may be temporarily stored, processed twice and then discarded to provide an exact determination of a traveling time estimate. In another embodiment, the raw timestamp data is processed once and discarded to provide an approximate determination of a traveling time estimate. The traveling time estimate may be updated during processing and the most-frequently occurring timestamp is available when processing the data stream is complete. There is no need to keep the raw data in a memory, thereby reducing the memory requirement associated with determining the traveling time of a light pulse.
    Type: Application
    Filed: April 9, 2019
    Publication date: August 20, 2020
    Inventors: Lilong SHI, Yibing Michelle WANG
  • Publication number: 20200249010
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Application
    Filed: April 17, 2020
    Publication date: August 6, 2020
    Inventor: Yibing Michelle WANG
  • Patent number: 10735714
    Abstract: A Time-of-Flight (TOF) technique is combined with analog amplitude modulation within each pixel in a pixel array using multiple Single Photon Avalanche Diodes (SPADs) in conjunction with a single Pinned Photo Diode (PPD) in each pixel. A SPAD may be shared among multiple neighboring pixels. The TOF information is added to the received light signal by the analog domain-based single-ended to differential converter inside the pixel itself. The spatial-temporal correlation among outputs of multiple, adjacent SPADs in a pixel is used to control the operation of the PPD to facilitate recording of TOF values and range of an object. Erroneous range measurements due to ambient light are prevented by stopping the charge transfer from the PPD—and, hence, recording a TOF value—only when two or more SPADs in the pixel are triggered within a pre-defined time interval. An autonomous navigation system with multi-SPAD pixels provides improved vision for drivers under difficult driving conditions.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: August 4, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yibing Michelle Wang, Lilong Shi, Ilia Ovsiannikov
  • Patent number: 10733760
    Abstract: A Dynamic Vision Sensor (DVS) pose-estimation system includes a DVS, a transformation estimator, an inertial measurement unit (IMU) and a camera-pose estimator based on sensor fusion. The DVS detects DVS events and shapes frames based on a number of accumulated DVS events. The transformation estimator estimates a 3D transformation of the DVS camera based on an estimated depth and matches confidence-level values within a camera-projection model such that at least one of a plurality of DVS events detected during a first frame corresponds to a DVS event detected during a second subsequent frame. The IMU detects inertial movements of the DVS with respect to world coordinates between the first and second frames. The camera-pose estimator combines information from a change in a pose of the camera-projection model between the first frame and the second frame based on the estimated transformation and the detected inertial movements of the DVS.
    Type: Grant
    Filed: October 9, 2019
    Date of Patent: August 4, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Zhengping Ji, Lilong Shi, Yibing Michelle Wang, Hyun Surk Ryu, Ilia Ovsiannikov
  • Publication number: 20200232787
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Application
    Filed: April 1, 2020
    Publication date: July 23, 2020
    Inventor: Yibing Michelle WANG
  • Patent number: 10718605
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: November 14, 2018
    Date of Patent: July 21, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Yibing Michelle Wang
  • Publication number: 20200225353
    Abstract: A method is disclosed to determine a traveling time for a plurality of received light pulses that reflected and returned from an object. Each returned light pulse is associated with a timestamp indicating a time between a transmission time of a corresponding light pulse and a time of arrival of the returned light pulse. For each timestamp, a number C is determined of time stamps that are subsequent to the timestamp and within a predetermined time window after the timestamp. A maximum number C is determined, and an index i is determined for the maximum number C. A traveling time is determined for the plurality of light pulses as an average of the timestamp having a same index as the maximum number C and timestamps that are within the predetermined time window after the timestamp having the same index as the maximum number C.
    Type: Application
    Filed: March 25, 2020
    Publication date: July 16, 2020
    Inventors: Lilong SHI, Yibing Michelle WANG
  • Patent number: 10704896
    Abstract: Using the same image sensor to capture both a two-dimensional (2D) image of a three-dimensional (3D) object and 3D depth measurements for the object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor generates a multi-bit output in the 2D mode and a binary output in the 3D mode to generate timestamps. Strong ambient light is rejected by switching the image sensor to a 3D logarithmic mode from a 3D linear mode.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: July 7, 2020
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventor: Yibing Michelle Wang