Patents Assigned to ORBBEC INC.
  • Patent number: 11828954
    Abstract: A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns, and the image patterns are rotated by an angle such that edges of the image patterns are not in parallel with a baseline between the structured light projection module and a capture module.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: November 28, 2023
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
  • Patent number: 11769266
    Abstract: A depth image engine and a depth image calculation method are provided. The depth image engine comprises: a buffer, configured to receive a data flow of a first image; an image rotator, configured to perform, after the buffer receives the entire data flow of the first image, a rotation operation on the first image to generate a second image; and a depth value calculator, configured to receive the second image and a reference image to perform a matching calculation on the second image and the reference image to generate a depth image.
    Type: Grant
    Filed: August 5, 2020
    Date of Patent: September 26, 2023
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
  • Patent number: 11756220
    Abstract: A depth calculation processor includes: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.
    Type: Grant
    Filed: August 31, 2022
    Date of Patent: September 12, 2023
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
  • Patent number: 11750796
    Abstract: This application provides a calibration device and a method. The calibration device includes calibration boards arranged at intervals and having board surface parallel to each other, a guide rail disposed at peripheries of the calibration boards, TOF cameras, and a controller. Support frames are arranged at intervals on the guide rail, and the TOF cameras are mounted on the guide rail using the support frames. Distances between the calibration surfaces and the corresponding TOF cameras are different. The controller is connected to the guide rail and the TOF cameras, and configured to send a first set of timing control signals to control the guide rail to carry the TOF cameras to move along the guide rail, and send a second set of timing control signals to the TOF cameras to control the TOF cameras to work simultaneously or alternately to measure distance values between the TOF cameras and the corresponding calibration boards.
    Type: Grant
    Filed: February 16, 2022
    Date of Patent: September 5, 2023
    Assignee: Orbbec Inc.
    Inventors: Hai Zeng, Xiaolong Hu
  • Patent number: 11741623
    Abstract: A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: at least two input ports configured to receive a first image data, wherein the first image data comprises at least a structured light image acquired under projection of a structured light; a data processing engine configured to perform a calculation process on the first image data to output a second image data, wherein the second image data comprises at least a depth map, wherein the data processing engine comprises at least a depth processing engine configured to perform a depth calculation process on the structured light image to obtain the depth map; and at least an output port coupled to the data processing engine and configured to output the second image data to a host device.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: August 29, 2023
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Zhenzhong Xiao, Xiaolu Mei, Sheng Xu, Yuanhao Huang, Xu Chen
  • Patent number: 11543671
    Abstract: A structured light projection module and a depth camera are provided. The structured light projection module includes: a light source array including a plurality of sub-light sources arranged in a two-dimensional pattern and configured to transmit array beams corresponding to the two-dimensional pattern; a lens configured to receive and converge the array beams; and a diffractive optical element configured to receive the array beams that are emitted after being converged by the lens and project beams in a structured light speckle pattern. The structured light speckle pattern is formed through staggered superposition of at least two secondary structured light speckle patterns. Each secondary structured light speckle pattern is formed through a tiling arrangement of multiple sub-speckle patterns generated by a portion of the sub-light sources, and comprises speckles formed by diffracting an individual sub-light source via the diffractive optical element.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: January 3, 2023
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Xu Chen
  • Patent number: 11475580
    Abstract: A depth calculation processor comprises: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.
    Type: Grant
    Filed: August 5, 2020
    Date of Patent: October 18, 2022
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
  • Patent number: 11442285
    Abstract: A diffractive optical element for a structured light projection module and a method of using the diffractive optical element are described herein. The diffractive optical element is configured to: receive two-dimensional patterned beams and generate multi-order diffractive beams, wherein the two-dimensional patterned beams are emitted from a structured light projection module, the structured light projection module includes a light source comprising a plurality of sub-light sources arranged in a two-dimensional array, and the two-dimensional patterned beams correspond to the two-dimensional array; and project a plurality of two-dimensional patterned beams, wherein each of the plurality of two-dimensional patterned beams creates a corresponding duplicated pattern, and the duplicated patterns form a speckle pattern having uniform speckle density. The two-dimensional patterned beams can overlap with each other, or not overlap with each other.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: September 13, 2022
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Xu Chen
  • Patent number: 11445164
    Abstract: The present disclosure provides a structured light projection module comprising: a Vertical-Cavity Surface-Emitting Laser (VCSEL) array light source that includes a semiconductor substrate and at least two VCSEL sub-arrays arranged thereon. The at least two VCSEL sub-arrays include VCSEL light sources. The structured light projection module further includes a diffractive optical element (DOE) that includes at least two DOE sub-units. The DOE sub-units are respectively corresponding to the VCSEL sub-arrays and configured to project multiple copies of light beams emitted by the corresponding at least two VCSEL sub-arrays.
    Type: Grant
    Filed: January 20, 2021
    Date of Patent: September 13, 2022
    Assignee: Orbbec Inc.
    Inventors: Zhenzhong Xiao, Xing Xu, Xu Chen
  • Patent number: 11445163
    Abstract: A system and method for obtaining a target image are provided. The system includes: a floodlight illumination source configured to provide illumination of a first wavelength for a target area; a first acquisition camera configured to acquire a target floodlight image of the first wavelength of the target area; a structured light projector configured to project a structured light image of a second wavelength to the target area; a second acquisition camera configured to acquire the structured light image of the target area; and a processor, connected to the floodlight illumination source, the first acquisition camera, the structured light projector, and the second acquisition camera, and configured to: acquire the target floodlight image and the structured light image; recognize a foreground target in the floodlight image; and extract a target structured light image based on a relative position relationship between the first acquisition camera and the second acquisition camera.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: September 13, 2022
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Lianghong Zhong, Xu Chen
  • Patent number: 11335020
    Abstract: A method for correcting errors of a depth camera caused by the temperature includes: obtaining, by at least two depth cameras, a depth image of a current target, wherein two adjacent depth cameras of the at least two depth cameras have a common field of view; modeling a measurement error of the two adjacent depth cameras caused by a temperature change; and correcting the depth image using the modeled measurement error, wherein the corrected depth image has a minimum depth difference in the common field of view.
    Type: Grant
    Filed: April 14, 2020
    Date of Patent: May 17, 2022
    Assignee: Orbbec Inc.
    Inventors: Xianzhuo Liu, Zhiming Huang, Xu Chen
  • Patent number: 11237404
    Abstract: A diffractive optical element is configured to receive a first patterned light beams, and diffracts the first patterned light beams to project a second patterned light beam outwardly. The second patterned light beam is formed of combined arrangement of a plurality of first patterned light beams, and the combined arrangement includes periodic arrangement in a first direction and a second direction. The first direction and the second direction are not perpendicular to each other. By designing the performance of the diffractive optical element, the outwardly projected structured light pattern is periodically arranged in two directions, and the two directions are not perpendicular to each other, such that spot patterns are highly unrelated in multiple directions, improving accuracy.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: February 1, 2022
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Zhaomin Wang, Yuanhao Huang, Xu Chen
  • Patent number: 11238270
    Abstract: The present application provides an identity authentication method and an apparatus. The method may include obtaining a sequence of depth images containing a target face and a sequence of original two-dimensional (2D) images containing the target face, and performing identity authentication. The identity authentication may be conducted by: calculating a target face three-dimensional (3D) texture image according to the depth images containing the target face and the original 2D images containing the target face; projecting the target face 3D texture image to a 2D plane to obtain a target face 2D image; extracting feature information from the target face 2D image; comparing the feature information of the target face 2D image with feature information of a reference face 2D image to determine a similarity value; and in response to that the similarity value exceeds a first threshold, determining that the identity authentication succeeds.
    Type: Grant
    Filed: April 24, 2020
    Date of Patent: February 1, 2022
    Assignee: Orbbec Inc.
    Inventors: Zhenzhong Xiao, Yuanhao Huang, Xu Chen
  • Patent number: 11194171
    Abstract: A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns. Relationships between adjacent image patterns of the plurality of image patterns comprise at least two of an overlapping relationship, an adjoining relationship, and a spacing relationship.
    Type: Grant
    Filed: May 5, 2020
    Date of Patent: December 7, 2021
    Assignee: Orbbec Inc.
    Inventors: Yuanhao Huang, Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
  • Patent number: 11049271
    Abstract: A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: two input ports to receive a first image data, wherein the first image data comprises structured light image acquired under projection of structured light; an input switch connected to the input ports and to convey all or some of the first image data from the input ports; a data processing engine connected to the input switch and to process the first image data that is output through the input switch and to output a second image data, wherein the second image data comprises a depth map, wherein the data processing engine comprises a depth processing engine to process the structured light image to obtain the depth map; and one output port connected to the data processing engine and to output the second image data to a main device.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: June 29, 2021
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Zhenzhong Xiao, Xiaolu Mei, Sheng Xu, Yuanhao Huang, Xu Chen
  • Patent number: 10958893
    Abstract: The present disclosure discloses a VCSEL array light source, a pattern design method for the VCSEL array light source, a laser projection apparatus, and a three-dimensional (3D) imaging device. The VCSEL array light source includes a semiconductor substrate and a plurality of VCSEL light sources arranged on the semiconductor substrate in a two-dimensional array. The two-dimensional array includes at least one sub-array and is generated by transforming the at least one sub-array.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: March 23, 2021
    Assignee: Orbbec Inc.
    Inventors: Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
  • Patent number: 10931935
    Abstract: The present disclosure provides a structured light projection module comprising: a Vertical-Cavity Surface-Emitting Laser (VCSEL) array light source that includes a semiconductor substrate and at least two VCSEL sub-arrays arranged thereon. The at least two VCSEL sub-arrays include VCSEL light sources. The structured light projection module further includes a diffractive optical element (DOE) that includes at least two DOE sub-units. The DOE sub-units are respectively corresponding to the VCSEL sub-arrays and configured to project multiple copies of light beams emitted by the corresponding at least two VCSEL sub-arrays.
    Type: Grant
    Filed: May 17, 2019
    Date of Patent: February 23, 2021
    Assignee: ORBBEC INC.
    Inventors: Zhenzhong Xiao, Xing Xu, Xu Chen
  • Patent number: D999804
    Type: Grant
    Filed: June 14, 2022
    Date of Patent: September 26, 2023
    Assignee: Orbbec Inc.
    Inventors: Zuanze Lin, Jianhua Tang