Patents Assigned to ORBBEC INC.
-
Patent number: 11828954Abstract: A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns, and the image patterns are rotated by an angle such that edges of the image patterns are not in parallel with a baseline between the structured light projection module and a capture module.Type: GrantFiled: November 3, 2021Date of Patent: November 28, 2023Assignee: Orbbec Inc.Inventors: Yuanhao Huang, Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
-
Patent number: 11769266Abstract: A depth image engine and a depth image calculation method are provided. The depth image engine comprises: a buffer, configured to receive a data flow of a first image; an image rotator, configured to perform, after the buffer receives the entire data flow of the first image, a rotation operation on the first image to generate a second image; and a depth value calculator, configured to receive the second image and a reference image to perform a matching calculation on the second image and the reference image to generate a depth image.Type: GrantFiled: August 5, 2020Date of Patent: September 26, 2023Assignee: Orbbec Inc.Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
-
Patent number: 11756220Abstract: A depth calculation processor includes: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.Type: GrantFiled: August 31, 2022Date of Patent: September 12, 2023Assignee: Orbbec Inc.Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
-
Patent number: 11750796Abstract: This application provides a calibration device and a method. The calibration device includes calibration boards arranged at intervals and having board surface parallel to each other, a guide rail disposed at peripheries of the calibration boards, TOF cameras, and a controller. Support frames are arranged at intervals on the guide rail, and the TOF cameras are mounted on the guide rail using the support frames. Distances between the calibration surfaces and the corresponding TOF cameras are different. The controller is connected to the guide rail and the TOF cameras, and configured to send a first set of timing control signals to control the guide rail to carry the TOF cameras to move along the guide rail, and send a second set of timing control signals to the TOF cameras to control the TOF cameras to work simultaneously or alternately to measure distance values between the TOF cameras and the corresponding calibration boards.Type: GrantFiled: February 16, 2022Date of Patent: September 5, 2023Assignee: Orbbec Inc.Inventors: Hai Zeng, Xiaolong Hu
-
Patent number: 11741623Abstract: A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: at least two input ports configured to receive a first image data, wherein the first image data comprises at least a structured light image acquired under projection of a structured light; a data processing engine configured to perform a calculation process on the first image data to output a second image data, wherein the second image data comprises at least a depth map, wherein the data processing engine comprises at least a depth processing engine configured to perform a depth calculation process on the structured light image to obtain the depth map; and at least an output port coupled to the data processing engine and configured to output the second image data to a host device.Type: GrantFiled: May 13, 2021Date of Patent: August 29, 2023Assignee: Orbbec Inc.Inventors: Xing Xu, Zhenzhong Xiao, Xiaolu Mei, Sheng Xu, Yuanhao Huang, Xu Chen
-
Patent number: 11543671Abstract: A structured light projection module and a depth camera are provided. The structured light projection module includes: a light source array including a plurality of sub-light sources arranged in a two-dimensional pattern and configured to transmit array beams corresponding to the two-dimensional pattern; a lens configured to receive and converge the array beams; and a diffractive optical element configured to receive the array beams that are emitted after being converged by the lens and project beams in a structured light speckle pattern. The structured light speckle pattern is formed through staggered superposition of at least two secondary structured light speckle patterns. Each secondary structured light speckle pattern is formed through a tiling arrangement of multiple sub-speckle patterns generated by a portion of the sub-light sources, and comprises speckles formed by diffracting an individual sub-light source via the diffractive optical element.Type: GrantFiled: August 24, 2020Date of Patent: January 3, 2023Assignee: Orbbec Inc.Inventors: Xing Xu, Xu Chen
-
Patent number: 11475580Abstract: A depth calculation processor comprises: an input port, configured to receive image data from an image sensor; a demultiplexer, connected to the input port, and configured to demultiplex the image data from the input port and output first image data into a first line and second image data into a second line; a grayscale image engine, configured to process the first image data from the first line to generate processed first image data; a depth image engine, configured to receive the second image data from the second line, and calculate depth image data based on the second image data; a multiplexer, configured to output the processed first image data from the grayscale image engine and the depth image data from the depth image engine; and an output port, configured to output the processed first image data and the depth image data from the multiplexer.Type: GrantFiled: August 5, 2020Date of Patent: October 18, 2022Assignee: Orbbec Inc.Inventors: Yuanhao Huang, Zhenzhong Xiao, Lianghong Zhong, Xiaolu Mei, Xing Xu, Xu Chen
-
Patent number: 11442285Abstract: A diffractive optical element for a structured light projection module and a method of using the diffractive optical element are described herein. The diffractive optical element is configured to: receive two-dimensional patterned beams and generate multi-order diffractive beams, wherein the two-dimensional patterned beams are emitted from a structured light projection module, the structured light projection module includes a light source comprising a plurality of sub-light sources arranged in a two-dimensional array, and the two-dimensional patterned beams correspond to the two-dimensional array; and project a plurality of two-dimensional patterned beams, wherein each of the plurality of two-dimensional patterned beams creates a corresponding duplicated pattern, and the duplicated patterns form a speckle pattern having uniform speckle density. The two-dimensional patterned beams can overlap with each other, or not overlap with each other.Type: GrantFiled: July 12, 2019Date of Patent: September 13, 2022Assignee: Orbbec Inc.Inventors: Xing Xu, Xu Chen
-
Patent number: 11445164Abstract: The present disclosure provides a structured light projection module comprising: a Vertical-Cavity Surface-Emitting Laser (VCSEL) array light source that includes a semiconductor substrate and at least two VCSEL sub-arrays arranged thereon. The at least two VCSEL sub-arrays include VCSEL light sources. The structured light projection module further includes a diffractive optical element (DOE) that includes at least two DOE sub-units. The DOE sub-units are respectively corresponding to the VCSEL sub-arrays and configured to project multiple copies of light beams emitted by the corresponding at least two VCSEL sub-arrays.Type: GrantFiled: January 20, 2021Date of Patent: September 13, 2022Assignee: Orbbec Inc.Inventors: Zhenzhong Xiao, Xing Xu, Xu Chen
-
Patent number: 11445163Abstract: A system and method for obtaining a target image are provided. The system includes: a floodlight illumination source configured to provide illumination of a first wavelength for a target area; a first acquisition camera configured to acquire a target floodlight image of the first wavelength of the target area; a structured light projector configured to project a structured light image of a second wavelength to the target area; a second acquisition camera configured to acquire the structured light image of the target area; and a processor, connected to the floodlight illumination source, the first acquisition camera, the structured light projector, and the second acquisition camera, and configured to: acquire the target floodlight image and the structured light image; recognize a foreground target in the floodlight image; and extract a target structured light image based on a relative position relationship between the first acquisition camera and the second acquisition camera.Type: GrantFiled: August 24, 2020Date of Patent: September 13, 2022Assignee: Orbbec Inc.Inventors: Xing Xu, Lianghong Zhong, Xu Chen
-
Patent number: 11335020Abstract: A method for correcting errors of a depth camera caused by the temperature includes: obtaining, by at least two depth cameras, a depth image of a current target, wherein two adjacent depth cameras of the at least two depth cameras have a common field of view; modeling a measurement error of the two adjacent depth cameras caused by a temperature change; and correcting the depth image using the modeled measurement error, wherein the corrected depth image has a minimum depth difference in the common field of view.Type: GrantFiled: April 14, 2020Date of Patent: May 17, 2022Assignee: Orbbec Inc.Inventors: Xianzhuo Liu, Zhiming Huang, Xu Chen
-
Patent number: 11237404Abstract: A diffractive optical element is configured to receive a first patterned light beams, and diffracts the first patterned light beams to project a second patterned light beam outwardly. The second patterned light beam is formed of combined arrangement of a plurality of first patterned light beams, and the combined arrangement includes periodic arrangement in a first direction and a second direction. The first direction and the second direction are not perpendicular to each other. By designing the performance of the diffractive optical element, the outwardly projected structured light pattern is periodically arranged in two directions, and the two directions are not perpendicular to each other, such that spot patterns are highly unrelated in multiple directions, improving accuracy.Type: GrantFiled: March 18, 2020Date of Patent: February 1, 2022Assignee: Orbbec Inc.Inventors: Xing Xu, Zhaomin Wang, Yuanhao Huang, Xu Chen
-
Patent number: 11238270Abstract: The present application provides an identity authentication method and an apparatus. The method may include obtaining a sequence of depth images containing a target face and a sequence of original two-dimensional (2D) images containing the target face, and performing identity authentication. The identity authentication may be conducted by: calculating a target face three-dimensional (3D) texture image according to the depth images containing the target face and the original 2D images containing the target face; projecting the target face 3D texture image to a 2D plane to obtain a target face 2D image; extracting feature information from the target face 2D image; comparing the feature information of the target face 2D image with feature information of a reference face 2D image to determine a similarity value; and in response to that the similarity value exceeds a first threshold, determining that the identity authentication succeeds.Type: GrantFiled: April 24, 2020Date of Patent: February 1, 2022Assignee: Orbbec Inc.Inventors: Zhenzhong Xiao, Yuanhao Huang, Xu Chen
-
Patent number: 11194171Abstract: A structured light projection module, a depth camera, and a method for manufacturing the structured light projection module are provided. The module comprises: a light source, comprising a plurality of sub-light sources that are arranged in a two-dimensional array and configured to emit two-dimensional patterned beams corresponding to the two-dimensional array, and the two-dimensional patterned beams comprising two-dimensional patterns; a lens, receiving and converging the two-dimensional patterned beams; and a diffractive optical element, receiving the two-dimensional patterned beams converged and emitted from the lens, and projecting speckle patterned beams corresponding to speckle patterns. The speckle patterns comprise a plurality of image patterns corresponding to the two-dimensional patterns. Relationships between adjacent image patterns of the plurality of image patterns comprise at least two of an overlapping relationship, an adjoining relationship, and a spacing relationship.Type: GrantFiled: May 5, 2020Date of Patent: December 7, 2021Assignee: Orbbec Inc.Inventors: Yuanhao Huang, Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
-
Patent number: 11049271Abstract: A depth calculation processor, a data processing method, and a 3D image device are disclosed herein. The depth calculation processor includes: two input ports to receive a first image data, wherein the first image data comprises structured light image acquired under projection of structured light; an input switch connected to the input ports and to convey all or some of the first image data from the input ports; a data processing engine connected to the input switch and to process the first image data that is output through the input switch and to output a second image data, wherein the second image data comprises a depth map, wherein the data processing engine comprises a depth processing engine to process the structured light image to obtain the depth map; and one output port connected to the data processing engine and to output the second image data to a main device.Type: GrantFiled: June 11, 2019Date of Patent: June 29, 2021Assignee: Orbbec Inc.Inventors: Xing Xu, Zhenzhong Xiao, Xiaolu Mei, Sheng Xu, Yuanhao Huang, Xu Chen
-
Patent number: 10958893Abstract: The present disclosure discloses a VCSEL array light source, a pattern design method for the VCSEL array light source, a laser projection apparatus, and a three-dimensional (3D) imaging device. The VCSEL array light source includes a semiconductor substrate and a plurality of VCSEL light sources arranged on the semiconductor substrate in a two-dimensional array. The two-dimensional array includes at least one sub-array and is generated by transforming the at least one sub-array.Type: GrantFiled: May 17, 2019Date of Patent: March 23, 2021Assignee: Orbbec Inc.Inventors: Zhaomin Wang, Min Yan, Xing Xu, Xu Chen
-
Patent number: 10931935Abstract: The present disclosure provides a structured light projection module comprising: a Vertical-Cavity Surface-Emitting Laser (VCSEL) array light source that includes a semiconductor substrate and at least two VCSEL sub-arrays arranged thereon. The at least two VCSEL sub-arrays include VCSEL light sources. The structured light projection module further includes a diffractive optical element (DOE) that includes at least two DOE sub-units. The DOE sub-units are respectively corresponding to the VCSEL sub-arrays and configured to project multiple copies of light beams emitted by the corresponding at least two VCSEL sub-arrays.Type: GrantFiled: May 17, 2019Date of Patent: February 23, 2021Assignee: ORBBEC INC.Inventors: Zhenzhong Xiao, Xing Xu, Xu Chen
-
Patent number: D999804Type: GrantFiled: June 14, 2022Date of Patent: September 26, 2023Assignee: Orbbec Inc.Inventors: Zuanze Lin, Jianhua Tang