By Projection Of Coded Pattern Patents (Class 356/610)
  • Patent number: 11966555
    Abstract: A system, method, and apparatus for measuring a workspace is provided. The method includes capturing a workspace that is virtually represented on a user interface display of a computing apparatus that image-captured the workspace. The user inputs, via the user interface, a value of a known measurement of a length represented in the virtual workspace. Through the user interface, along the virtual workspace, the user identifies virtual end boundary points of the length associated with the known measurement. The user then defines a defined space within the virtual workspace by placing additional virtual boundary points. The system calibrates from the inputted value and the virtual end boundary points of the known measurement all the remaining measurements of the surface area, which can be used to render a map display and calculate surface area, volume, or any other geometric aspects of the defined space.
    Type: Grant
    Filed: January 9, 2023
    Date of Patent: April 23, 2024
    Inventors: Charles Allan Wolford, Garrett Scott Isaacs
  • Patent number: 11954767
    Abstract: Methods, systems, and computer readable media for generating a three-dimensional reconstruction of an object with reduced distortion are described. In some aspects, a system includes at least two image sensors, at least two projectors, and a processor. Each image sensor is configured to capture one or more images of an object. Each projector is configured to illuminate the object with an associated optical pattern and from a different perspective. The processor is configured to perform the acts of receiving, from each image sensor, for each projector, images of the object illuminated with the associated optical pattern and generating, from the received images, a three-dimensional reconstruction of the object. The three-dimensional reconstruction has reduced distortion due to the received images of the object being generated when each projector illuminates the object with an associated optical pattern from the different perspective.
    Type: Grant
    Filed: January 20, 2023
    Date of Patent: April 9, 2024
    Assignee: Cognex Corporation
    Inventors: Martin Schaffer, Marcus Große
  • Patent number: 11768102
    Abstract: A vibration measurement apparatus 30 includes a detection unit 31 that acquires, as a pattern image from an image capturing apparatus 20 that shoots a measurement target surface of a structure 40, an image of the measurement target surface onto which pattern light is projected by an optical apparatus 10, and detects the pattern light from the pattern image, an estimation unit 32 that estimates an angle between the normal of the image capturing surface and the normal of the measurement target surface, based on the pattern light, an image conversion unit 33 that converts the shot image into an image that would be obtained were the normal of the measurement target surface coincident with the normal of the image capturing surface of the image capturing apparatus 20, using the estimated angle, and a vibration measurement unit 34 that measures the vibration of the structure 40 using the converted image.
    Type: Grant
    Filed: March 29, 2018
    Date of Patent: September 26, 2023
    Assignee: NEC CORPORATION
    Inventors: Gaku Nakano, Masahiko Ohta, Asuka Ishii, Kazuhito Murata
  • Patent number: 11726411
    Abstract: A substrate shape measuring device, including: a substrate support to support a substrate having a main surface, the main surface of the substrate when supported by the substrate support substantially extending in a first plane; one or more sensor assemblies, each including a light emitter to emit light along a light axis substantially parallel to the first plane and a light sensor arranged to receive the light; and a processing device arranged to determine a shape of the substrate, wherein the substrate shape measuring device is constructed to measure with the one or more sensor assemblies in at least a first measurement direction with respect to the substrate substantially parallel to the first plane and a second measurement direction with respect to the substrate substantially parallel to the first plane.
    Type: Grant
    Filed: June 8, 2020
    Date of Patent: August 15, 2023
    Assignee: ASML NELHERLANDS B.V.
    Inventors: Gijs Kramer, Ringo Petrus Cornelis Van Dorst
  • Patent number: 11710945
    Abstract: An optoelectronic apparatus includes a heat sink, which is shaped to define a base, a first platform at a first elevation above the base, and a second platform alongside the first platform at a second elevation above the base, which is different from the first elevation. A first monolithic emitter array is mounted on the first platform and is configured to emit first optical beams. A second monolithic emitter array is mounted on the second platform and is configured to emit second optical beams. An optical element is configured to direct both the first and the second optical beams toward a target region.
    Type: Grant
    Filed: April 6, 2021
    Date of Patent: July 25, 2023
    Assignee: APPLE INC.
    Inventors: Yazan Z. Alnahhas, Harish Govindarajan, Oyvind Svensen, Yuval Tsur, Zhengyu Miao, Christopher M. Wright
  • Patent number: 11663786
    Abstract: Provided is an eyewear display system includes: a scanner including a measuring unit configured to acquire three-dimensional coordinates, a point cloud data acquiring unit configured to acquire point cloud data, and a communication unit; an eyewear device including a display, a relative position detection sensor, a relative direction detection sensor, and a communication unit; a storage device including CAD design data of an observation site; and a data processing device configured to synchronize a coordinate space of the scanner, a coordinate space of the eyewear device, and a coordinate space of the CAD design data, and convert observation data OD and/or observation data prediction PD into data in the coordinate space of the CAD design data, such that the eyewear device displays the observation data OD or observation data prediction PD on the display by superimposing the observation data OD or observation data prediction PD on an actual landscape.
    Type: Grant
    Filed: May 6, 2021
    Date of Patent: May 30, 2023
    Assignee: TOPCON CORPORATION
    Inventors: Satoshi Yasutomi, Takeshi Kikuchi
  • Patent number: 11587268
    Abstract: Methods, systems, and computer readable media for generating a three-dimensional reconstruction of an object with reduced distortion are described. In some aspects, a system includes at least two image sensors, at least two projectors, and a processor. Each image sensor is configured to capture one or more images of an object. Each projector is configured to illuminate the object with an associated optical pattern and from a different perspective. The processor is configured to perform the acts of receiving, from each image sensor, for each projector, images of the object illuminated with the associated optical pattern and generating, from the received images, a three-dimensional reconstruction of the object. The three-dimensional reconstruction has reduced distortion due to the received images of the object being generated when each projector illuminates the object with an associated optical pattern from the different perspective.
    Type: Grant
    Filed: August 29, 2019
    Date of Patent: February 21, 2023
    Assignee: Cognex Corporation
    Inventors: Martin Schaffer, Marcus Große
  • Patent number: 11543671
    Abstract: A structured light projection module and a depth camera are provided. The structured light projection module includes: a light source array including a plurality of sub-light sources arranged in a two-dimensional pattern and configured to transmit array beams corresponding to the two-dimensional pattern; a lens configured to receive and converge the array beams; and a diffractive optical element configured to receive the array beams that are emitted after being converged by the lens and project beams in a structured light speckle pattern. The structured light speckle pattern is formed through staggered superposition of at least two secondary structured light speckle patterns. Each secondary structured light speckle pattern is formed through a tiling arrangement of multiple sub-speckle patterns generated by a portion of the sub-light sources, and comprises speckles formed by diffracting an individual sub-light source via the diffractive optical element.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: January 3, 2023
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Xu Chen
  • Patent number: 11520013
    Abstract: A LIDAR system that includes a laser unit, a receiving unit, and a cooling device for generating a cooling airflow. The laser unit, the receiving unit, and the cooling device are situated rotatingly about a rotational axis, so that the cooling airflow for cooling the rotating components is generated by the LIDAR system itself.
    Type: Grant
    Filed: September 7, 2018
    Date of Patent: December 6, 2022
    Assignee: Robert Bosch GmbH
    Inventors: Mirko Hattass, Michael Zoeller, Alexander Greiner, Remigius Has
  • Patent number: 11513211
    Abstract: Some embodiments include a method of generating an environment reference model for positioning comprising: receiving multiple data sets representing a scanned environment including information about a type of sensor used and data for determining an absolute position of objects or feature points represented by the data sets; extracting one or more objects or feature points from each data set; determining a position of each object or feature point in a reference coordinate system; generating a three-dimensional vector representation of the scanned environment aligned with the reference coordinate system including representation of the objects or feature points at corresponding locations; creating links between the objects or feature points in the three-dimensional vector model with an identified type of sensor by which they can be detected in the environment; and storing the three-dimensional vector model representation and the links in a retrievable manner.
    Type: Grant
    Filed: November 29, 2016
    Date of Patent: November 29, 2022
    Assignee: Continental Automotive GmbH
    Inventors: Christian Thiel, Paul Barnard, Bingtao Gao
  • Patent number: 11493922
    Abstract: The technology relates to an exterior sensor system for a vehicle configured to operate in an autonomous driving mode. The technology includes a close-in sensing (CIS) camera system to address blind spots around the vehicle. The CIS system is used to detect objects within a few meters of the vehicle. Based on object classification, the system is able to make real-time driving decisions. Classification is enhanced by employing cameras in conjunction with lidar sensors. The specific arrangement of multiple sensors in a single sensor housing is also important to object detection and classification. Thus, the positioning of the sensors and support components are selected to avoid occlusion and to otherwise prevent interference between the various sensor housing elements.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: November 8, 2022
    Assignee: Waymo LLC
    Inventors: Peter Avram, Kimberly Toth, Jeremy Dittmer, Giulia Guidi
  • Patent number: 11449970
    Abstract: A three-dimensional geometry measurement apparatus including a virtual coordinate identification part that identifies coordinates of a virtual captured pixel corresponding to a feature point in an image plane of a capturing device by virtually projecting the feature point on a reference instrument onto the image plane: correction part that generates correction information for correcting coordinates of the measurement-target captured pixel included in a measurement-target captured image; and a geometry identification part that corrects coordinates of a plurality of the measurement-target captured pixels included in the measurement-target captured image generated by capturing an object to be measured with the capturing device on the basis of geometric property information and the correction information, and identifies a geometry of the object to be measured on the basis of measurement three-dimensional coordinates to be calculated based on the coordinates of the measurement-target captured pixels.
    Type: Grant
    Filed: January 18, 2021
    Date of Patent: September 20, 2022
    Assignee: MITUTOYO CORPORATION
    Inventor: Kaoru Miyata
  • Patent number: 11442285
    Abstract: A diffractive optical element for a structured light projection module and a method of using the diffractive optical element are described herein. The diffractive optical element is configured to: receive two-dimensional patterned beams and generate multi-order diffractive beams, wherein the two-dimensional patterned beams are emitted from a structured light projection module, the structured light projection module includes a light source comprising a plurality of sub-light sources arranged in a two-dimensional array, and the two-dimensional patterned beams correspond to the two-dimensional array; and project a plurality of two-dimensional patterned beams, wherein each of the plurality of two-dimensional patterned beams creates a corresponding duplicated pattern, and the duplicated patterns form a speckle pattern having uniform speckle density. The two-dimensional patterned beams can overlap with each other, or not overlap with each other.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: September 13, 2022
    Assignee: Orbbec Inc.
    Inventors: Xing Xu, Xu Chen
  • Patent number: 11373321
    Abstract: Provided are projectors, each including a light source configured to emit laser light, a substrate spaced apart from the light source, a pattern mask including a pattern disposed on a first surface of the substrate, the first surface facing the light source, and a meta-lens including a plurality of first nanostructures formed on a second surface of the substrate, the second surface opposite the first surface, the nanostructures having a dimension of a sub-wavelength that is less than a wavelength of light emitted from the light source.
    Type: Grant
    Filed: November 16, 2018
    Date of Patent: June 28, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jangwoo You, Byunghoon Na, Seunghoon Han
  • Patent number: 11317078
    Abstract: A method and system are disclosed that can rapidly and automatically determine the optimal exposure time for high-quality three-dimensional (3D) shape measurement with digital fringe projection technique. The method only requires capturing a fringe pattern image with one exposure time to automatically determine a single global optimal exposure time for high quality 3D shape measurement. The method can be extended to automatically determine a plurality of optimal exposure times for HDR image capture.
    Type: Grant
    Filed: May 14, 2020
    Date of Patent: April 26, 2022
    Assignee: Purdue Research Foundation
    Inventor: Song Zhang
  • Patent number: 11223816
    Abstract: The present invention provides a projector including a laser module and a lens module, wherein the lens module includes a plurality of lens and a plurality of diffractive optical elements. In the operations of the projector, the laser module is arranged to generate at least one laser beam; each of the lenses is arranged to receive one of the at least one laser beam to generate a collimated laser beam; and the diffractive optical elements correspond to the lenses, respectively, and each of the diffractive optical elements is arranged to receive the collimated laser beam from the corresponding lens to generate an image. The images generated by the diffractive optical elements form a projected image of the projector. By using the projector of the present invention, the projected image may have higher resolution or field of view that is advantageous for the 3D sensing system.
    Type: Grant
    Filed: September 26, 2018
    Date of Patent: January 11, 2022
    Assignee: HIMAX TECHNOLOGIES LIMITED
    Inventors: Biing-Seng Wu, Han-Yi Kuo, Bo-Han Lyu, Yin-Dong Lu, Kuan-Ming Chen, Meng-Ko Tsai
  • Patent number: 11187790
    Abstract: A laser scanning system of the present invention includes a first rotation mechanism configured to perform a rotation in a predetermined first rotation axis and at a rotation speed around the first rotation axis as a rotation center; a first rotation speed control unit configured to control the rotation speed of the rotation in the first rotation axis by the first rotation mechanism, and a laser scanner device disposed on the first rotation mechanism, to be rotated together with and by the first rotation mechanism, and the laser scanner device including a laser distance measuring unit configured to emit a leaser and to measure a distance to a detection target, wherein the first rotation speed control unit is configured to make a control to the rotation speed of the rotation in the first rotation axis in a detection rotation angle range corresponding to an area in which the detection target is present and another control to the rotation speed of the rotation in the first rotation axis in a non-detection rotati
    Type: Grant
    Filed: January 16, 2017
    Date of Patent: November 30, 2021
    Assignee: Meiji University
    Inventor: Yoji Kuroda
  • Patent number: 11169129
    Abstract: Methods and systems for calibrating inspection of a feature on a part are described. The method comprises acquiring, at a plurality of point cloud densities, measurement data from a reference part having a known defect associated with the feature; assessing the measurement data at the plurality of point cloud densities to detect the known defect; determining a lowest point cloud density from the plurality of point cloud densities at which the known defect is detectable; and setting an inspection point cloud density for inspection of the feature to the lowest point cloud density.
    Type: Grant
    Filed: February 18, 2020
    Date of Patent: November 9, 2021
    Assignee: PRATT & WHITNEY CANADA CORP.
    Inventors: Mario Blais, Clement Drouin Laberge
  • Patent number: 11146735
    Abstract: The present disclosure provides an image processing method, an image processing apparatus, a computer readable storage medium, and an electronic device. The method includes: in response to detecting that a camera component is turned on, controlling the camera component to collect a speckle image, the speckle image being an image formed by illuminating an object with laser speckles; detecting a target temperature of the camera component, and acquiring a corresponding reference image based on the target temperature, the reference image being an image with reference depth information and collected when calibrating the camera component; and calculating based on the speckle image and the reference image to acquire a depth image.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: October 12, 2021
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Ziqing Guo, Haitao Zhou, Kamwing Au, Xiao Tan, Guohui Tan
  • Patent number: 11015917
    Abstract: A method of dimensioning an object includes: projecting, from a plurality of laser emitters disposed on a dimensioning device and having a predefined spatial arrangement forming a plane, respective laser beams onto a surface of the object, the laser beams oriented parallel to each other; controlling an image sensor of the dimensioning device, simultaneously with the projecting, to capture image data representing the surface and projections of the laser beams on the surface; detecting projection pixel coordinates in the image data representing the projections of the laser beams on the surface; detecting edge pixel coordinates in the image data representing edges of the surface; and determining a dimension of the surface based on the projection pixel coordinates, the edge pixel coordinates, and the predefined spatial arrangement.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: May 25, 2021
    Assignee: Zebra Technologies Corporation
    Inventor: Sanjeewa Thimirachandra
  • Patent number: 10996483
    Abstract: A structured light projector and a method for structured light projection are disclosed. The structured light projector includes a projection module, an image sensor and a processor. The projection module is configured to project an optical pattern onto a region of space. The image sensor is configured to capture an image by detecting the optical pattern projected onto the region of space. The processor is configured to calculate disparity information of the optical pattern projected onto the region of space from the captured image, and is configured to compensate for the disparity of depending on an environment temperature of the projection module.
    Type: Grant
    Filed: December 24, 2019
    Date of Patent: May 4, 2021
    Assignee: HIMAX TECHNOLOGIES LIMITED
    Inventors: Ching-Wen Wang, Cheng-Che Tsai, Wu-Feng Chen, Yi-Hsiu Lin, Hsueh-Tsung Lu
  • Patent number: 10928187
    Abstract: Prediction of a distribution of light in an illumination pupil of an illumination system includes identifying component(s) of the illumination system the adjustment of which affects this distribution and simulating the distribution based on a point spread function defined in part by the identified components. The point spread function has functional relationship with configurable setting of the illumination settings.
    Type: Grant
    Filed: October 17, 2017
    Date of Patent: February 23, 2021
    Assignee: Nikon Corporation
    Inventors: Daniel Gene Smith, Eric Peter Goodwin
  • Patent number: 10802291
    Abstract: A compact folded projection system is described that includes a laser light source, a folded lens system comprising a lens stack including two or more refractive lenses and a light folding element (e.g., a prism), and a diffractive beam splitter that includes at least one diffractive surface. The light folding element provides a “folded” optical axis for the lens system to reduce the Z-height of the projection system, for example to within a range of 1.7 to 4 millimeters (e.g., 2 millimeters in some implementations). The laser light source emits light that is refracted by the lens stack to the folding element. The folding element redirects the light to the beam splitter which replicates the light into N×M duplications or tiles to thus generate a larger field of view (FOV) than the internal FOV of the lens system.
    Type: Grant
    Filed: March 21, 2019
    Date of Patent: October 13, 2020
    Assignee: Apple Inc.
    Inventors: Refael Della Pergola, Chandra Kakani, Roei Remez, Yuval Tsur
  • Patent number: 10788317
    Abstract: The various embodiments described herein include methods and/or systems for depth mapping. In one aspect, a method of depth mapping is performed at an apparatus including a projector, a camera, one or more processors, and memory storing one or more programs for execution by the one or more processors. The method includes identifying one or more areas of interest in a scene in accordance with variation of depth in the scene as detected at a first resolution. The method also includes, for each area of interest: (1) applying, via the projector, a respective structured-light pattern to the area of interest; (2) capturing, via the camera, an image of the area of interest with the respective structured-light pattern applied to it; and (3) creating a respective depth map of the area of interest using the captured image, the respective depth map having a higher resolution than the first resolution.
    Type: Grant
    Filed: August 1, 2018
    Date of Patent: September 29, 2020
    Assignee: FACEBOOK, INC.
    Inventors: Shizhe Shen, Francislav P. Penov, Aidymar Bigio
  • Patent number: 10748015
    Abstract: Disclosed is an optical unit wherein a rotating reflector rotates about a rotation axis in one direction, while reflecting light emitted from a light source. The rotating reflector is provided with a reflecting surface such that the light reflected by the rotating reflector, while rotating, forms a desired light distribution pattern, said light having been emitted from the light source. The light source is composed of light emitting elements. The rotation axis is provided within a plane that includes an optical axis and the light source. The rotating reflector is provided with, on the periphery of the rotation axis, a blade that functions as the reflecting surface.
    Type: Grant
    Filed: February 16, 2017
    Date of Patent: August 18, 2020
    Assignee: KOITO MANUFACTURING CO., LTD.
    Inventor: Satoshi Yamamura
  • Patent number: 10612912
    Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: April 7, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Mark Timothy Sullivan, Andrew Matthew Bardagjy, Joseph Duggan, Fei Liu, Simon Morris Shand Weiss
  • Patent number: 10607064
    Abstract: An optical projection system includes an image sensor, a light emitting circuit and a processor. The image sensor is configured to capture an image of a target object. The processor is electrically coupled to the image sensor and the light emitting circuit. The processor is configured to determine a size of the target object, and control the light emitting circuit to emit an optical pattern and to fan out the optical pattern according to the size of the target object, in order to cover the target object.
    Type: Grant
    Filed: May 21, 2018
    Date of Patent: March 31, 2020
    Assignee: HIMAX TECHNOLOGIES LIMITED
    Inventors: Cheng-Hung Chi, Yi-Nung Liu
  • Patent number: 10585193
    Abstract: The technology disclosed relates to determining positional information of an object in a field of view. In particular, it relates to calculating a distance of the object from a reference such as a sensor including scanning the field of view by selectively illuminating directionally oriented light sources and measuring one or more differences in property of returning light emitted from the light sources and reflected from the object. The property can be intensity or phase difference of the light. It also relates to finding an object in a region of space. In particular, it relates to scanning the region of space with directionally controllable illumination, determining a difference in a property of the illumination received for two or more points in the scanning, and determining positional information of the object based in part upon the points in the scanning corresponding to the difference in the property.
    Type: Grant
    Filed: March 26, 2018
    Date of Patent: March 10, 2020
    Assignee: Ultrahaptics IP Two Limited
    Inventor: David Holz
  • Patent number: 10551175
    Abstract: In a first step, numbering with a reference field of view at one area set first by an operator being defined as an original point is performed. In a second step, a place adjacent to a side around the reference field of view is numbered, then the measurement range is automatically moved to sequentially execute measurement at that position, presence of shape data is checked, measurement results is stored, and, presence of shape data at the numbered position is recorded on a memory device. In a third step, field of view with shape data found therein as a next reference field of view is employed, a place adjacent to a side around the reference field of view is numbered, then the measurement range is automatically moved to sequentially execute measurement at that position other than a position at which measurement has already been made or no shape data is found.
    Type: Grant
    Filed: January 16, 2019
    Date of Patent: February 4, 2020
    Assignee: MITUTOYO CORPORATION
    Inventor: Hiroshi Sakai
  • Patent number: 10545275
    Abstract: A waveguide comprises a first surface and a second surface. The first surface comprises a first plurality of grating structures. The waveguide is configured to guide an in-coupled light beam to undergo total internal reflection between the first surface and the second surface. The first grating structures are configured to disrupt the total internal reflection to cause at least a portion of the in-coupled light beam to couple out of the waveguide and project from the first surface, the portion of the in-coupled light beam coupled out of the waveguide forming out-coupled light beams, the out-coupled light beams being configured to form an array of dots on a surface where the out-coupled light beams are projected on.
    Type: Grant
    Filed: July 16, 2018
    Date of Patent: January 28, 2020
    Assignee: Shenzhen Guangjian Technology Co., Ltd.
    Inventor: Fanglu Lyu
  • Patent number: 10498109
    Abstract: A pattern projector with multiple point light source includes a light source of multiple point source capable of providing plural laser dot light beams in a spherical wave form, a lens element and a diffractive optical element. Plural light dots are arranged to form an arrangement pattern of emitting light dots in a specific regularity. The arrangement pattern of emitting light dots is imaged and multiplied to form plural ones. The neighboring two arrangement patterns of emitting light dots are partially overlapped. Non-regularity without repeat and variety on the overlapped portions can be achieved by DOE design that may adjust different overlapping degrees and ways on the arrangement patterns of emitting light dots in a specific regularity.
    Type: Grant
    Filed: December 17, 2018
    Date of Patent: December 3, 2019
    Assignee: DIGIGRAM TECHNOLOGY CO., LTD.
    Inventors: Chao Hsu Tsai, Chiu-Lan Chu
  • Patent number: 10393515
    Abstract: In a three-dimensional scanner, a scanner main body calculates the position and direction of a depth sensor. The scanner main body also determines a movement candidate, which is a candidate for a position and direction to/in which the depth sensor is to be moved next. Then, the scanner main body acquires a feature within the movement candidate, which is the feature observable by the depth sensor from the movement candidate, and evaluates the stability of mapping performed from the movement candidate through use of the feature within the movement candidate. The scanner main body further presents at least any one of the moving direction or moving speed of the depth sensor to a user based on an evaluation result.
    Type: Grant
    Filed: January 20, 2016
    Date of Patent: August 27, 2019
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Ryosuke Kawanishi, Makito Seki, Keisuke Sambongi, Yu Enomoto
  • Patent number: 10386706
    Abstract: A structured-light projector includes a diffractive optical element (DOE) that receives a collimated light and generates a plurality of light tiles. The DOE includes a plurality of optical components disposed on a substrate, wherein the optical components of the DOE are randomly arranged on the substrate.
    Type: Grant
    Filed: September 15, 2017
    Date of Patent: August 20, 2019
    Assignee: Himax Technologies Limited
    Inventors: Ming-Shu Hsiao, Yi-Nung Liu
  • Patent number: 10378888
    Abstract: A device, for spatially measuring surfaces, includes a projector for projecting patterns into an object space, two cameras for recording pictures of a surface in the object space, and a control and evaluation unit for activating the cameras and evaluating the pictures. The projector includes a light source, a projection lens, at least one rotatably arranged pattern structure, and a drive for rotating the at least one pattern structure. The control and evaluation unit to: activate the cameras for simultaneously recording a picture at each of a plurality of successive points in time; identify corresponding points in the picture planes of the cameras, by way of evaluating a correlation function between the sequences of brightness values acquired for potentially corresponding points and maximizing a value of the correlation; and determine spatial coordinates of surface points by way of triangulation on the basis of the identified corresponding points.
    Type: Grant
    Filed: May 4, 2016
    Date of Patent: August 13, 2019
    Assignees: FRIEDRICH-SCHILLER-UNIVERSITAET JENA, FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN
    Inventors: Stefan Heist, Gunther Notni, Kevin Srokos, Peter Lutzke, Ingo Schmidt, Peter Kühmstedt
  • Patent number: 10359414
    Abstract: Devices and methods for performing frequency domain (FD) fluorescence lifetime spectroscopy are provided. The devices include a modulated light source, a focusing optical fiber, a detecting optical fiber, and a detector. The methods include focusing sinusoidal modulated incident light from a light source on a biological sample containing a protein, detecting a range of wavelengths of sinusoidal modulated fluorescent light emitted from the protein, determining a phase shift for the modulated fluorescent light, determining an amplitude modulation of the modulated fluorescent light, and determining a fluorescence lifetime of the protein.
    Type: Grant
    Filed: March 9, 2016
    Date of Patent: July 23, 2019
    Assignee: The Regents of the University of Michigan
    Inventors: Joe Fu-Jiou Lo, Zhengtuo Zhao, Rui Liu
  • Patent number: 10317684
    Abstract: In one embodiment, the light from a single laser is used to illuminate a pattern-generating optical element to generate a pattern. The pattern-generating optical element in various embodiments can be, for example, a holographic diffractive optical element (DOE) or an array of micro-lenses. A multiple beam grating (MBG) duplicates the pattern multiple times to provide a multiple pattern image. A lens is used to project the patterns onto an object. In one embodiment, the lens is located between the pattern-generating optical element and the multiple beam grating (MBG).
    Type: Grant
    Filed: January 24, 2018
    Date of Patent: June 11, 2019
    Assignee: K Laser Technology, Inc.
    Inventor: Wai-Hon Lee
  • Patent number: 10317192
    Abstract: The geometry measurement apparatus includes: an image acquisition part that acquires a plurality of captured images generated by imaging an object to be measured, onto which a plurality of respectively different projection patterns are sequentially projected; a quantization part that generates a quantization value of a luminance value for each pixel in the plurality of captured images by comparing the luminance value with a predetermined reference value; a selection part that selects, based on the relationship between the reference value and the luminance value for a plurality of pixels having the same coordinates in the plurality of captured images, a quantization value to be used for identifying the geometry of the object to be measured, from among a plurality of quantization values corresponding to the plurality of captured images; and a geometry identification part that identifies the geometry of the object to be measured based on the quantization value selected by the selection part.
    Type: Grant
    Filed: February 15, 2017
    Date of Patent: June 11, 2019
    Assignee: MITUTOYO CORPORATION
    Inventor: Kaoru Miyata
  • Patent number: 10257428
    Abstract: An image processing apparatus includes an acquisition unit to acquire a captured image obtained by capturing, by an image capturing unit, a target object to which a pattern has been projected. An adjustment unit adjusts, based on the pattern in the acquired captured image, at least one of a first parameter for controlling brightness of the pattern projected from a projection unit configured to project the pattern, and a second parameter for controlling an exposure amount of the image capturing unit.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: April 9, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Hiroshi Yoshikawa, Shinji Uchiyama
  • Patent number: 10240913
    Abstract: The invention makes it possible to measure an object with a three dimensional shape that is made of various materials with a high degree of precision and at high-speed, without requiring a vast amount advance of preparation. A measuring unit detects internal scattering light measuring areas in a captured image, and obtains profiles of internal scattering light components in the areas. An estimating unit estimates the internal scattering light components in three-dimensional coordinate measuring areas based on the profiles of the internal scattering light components in the internal scattering light measuring areas. A reducing unit reduces the internal scattering light components in the three-dimensional coordinate measuring areas to generate a direct-reflected light component image. Then, a calculating unit calculates three-dimensional coordinates on measuring lines based on the direct-reflected light component image.
    Type: Grant
    Filed: October 6, 2015
    Date of Patent: March 26, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Toshihiro Kobayashi
  • Patent number: 10139217
    Abstract: A light emitter is provided to emit, into an environment of interest, a plurality of different patterns of light during respective periods of time. Each of the different patterns of light varies according to angle in a first direction such the location of a light detector disposed in the environment can be determined based on illumination from the light emitter that is detected by the light detector over time. The light emitter includes an astigmatic optical element and a die on which are disposed multiple sets of one or more light emitters, each set corresponding to a respective pattern of illumination emitted from the light emitter. Such a configuration of the light emitter can provide means for producing the different patterns of illumination in an energy-efficient, low-cost, and/or size-constrained manner.
    Type: Grant
    Filed: February 16, 2016
    Date of Patent: November 27, 2018
    Assignee: Google LLC
    Inventors: Jason Holt, Roman Lewkow, Sameer Ansari
  • Patent number: 10049460
    Abstract: An object is identified or tracked within a volume by projecting a light beam encoded with one or more predefined properties to have a predefined optical structure into the volume. A detector captures light from the predefined optical structure reflected from the volume. By analyzing one or more characteristics of light from the predefined optical structure reflected from the object, the object is segmented from the volume.
    Type: Grant
    Filed: February 24, 2016
    Date of Patent: August 14, 2018
    Assignee: Facebook, Inc.
    Inventors: Nitay Romano, Nadav Grossinger
  • Patent number: 10045015
    Abstract: A method for synchronizing a camera that has an image sensor with a projector that can generate a synchronization signal which corresponds to the projector frame rate. The projector is operated with a frame rate (F2), and the camera is operated with a frame rate (F1). A blanking interval is formed between individual images, and the synchronization signal of the projector is provided for controlling the camera. In order to match a phase (P1) of the frame rate (F1) of the camera to a phase (P2) of the frame rate (F2) of the projector and/or in order to match the frame rate (F1) of the camera to the frame rate (F2) of the projector, one or more blanking intervals between the individual images of the camera are varied dependent on the synchronization signal of the projector.
    Type: Grant
    Filed: April 23, 2012
    Date of Patent: August 7, 2018
    Assignee: VRMAGIC GMBH
    Inventors: Stefan Sichler, Oliver Menken
  • Patent number: 10032279
    Abstract: An information processing apparatus includes an image acquisition unit configured to acquire an image obtained by imaging a target object onto which a pattern having a bright portion and a dark portion is projected by a projection unit, an allocation unit configured to allocate, to a pixel in the image, a label corresponding to luminance of the pixel by referring to a characteristic of the pattern, and a correspondence relationship derivation unit configured to derive a correspondence relationship between a position of the pattern in a projection plane of the projection unit and a position of the pattern in the acquired image and a three-dimensional coordinate derivation unit configured to derive three-dimensional coordinates of a surface of the target object based on the derived correspondence relationship.
    Type: Grant
    Filed: February 19, 2016
    Date of Patent: July 24, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Masaki Inaba, Tomoaki Higo
  • Patent number: 10016862
    Abstract: The present invention provides a measurement apparatus for measuring a shape of an object to be measured, including a processing unit configured to obtain information on the shape of the object to be measured based on an image obtained by imaging the object to be measured onto which pattern light alternately including a bright portion and a dark portion along a first direction is projected, wherein the processing unit obtains a plurality of first signals different from each other and indicating a light intensity distribution in a second direction intersecting the first direction, from a region of the image, which corresponds to the dark portion.
    Type: Grant
    Filed: May 31, 2016
    Date of Patent: July 10, 2018
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Tsuyoshi Yamazaki
  • Patent number: 9772720
    Abstract: Control apparatus includes an optical subsystem, which is configured to direct first light toward a scene that includes a hand of a user in proximity to a wall of a room and to receive the first light that is reflected from the scene, and to direct second light toward the wall so as to project an image of a control device onto the wall. A processor is configured to control the optical subsystem so as to generate, responsively to the received first light, a depth map of the scene, to process the depth map so as to detect a proximity of the hand to the wall in a location of the projected image, and to control electrical equipment in the room responsively to the proximity.
    Type: Grant
    Filed: June 14, 2016
    Date of Patent: September 26, 2017
    Assignee: APPLE INC.
    Inventors: Alexander Shpunt, Raviv Erlich, Ronen Akerman, Ran Halutz
  • Patent number: 9599463
    Abstract: An object detection device includes at least one light source, an irradiation optical system configured to irradiate a measured object with light emitted from the light source, a light reception element configured to image reflected light reflected by the measured object, and a detection unit configured to detect the measured object based on the reflected light received by the light reception element, and the irradiation optical system includes conversion means for converting the light emitted from the light source into a plurality of regular patterns.
    Type: Grant
    Filed: October 1, 2015
    Date of Patent: March 21, 2017
    Assignee: ALPS ELECTRIC CO., LTD.
    Inventors: Tatsumaro Yamashita, Yoshihiro Someno
  • Patent number: 9575184
    Abstract: A multi-ladar sensor system is proposed for operating in dense environments where many ladar sensors are transmitting and receiving burst mode light in the same space, as may be typical of an automotive application. The system makes use of several techniques to reduce mutual interference between independently operating ladar sensors. In one embodiment, the individual ladar sensors are each assigned a wavelength of operation, and an optical receive filter for blocking the light transmitted at other wavelengths, an example of wavelength division multiplexing (WDM). Each ladar sensor, or platform, may also be assigned a pulse width selected from a list, and may use a pulse width discriminator circuit to separate pulses of interest from the clutter of other transmitters. Higher level coding, involving pulse sequences and code sequence correlation, may be implemented in a system of code division multiplexing, CDM.
    Type: Grant
    Filed: July 3, 2014
    Date of Patent: February 21, 2017
    Assignee: Continental Advanced LIDAR Solutions US, Inc.
    Inventors: Patrick Gilliland, Howard Bailey, Roger Stettner, Nitin Kataria
  • Patent number: 9521399
    Abstract: Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction.
    Type: Grant
    Filed: April 25, 2016
    Date of Patent: December 13, 2016
    Assignee: AQUIFI, INC.
    Inventors: Aryan Hazeghi, Carlo Dal Mutto, Abbas Rafii, David Demirdjian
  • Patent number: 9322643
    Abstract: An apparatus for 3D surface measurement of a target surface, the apparatus comprising: a first projector configured to project a fringe pattern onto the target surface; a second projector configured to project a fringe pattern onto the target surface; a first camera configured to capture the fringe patterns projected by the first projector and the second projector; a second camera configured to capture the fringe patterns projected by the first projector and the second projector; and a computer configured to perform fringe pattern processing of the fringe patterns captured by the first camera and the second camera and to perform data stitching and merging to obtain a 3D surface reconstruction.
    Type: Grant
    Filed: October 17, 2012
    Date of Patent: April 26, 2016
    Assignee: NANYANG TECHNOLOGICAL UNIVERSITY
    Inventors: Lei Huang, Chi Seng Ng, Hoe Jyh Koh, Anand Krishna Asundi
  • Patent number: 9325973
    Abstract: Dynamic projection of at least first and second patterns contributes detectable disparity onto a scene that includes a target object. The scene is imaged with two-dimensional cameras whose acquired imagery includes disparity contributions whose presence enable a three-dimensional reconstruction depth map to be rapidly and accurately generated. In one embodiment coherent light is input to a first DOE within whose near range output is disposed a second DOE, whose far range output projects an image. Electronically varying effective optical distance between the two DOEs varies the pattern projected from the second DOE. A processor system and algorithms enable dynamic intelligent selection of projected patterns to more readily discern target object characteristics: shape, size, velocity. Patterns can implement spatio-temporal depth reconstruction, spatio-temporal depth reconstruction, and even single-camera spatio-temporal light coding reconstruction.
    Type: Grant
    Filed: July 1, 2015
    Date of Patent: April 26, 2016
    Assignee: AQUIFI, INC.
    Inventors: Aryan Hazeghi, Carlo Dal Mutto, Abbas Rafii, David Demirdjian