Three-dimensional-mapping two-dimensional-scanning LIDAR based on one-dimensional-steering optical phased arrays and method of using same

- Quanergy Systems, Inc.

A plurality of one-dimensional planar beam forming and steering optical phased array chips form a two-dimensional-scanning solid-state lidar, enabling manufacturing of three-dimensional mapping time-of-flight lidars at high yield and low cost resulting from the simplicity of said one-dimensional optical phased array chips.

Skip to: Description  ·  Claims  ·  References Cited  · Patent History  ·  Patent History
Description
CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No. 14/460,369 filed Aug. 15, 2014, the contents of which are incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates generally to the field of environment sensing, and more particularly to the use of Time of Flight (ToF) lidar sensors for real-time three-dimensional mapping and object detection, tracking, identification and/or classification.

BACKGROUND OF THE INVENTION

A lidar sensor is a light detection and ranging sensor. It is an optical remote sensing module that can measure the distance to a target or objects in a scene, by irradiating the target or scene with light, using pulses (or alternatively a modulated signal) from a laser, and measuring the time it takes photons to travel to said target or landscape and return after reflection to a receiver in the lidar module. The reflected pulses (or modulated signals) are detected, with the time of flight and the intensity of the pulses (or modulated signals) being measures of the distance and the reflectivity of the sensed object, respectively.

Conventional lidar sensors utilize mechanically moving parts for scanning laser beams. In some systems, including certain systems used in automotive applications, such as advanced driver assist systems (ADAS) and autonomous driving systems, it is preferred to use solid state sensors for a variety of potential advantages including but not limited to higher sensor reliability, longer sensor lifetime, smaller sensor size, lower sensor weight, and lower sensor cost.

Radio frequency (RF) delay lines used for the creation of radar phased arrays were used several decades ago for the solid state steering of radar signals. Photonic integrated circuit (PIC) based delay lines combined with detectors and RF antenna arrays were used two decades ago to improve the precision of delays in the solid state steering of radar signals. PICs with microscale and nanoscale devices can be used to produce optical phased arrays (OPAs), comprising tunable optical delay lines and optical antennas, for the solid state steering of laser beams.

Phased arrays in the optical domain that are produced to date are complex, costly and/or have a different purpose than beam forming and beam steering; some combine spatial filters, optical amplifiers and ring lasers (U.S. Pat. No. 7,339,727), some involve a plurality of optical input beams (U.S. Pat. No. 7,406,220), some involve volume diffraction gratings and a plurality of input directions (U.S. Pat. No. 7,428,100), some combine beams of a plurality of wavelengths (U.S. Pat. No. 7,436,588), some have optical phase reference sources and gain elements (U.S. Pat. No. 7,489,870), some have predetermined areas in the field of view and a plurality of beam forming elements (U.S. Pat. No. 7,532,311), and some have multiple frequencies and multiple optical phase reference sources (U.S. Pat. No. 7,555,217).

Two-dimensional beam forming and steering phased arrays in the optical domain that are produced to date have low yields and are costly because they steer in two dimensions with a complex two-dimensional pixel array.

SUMMARY OF THE INVENTION

A plurality of one-dimensional (1D) planar beam forming and steering optical phased array (OPA) chips form a two-dimensional (2D) scanning solid-state lidar, enabling manufacturing of three-dimensional (3D) mapping time-of-flight lidars at high yield and low cost resulting from the simplicity of said 1D OPA chips.

DESCRIPTION OF THE DRAWINGS

The following drawings are illustrative of embodiments of the present invention and are not intended to limit the invention as encompassed by the claims forming part of the application.

The schematic diagram of FIG. 1 depicts a plurality of 1D planar beam forming and steering optical phased array chips 10. The double-headed arrow 20 lies in the steering plane within the field of view. A graded-index (GRIN) lens 30 is used with each chip to reduce the spot size in the dimension perpendicular to the steering direction. Alternatively, a geometric refractive lens, a diffractive optical element (DOE), or a holographic optical element (HOE) could be used to achieve said spot size reduction.

The schematic diagram of FIG. 2 depicts a plurality of 1D planar beam forming and steering optical phased array chips 10. The double-headed arrow 20 lies in the steering plane within the field of view. The spot size in the dimension perpendicular to the steering direction is reduced with an on-chip grating 40.

 DETAILED DESCRIPTION OF THE INVENTION

A lidar-based apparatus and method are used for the solid state steering of laser beams using Photonic Integrated Circuits (PICs). Integrated optic design and fabrication micro- and nanotechnologies are used for the production of chip-scale optical splitters that distribute an optical signal from a laser essentially uniformly to an array of pixels, said pixels comprising tunable optical delay lines and optical antennas. Said antennas achieve out-of-plane coupling of light.

As the delay lines of said antenna-containing pixels in said array are tuned, each antenna emits light of a specific phase to form a desired far-field radiation pattern through interference of these emissions. Said array serves the function of solid state optical phased array (OPA).

By incorporating a large number of antennas, high-resolution far-field patterns can be achieved by an OPA, supporting the radiation pattern beam forming and steering needed in solid state lidar, as well as the generation of arbitrary radiation patterns as needed in three-dimensional holography, optical memory, mode matching for optical space-division multiplexing, free space communications, and biomedical sciences. Whereas imaging from an array is conventionally transmitted through the intensity of the pixels, the OPA allows imaging through the control of the optical phase of pixels that receive coherent light waves from a single source.

A plurality of one-dimensional (1D) planar beam forming and steering optical phased array chips are simple building blocks of the transmitter in a solid-state lidar, enabling manufacturing of lidars with high yields and at low cost.

The vertical dimension (i.e., the dimension perpendicular to the steering direction) of the spot size of each said chip is reduced with at least one off-chip lens or at least one on-chip grating.

Types of said off-chip lens include but are not limited to:

    • Refractive lens
    • Graded-index (GRIN) lens
    • Diffractive optical element (DOE)
    • Holographic optical element (HOE)

Each chip containing an OPA PIC is preferably compatible with a complementary metal-oxide-semiconductor (CMOS) process.

The optical power coupled into the plurality of chips can originate from a single laser or from a plurality of lasers.

Claims

1. A method, comprising:

forming an emitter array of one-dimensional planar beam forming and steering optical phased array photonic integrated circuit chips in a first vertical dimension, each photonic integrated circuit chip emitting optical phase controlled unmodulated pulses of coherent light waves that interfere with each other to form an optical beam pointed in a plurality of directions in a second dimension perpendicular to the first vertical dimension; and
collecting at a receiver array reflected pulses indicative of the distance and the reflectivity of a sensed object, the distance of the sensed object establishing a third dimension.

2. The method of claim 1 further comprising utilizing at least one off-chip lens.

3. The method of claim 2 wherein the off-chip lens is selected from a refractive lens, a graded index lens, a diffractive optical element and a holographic optical element.

4. The method of claim 1 further comprising utilizing at least one on-chip grating.

5. The method of claim 1 wherein the unmodulated pulses of coherent light waves are generated from a single laser.

6. The method of claim 1 wherein the unmodulated pulses of coherent light waves are generated by a plurality of lasers, with the optical input into each photonic integrated circuit chip being generated from one of the plurality of lasers.

Referenced Cited
U.S. Patent Documents
3064252 November 1962 Varela
3636250 January 1972 Haeff
3781111 December 1973 Fletcher et al.
3781552 December 1973 Kadrmas
3897150 July 1975 Bridges et al.
4179216 December 18, 1979 Theurer et al.
4477184 October 16, 1984 Endo
4952911 August 28, 1990 D'Ambrosia et al.
5132843 July 21, 1992 Aoyama et al.
5210586 May 11, 1993 Grage et al.
5455669 October 3, 1995 Wetteborn
5543805 August 6, 1996 Thaniyavarn
5552893 September 3, 1996 Akasu
5682229 October 28, 1997 Wangler
5691687 November 25, 1997 Kumagai et al.
5877688 March 2, 1999 Morinaka et al.
5898483 April 27, 1999 Flowers
5898491 April 27, 1999 Ishiguro et al.
6765663 July 20, 2004 Byren et al.
6891987 May 10, 2005 Ionov et al.
7030968 April 18, 2006 D'Aligny et al.
7190465 March 13, 2007 Froehlich et al.
7281891 October 16, 2007 Smith et al.
7339727 March 4, 2008 Rothenberg et al.
7406220 July 29, 2008 Christensen et al.
7428100 September 23, 2008 Smith et al.
7436588 October 14, 2008 Rothenberg et al.
7489870 February 10, 2009 Hillis et al.
7532311 May 12, 2009 Henderson et al.
7555217 June 30, 2009 Hillis et al.
7746449 June 29, 2010 Ray et al.
7969558 June 28, 2011 Hall
8125367 February 28, 2012 Ludwig
8203115 June 19, 2012 Hochberg et al.
8311374 November 13, 2012 Hochberg et al.
8731247 May 20, 2014 Pollock
8836922 September 16, 2014 Pennecot et al.
8988754 March 24, 2015 Sun et al.
9014903 April 21, 2015 Zhu et al.
9069080 June 30, 2015 Stettner et al.
9104086 August 11, 2015 Davids et al.
9383753 July 5, 2016 Templeton et al.
9753351 September 5, 2017 Eldada
20050033497 February 10, 2005 Stopczynski
20060091303 May 4, 2006 Evans
20060091305 May 4, 2006 Grunnet-Jepsen et al.
20060197936 September 7, 2006 Libeman et al.
20060239688 October 26, 2006 Hillis
20070052947 March 8, 2007 Ludwig et al.
20070181810 August 9, 2007 Tan et al.
20080002176 January 3, 2008 Krasutsky
20080094607 April 24, 2008 Bernard et al.
20080186470 August 7, 2008 Hipp
20080204699 August 28, 2008 Benz et al.
20080227292 September 18, 2008 Miki
20090059201 March 5, 2009 Willner et al.
20090251680 October 8, 2009 Farsaie
20090278030 November 12, 2009 Deliwala
20100045964 February 25, 2010 Jin et al.
20100187402 July 29, 2010 Hochberg et al.
20100187442 July 29, 2010 Hochberg et al.
20100253585 October 7, 2010 Llorens del Rio et al.
20100271614 October 28, 2010 Albuquerque et al.
20100290029 November 18, 2010 Hata
20110216304 September 8, 2011 Hall
20110222814 September 15, 2011 Krill et al.
20110255070 October 20, 2011 Phillips et al.
20110316978 December 29, 2011 Dillon et al.
20120013962 January 19, 2012 Subbaraman et al.
20120226118 September 6, 2012 Delbeke et al.
20120286136 November 15, 2012 Krill et al.
20130027715 January 31, 2013 Imaki et al.
20130044309 February 21, 2013 Dakin et al.
20130114924 May 9, 2013 Loh et al.
20130127980 May 23, 2013 Haddick et al.
20130208256 August 15, 2013 Mamidipudi et al.
20130242400 September 19, 2013 Chen
20130301976 November 14, 2013 Saida et al.
20140152871 June 5, 2014 Campbell et al.
20140211194 July 31, 2014 Pacala et al.
20140240691 August 28, 2014 Mheen
20140376001 December 25, 2014 Swanson
20150192677 July 9, 2015 Yu et al.
20150293224 October 15, 2015 Eldada et al.
20150346340 December 3, 2015 Yaacobi et al.
20150378241 December 31, 2015 Eldada
20160047901 February 18, 2016 Pacala et al.
20160049765 February 18, 2016 Eldada
20160161600 June 9, 2016 Eldada et al.
Foreign Patent Documents
H-3-6407 January 1991 JP
2006-177843 July 2006 JP
Other references
  • Aull, B.F. et al. (2002). “Geiger-mode avanlanche photodiodes for three-dimensional imaging,” Lincoln Labora. J. 13:335-350.
  • Avalanche Photodiode (2011). User Guide. Excelitas Technologies. 8 total pages.
  • American National Standard for Safe Use of Lasers (2000). ANSI. ANSI Z136.1—2000.
  • The American Heritage Dictionary (1996). Third edition. Houghton Mifflin Company. pp. 1497, 1570, 1697, 1762 and 1804.
  • Besl, P.J. (1988). “Active, optical range imaging sensors,” Mach. Vision Applic. 1:127-152.
  • Bordone, A. et al. (2003). “Development of a high resolution laser radar for 3D imaging in artwork cataloguing,” SPIE 5131:244-248.
  • Code of Federal Regulations (2005). Parts 800 to 1299. 21 C.F.R. Section 1040.10, 23 total pages.
  • Doylend et al. (2012). “Hybrid III/V silicon photonic source with integrated 1D free-space beam steering,” Optics Letters 37:4257-4259.
  • Extended European Search Report dated Jan. 26, 2018, for EP Application No. 15 830 163.0, filed on Jun. 23, 2015, 10 pages.
  • Extended European Search Report dated Mar. 12, 2018, for EP Application No. 15 832 162.0, filed on Aug. 6, 2015, 10 pages.
  • File History for U.S. Pat. No. 7,969,558, issued on Jun. 28, 2011, 274 total pages.
  • Guo et al., (2013). “Two-Dimensional optical Beam Steering with InP-Based Photonic Integrated Circuits”, IEEE Journal of Selected Topics in Quantum Electronics 19:6100212, 12 total pages.
  • Gustavson, R.L. (1992). “Diode-laser radar for low-cost weapon guidance,” Laser Radar VII 1633:21-32.
  • Jelalian, A.V. (1992). “Laser radar systems,” 3 total pages.
  • Jie, S. et al. (2013). “Large-scale silicon photonic circuits for optical phased arrays,” IEEE J. Selected Topics in Quantum Electronics 20:1-15.
  • Kamerman, G.W. (1993). Chapter 1: Laser radar. vol. 6. The infrared and electro-optical systems handbook. 4 total pages.
  • Kamerman, G.W. (1993). Chapter 1: Laser radar. vol. 6. The infrared and electro-optical systems handbook. 80 total pages.
  • Kawata, H. et al. (2005). “Development of ultra-small lightweight optical range sensor system,” 7 total pages.
  • Kawata, H. et al. (2005). “Development of ultra-small lightweight optical range sensor system,” 63 total pages.
  • Kilpela, A. et al. (2001). “Precise pulsed time-of-flight laser range finder for industrial distance measurements,” Rev. Scientific Instruments 72:2197-2202.
  • LaserFocusWorld (1995). “How to select avalanche photodiodes,” 9 total pages.
  • Manandhar, D. et al. (2002). “Auto-extraction of urban features from vehicle-borne laser data,” 6 total pages.
  • Richmond, R.D. et al. (2005). “Polarimetric imaging laser radar (PILAR) program,” Adv. Sens. Payloads for UAV 35 total pages.
  • Saleh, B.E.A. et al. (1991). Fundamentals of Photonics. John Wiley & Sons, Inc. 162 total pages.
  • Skolnik, M.I. (1980). “Introduction to radar systems,” Second edition. McGraw-Hill Book Company. p. 7.
  • Skolnik, M.I. (1990). “Radar handbook,” Second edition. McGraw-Hill Publishing Company. 1191 total pages.
  • Ullrich, A. et al. (1999). “High-performance 3D-imaging laser sensor,” SPIE 3707:658-664.
  • Westinghouse (date unknown). AN/TPS-43E Tactical radar system, 14 total pages.
  • Guo et al., “InP Photonic Integrated Circuit for 2D Optical Beam Steering”, Photonics Conference, Oct. 9-13, 2011, Arlington, VA, IEEE, 2011, 3 pgs.
  • Guo et al., “Two-Dimensional optical Beam Steering with InP-Based Photonic Integrated Circuits”, IEEE Journal of Selected Topics in Quantum Electronics, vol. 19, No. 4, Aug. 2013, pp. 1, 6, 8, 11.
  • Hulme et al., “Fully Integrated Hybrid Silicon Free-Space Beam Steering Source with 32 Channel Phased Array”, SPIE, Mar. 26, 2014, pp. 898907-2, 898907-13.
  • Intellectual Property Office of Singapore, Written Opinion issued to SG application No. 11201610963X, dated Oct. 5, 2017, 5 pgs.
  • Taillaert et al., “An Out-Of-Plane Grating Coupler for Efficient Butt-Coupling Between Compact Planar Waveguides and Single-Mode Fibers”, IEEE Journal of Quantum Electronics, vol. 38, No. 7, Jul. 2002, pp. 951-953.
  • International Search Report and Written Opinion issued to International Patent Application No. PCT/US15/44069, dated Nov. 12, 2015, 9 pgs.
  • Van Acoleyen, Karel, “Nanophotonic Beamsteering Elements Using Silicon Technology for Wireless Optical Applications”, Ghent University, Dept. of Information Technology, Aug. 27, 2012, 180 pgs.
  • Van Acoleyen, Karel, “Off-Chip Beam Steering with a One-Dimensional Optical Phased Array on Silicon-On-Insulator”, Optics Letters, vol. 34, No. 9, May 1, 2009, pp. 1477-1479.
  • International Search Report and Written Opinion issued to international patent application No. PCT/US15/56516, dated Feb. 4, 2016, 7 pgs.
Patent History
Patent number: 10180493
Type: Grant
Filed: Dec 26, 2017
Date of Patent: Jan 15, 2019
Patent Publication Number: 20180136317
Assignee: Quanergy Systems, Inc. (Sunnyvale, CA)
Inventor: Louay Eldada (Sunnyvale, CA)
Primary Examiner: Luke D Ratcliffe
Application Number: 15/854,614
Classifications
Current U.S. Class: Including Specific Optical Interface (398/116)
International Classification: G01S 7/48 (20060101); G01S 7/481 (20060101); G01S 17/89 (20060101); G01S 17/10 (20060101); G01S 17/42 (20060101); H01S 5/00 (20060101);