Burst-mode time-of-flight imaging
An imager includes an emitter, an array of pixel elements, and driver logic. The emitter releases bursts of light pulses with pauses between bursts. Each element of the array has a finger gate biasable to attract charge to the surface, a reading node to collect the charge, and a transfer gate to admit such charge to the reading node and to deter such charge from being absorbed into the finger gate. The driver logic biases the finger gates with the modulated light pulses such that the finger gates of adjacent first and second elements cycle with unequal phase into and out of a charge-attracting state. To reduce the effects of ambient light on the imager, the driver logic is configured to bias the transfer gates so that the charge is admitted to the reading node only during the bursts and is prevented from reaching the reading node during the pauses.
Latest Microsoft Patents:
In time-of-flight (TOF) depth imaging, a subject is irradiated by pulsed or modulated light from an emitter. Some of this light reflects back from the subject to an imaging photodetector. The pixel elements of the photodetector are addressed in groups, in synchronicity with the pulsed output of the emitter. In some variants, the integration periods for each group of pixel elements differ by a predetermined amount. Accordingly, a pixel-resolved time of flight of the pulses, from their origin at the emitter, out to the subject, and back to the photodetector, is discernible based on the relative amounts of light received in corresponding elements of the different groups. From the time of flight computed for a given pixel, the depth of the locus of the subject imaged by that pixel—i.e., the distance away from the photodetector—can be computed.
In the approach summarized above, the signal-to-noise ratio for depth measurement is reduced in the presence of broadband ambient light. In principle, the signal-to-noise ratio can be improved by increasing the output power of the emitter, such that the reflected light from the emitter overwhelms the ambient light. However, increasing emitter power may also increase the size, complexity, and cost of the imaging system.
SUMMARYOne embodiment of this disclosure provides a TOF depth imager comprising an emitter, an array of pixel elements, and driver logic. The emitter is configured to release repeating bursts of modulated light pulses with a pause between consecutive bursts. Formed on a semiconductor surface, each element of the array has a finger gate biasable to attract photogenerated charge to the surface, a reading node to collect charge attracted to the surface, and a transfer gate biasable to admit such charge to the reading node and to deter such charge from being absorbed into the finger gate. The driver logic is configured to bias the finger gates of the elements of the array in synchronicity with the modulated light pulses from the emitter such that the finger gates of adjacent first and second elements cycle with unequal (e.g., complementary) phase into and out of a charge-attracting state. The driver logic is further configured to bias the transfer gates so that the charge is admitted to the reading node only during the bursts and is prevented from reaching the reading node during the pauses.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
Aspects of this disclosure will now be described by example and with reference to the illustrated embodiments listed above. Components that may be substantially the same in one or more embodiments are identified coordinately and are described with little repetition. It will be noted, however, that elements identified coordinately may also differ to some degree. It will be further noted that the drawing figures included in this disclosure are schematic and generally not drawn to scale. Rather, the various drawing scales, aspect ratios, and numbers of components shown in the figures may be purposely distorted to make certain features or relationships easier to see.
To provide some measure of ambient-light rejection, photodetector array 116 may be arranged behind an optical band-pass filter (not shown in the drawings). Accordingly, the photodetector array may be substantially insensitive to light outside the narrow passband of the filter. Preferably, the passband is chosen to match the emission wavelength band of emitter 112. In one embodiment, the emitter may be a narrow-band infrared (IR) emitter such as an IR laser or IR light-emitting diode (LED). Irradiance and photodetection in the IR provides an additional advantage in that a human subject will not detect the irradiance from the emitter.
With respect to the pulsed output of emitter 112, this disclosure embraces a broad range of output power and modulation pulse width. In one non-limiting embodiment, the pulse width may be one half of the reciprocal of the modulation frequency. Along with the output power, the modulation frequency appropriate for a given depth-sensing application depends on the distance between subject 114 and depth imager 110. For distances on the order of three meters, each modulation cycle of the emitter may be 20 nanoseconds (ns); the ON pulse width within that modulation cycle may be about 10 ns, for a 50% duty cycle. It will be noted, however, that other ranges and modulation frequencies are fully consistent with the spirit and scope of this disclosure.
Even when the photodetector response is limited to a narrow wavelength band, the signal-to-noise ratio for depth imaging is reduced in the presence of broadband ambient-light, especially sunlight. One way to reduce the effect of ambient light on the signal-to-noise ratio is to reduce by a given factor the integration time of the photodetector array while increasing the output power of emitter 112 by the same factor. In this approach, the amount of signal light integrated at the array is unchanged, but the amount of ambient light is reduced by the given factor. One way to coerce higher output power from a laser or LED emitter is to operate the emitter in burst mode. In burst mode, the emitter is configured to release repeating bursts of modulated light pulses with a pause between consecutive bursts. In some embodiments, the repeating bursts may be periodic, as described below. Meanwhile, the photodetector is gated to integrate only during the bursts, not during the pauses.
Burst-mode operation is illustrated by example with reference to
The approaches described herein are well-suited to phase-based techniques, which may include harmonic cancellation. As such, measurement accuracy may be driven by the modulation frequency and relatively immune to changes in the modulation waveform shape, due to temperature and waveform drift. This is a significant advantage over related pulse-based methods, where such shifts in waveform shape may be compensated, if possible, by calibration.
Continuing in
No aspect of the drawings or description herein should be understood in a limiting sense, for numerous other embodiments are envisaged as well. Although pixel 418 of
In the embodiment of
In the embodiment of
In the embodiment of
It will be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
Claims
1. A time-of-flight depth imager comprising:
- an emitter configured to release repeating bursts of modulated light pulses with a pause between consecutive bursts;
- an array of pixel elements formed on a semiconductor surface, each element having a finger gate biasable to attract photogenerated charge to the surface, a reading node to collect the photogenerated charge attracted to the surface, and a transfer gate biasable to admit such charge to the reading node and to deter such charge from being absorbed into the finger gate;
- logic to bias the finger gates of the pixel elements of the array, in synchronicity, during the bursts, with the modulated light pulses from the emitter, and to apply negative bias to the finger gates during the pauses, the finger gates of adjacent first and second pixel elements cycling with unequal phase into and out of a charge-attracting, positive state; and
- logic to bias the transfer gates of the pixel elements of the array so that the photogenerated charge is admitted to the reading node only during the bursts and is prevented from reaching the reading node during the pauses.
2. The depth imager of claim 1 wherein the logic to bias the transfer gates is configured to apply negative bias to the transfer gates during the pauses and positive bias to the transfer gates during the bursts.
3. The depth imager of claim 1 further comprising a drain node isolated from the reading node and maintained at positive bias to collect the photogenerated charge during the pauses.
4. The depth imager of claim 1 wherein the photogenerated charge is collected at the reading node of each pixel element of the array to effect a quantum-efficiency based time-of-flight measurement.
5. The depth imager of claim 1 wherein the emitter is an infrared or near-infrared emitter of narrow emission bandwidth.
6. The depth imager of claim 1 wherein the emitter is a laser.
7. The depth imager of claim 1 wherein each burst lasts 0.5 to 50 microseconds, and wherein each pause lasts 2 to 500 microseconds.
8. A time-of-flight depth imager comprising:
- an emitter configured to release repeating bursts of modulated light pulses with a pause between consecutive bursts;
- an array of pixel elements formed on a semiconductor surface, each pixel element having a finger gate biasable to attract photogenerated charge to the surface, a reading node to collect the photogenerated charge attracted to the surface, a transfer gate biasable to admit such charge to the reading node and to deter such charge from being absorbed into the finger gate, a drain node to drain such charge from the substrate during the pauses, and a drain gate biasable to steer such charge toward the drain node;
- logic to bias the finger gates of the pixel elements of the array, in synchronicity, during the bursts, with the modulated light pulses from the emitter, and to apply negative bias to the finger gates during the pauses, the finger gates of adjacent first and second pixel elements cycling with unequal phase into and out of a charge-attracting, positive state;
- logic to bias the transfer gates of the pixel elements of the array so that the photogenerated charge is admitted to the reading node only during the bursts and is prevented from reaching the reading node during the pauses; and
- logic to bias the drain gates of the pixel elements of the array so that the photogenerated charge is steered toward the drain node only during the pauses and is prevented from reaching the drain node during the bursts.
9. The depth imager of claim 8 wherein the transfer gate and the drain gate of each pixel element are adjacent each other at one end of the finger gate of that element.
10. The depth imager of claim 8 wherein the transfer gate of each pixel element is arranged at one end of the finger gate, and wherein the drain gate is adjacent the transfer gate on a side of the transfer gate opposite the finger gate.
11. The depth imager of claim 8 wherein the logic to bias the transfer gates is configured to apply ground or negative bias to the transfer gates during the pauses and positive bias during the bursts.
12. The depth imager of claim 8 wherein the logic to bias the drain gates is configured to apply ground or negative bias to the drain gates during the bursts and positive bias during the pauses.
13. The depth imager of claim 12 wherein the drain gate of each pixel element is adjacent the finger gate and the transfer gate of that element, wherein the drain gate extends parallel to the finger gate from a position adjacent an interior portion of the finger gate to a position adjacent the transfer gate.
14. A time-of-flight depth imager comprising:
- an emitter configured to release repeating bursts of modulated light pulses with a pause between consecutive bursts;
- an array of pixel elements formed on a semiconductor surface, each pixel element having a finger gate biasable to attract photogenerated charge to the surface, a reading node to collect the photogenerated charge attracted to the surface, a transfer gate at one end of the finger gate biasable to admit such charge to the reading node and to deter such charge from being absorbed into the finger gate, a drain node to drain such charge from the substrate during the pauses, and a drain gate biasable to draw such charge away from the finger gate and toward the drain node;
- logic to bias the finger gates of the pixel elements of the array in synchronicity with the modulated light pulses from the emitter, the finger gates of adjacent first and second pixel elements cycling with unequal phase into and out of a charge-attracting state;
- logic to bias the transfer gates of the pixel elements of the array so that the photogenerated charge is admitted to the reading node only during the bursts and is prevented from reaching the reading node during the pauses; logic to bias the drain gates of the pixel elements of the array so that the photogenerated charge is drawn toward the drain node only during the pauses and is prevented from reaching the drain node during the bursts; and
- logic to bias the drain nodes, such logic configured to impart a high impedance to a path from a given finger gate to an associated drain node during the bursts, and a lower impedance to the path from the finger gate to the associated drain node during the pauses.
15. The depth imager of claim 14 wherein the drain gate of each pixel element is arranged adjacent an interior portion of the finger gate of that element.
16. The depth imager of claim 14 wherein the drain gate of each pixel element is adjacent the finger gate of that element, wherein the drain gate extends perpendicular to the finger gate from a position adjacent the end of the finger gate.
17. The depth imager of claim 14 wherein the drain gate is U-shaped, with one arm adjacent an interior portion of the finger gate of that element, and another arm adjacent the transfer gate so as to draw charge away from the transfer gate when the drain gate is under positive bias.
18. The depth imager of claim 14 wherein the logic to bias the transfer gates is configured to apply positive bias to the transfer gates during the bursts and ground bias during the pauses, and wherein the logic to bias the drain gates is configured to apply positive bias to the drain gates during the pauses and ground bias during the bursts.
6515740 | February 4, 2003 | Bamji et al. |
7439509 | October 21, 2008 | Grazioso et al. |
7688944 | March 30, 2010 | Ritman |
7994465 | August 9, 2011 | Bamji et al. |
20020084430 | July 4, 2002 | Bamji et al. |
20030223053 | December 4, 2003 | Liu et al. |
20070158770 | July 12, 2007 | Kawahito |
20100020306 | January 28, 2010 | Hall |
20110019049 | January 27, 2011 | Jin et al. |
20110205522 | August 25, 2011 | Snow et al. |
20120008128 | January 12, 2012 | Bamji |
20120173184 | July 5, 2012 | Ovsiannikov et al. |
20120175685 | July 12, 2012 | Kim et al. |
20120188530 | July 26, 2012 | Bamji et al. |
20120249740 | October 4, 2012 | Lee et al. |
102057295 | May 2011 | CN |
- Tomonari Sawada et al “TOF range image sensor using a range-shift technique” 2008 IEEE Sensors, Lecce, Italy, IEEE, Piscataway, NJ, USA, Oct. 26, 2008, pp. 1390-1393, XP031375344, ISBN: 978-1-4244-2580-8.
- IPEA European Patent Office, Written Opinion Issued in PCT Application No. PCT/US2014/032296, Feb. 18, 2015, WIPO, 6 Pages.
- IPEA European Patent Office, International Preliminary Report on Patentability Issued in PCT Application No. PCT/US2014/032296, Jun. 23, 2015, WIPO, 6 Pages.
- Conroy, et al., “A Power-Saving Modulation Technique for Time-of-Flight Range Imaging Sensors”, Retrieved at <<http://researchcommons.waikato.ac.nz/bitstream/handle/10289/5426/Conroy%202011%20A%20Power-Saving%20Modulation.pdf?sequence=1>>, In Videometrics, Range Imaging, and Applications XI, Jun. 9, 2011, p. 13.
- Niclass, et al., “A CMOS 3D Camera with Millimetric Depth Resolution”, Retrieved at <<http://aqua.epfl.ch/files/content/sites/aqua/files/groups/AQUA/public/Research/CMOS3D/CICC04.pdf>>, In IEEE Conference Custom Integrated Circuits, Oct. 3, 2004, pp. 4.
- ISA European Patent Office, International Search Report & Written Opinion for PCT Patent Application No. PCT/US2014/032296, Jul. 28, 2014, WIPO, 11 Pages.
- Sawada et al., “TOF Range Image Sensor Using A Range-Shift Technique”, In IEEE Sensors, Oct. 26, 2008, pp. 1390-1393.
- The State Intellectual Property Office of China, First Office Action and Search Report Issued in Chinese Patent Application No. 201480020206.9, Sep. 9, 2016, China, 15 pages.
Type: Grant
Filed: Apr 5, 2013
Date of Patent: Nov 15, 2016
Patent Publication Number: 20140300700
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC (Redmond, WA)
Inventors: Cyrus Bamji (Fremont, CA), Tamer Elkhatib (San Jose, CA), Swati Mehta (Palo Alto, CA), Zhanping Xu (Sunnyvale, CA)
Primary Examiner: Luke Ratcliffe
Application Number: 13/857,946
International Classification: H04N 13/02 (20060101); G01S 17/36 (20060101); G01S 17/89 (20060101); G01S 7/486 (20060101); H01L 27/146 (20060101);