Distance detection method and system
There is provided a system and method for detecting a distance to an object. The method comprises providing a lighting system having at least one pulse width modulated visible-light source for illumination of a field of view; emitting an illumination signal for illuminating the field of view for a duration of time y using the visible-light source at a time t; integrating a reflection energy for a first time period from a time t−x to a time t+x; determining a first integration value for the first time period; integrating the reflection energy for a second time period from a time t+y−x to a time t+y+x; determining a second integration value for the second time period; calculating a difference value between the first integration value and the second integration value; determining a propagation delay value proportional to the difference value; determining the distance to the object from the propagation delay value.
Latest LeddarTech Inc. Patents:
- Beam-steering device particularly for LIDAR systems
- Component for a LIDAR sensor system, LIDAR sensor system, LIDAR sensor device, method for a LIDAR sensor system and method for a LIDAR sensor device
- LIDAR SYSTEM WITH COARSE ANGLE CONTROL
- Beam-steering device particularly for LIDAR systems
- Systems and methods for wide-angle LiDAR using non-uniform magnification optics
This application is a reissue continuation application of and claims priority to U.S. application Ser. No. 14/984,704, filed on Dec. 30, 2015, issued as U.S. Pat. No. RE46,930. U.S. application Ser. No. 14/984,704, issued as U.S. Pat. No. RE46,930, is a reissue application based on U.S. application Ser. No. 13/632,191, filed on Oct. 1, 2012, which previously issued as U.S. Pat. No. 8,619,241. U.S. application Ser. No. 13/632,191 is a divisional of U.S. application Ser. No. 12/809,235, filed Jun. 18, 2010, now U.S. Pat. No. 8,310,655, which is the U.S. national phase of International Application No. PCT/CA2008/002268, which claims priority to U.S. Provisional Application Ser. No. 61/015,738, filed Dec. 21, 2007, U.S. Provisional Application Ser. No. 61/015,867, filed Dec. 21, 2007, and U.S. Provisional Application Ser. No. 61/042,424, filed Apr. 4, 2008.
TECHNICAL FIELDThe invention relates to methods and systems for improving the measurement of light transit time reflected by different types of objects in detection and ranging methods and systems.
BACKGROUND OF THE ARTSeveral methods are used to measure the distance between an apparatus and an object. Optical range-finding systems frequently rely on the time-of-flight principle and determine the distance between the apparatus and the object by measuring the time a short pulse of light emitted from the apparatus takes to reach an object and be reflected to a photo-detection circuit. Conventional optical rangefinders use a counter initiated at the starting pulse and then stopped when the receiver circuit detects the pulse echo of a value higher than a specific threshold. This threshold can be set low to provide sensitivity but the system will generate false alarms from transient noise. It can be set high to avoid false alarms but the system will not detect objects that return weak signal reflection. In bad weather conditions, such as rain or snow, several pulse echoes can be generated. Some techniques help to detect a certain number of echoes and may be used the reject some reflections but they have their limitations.
Some optical rangefinders use other methods to be more robust against false alarms. One method is based on the use of an analog-to-digital converter (ADC) for the digitalization of the waveform of the echoed back signal. Once digitalized, the waveform can be processed by digital signal processing circuits to improve the performance of the system.
Several techniques are already known for improving the performance of an optical rangefinder using an ADC. Averaging is an efficient way to improve the signal to noise ratio (SNR). However, averaging has an impact on response time and may render the system too slow for some applications.
The resolution of distance measurement can be enhanced by using a clock pulsed delay circuit technique. Using an integer (N) division of the clock pulse signal with a delay circuit and by rearranging each echo light pulse sample data, this technique improves the resolution by a factor N. However, this technique has an impact on the number of averages if the averaging technique is also used to improve the SNR.
Digital correlation is another digital processing technique for increasing the resolution of the range measurement. By correlating the echo pulse signal with a pre-stored waveform, the distance to the object can be estimated by using the peak value of the result of the correlation function.
Several digital processing techniques have been elaborated to improve the performance of rangefinders but none consider that the need, in terms of resolution and signal to noise improvement, is not constant as a function of the range for most of range-finding applications.
SUMMARYIt is therefore an aim of the present invention to address at least one of the above mentioned difficulties
The present system improves the detection of the presence and the measure of the distance of objects, while optimizing the performance (resolution, repetition rate, etc) by adapting a range-dependant processing as a function of the need of different applications.
The present system can be adapted for use with a lighting system for lighting purposes as well as for the detection and ranging purposes.
The present system also improves the detection of rain, snow, fog, smoke and can provide information about current weather conditions.
According to a broad aspect of the present invention, there is provided a method for detecting a distance to an object. The method comprises providing a lighting system having at least one pulse width modulated visible-light source for illumination of a field of view; emitting an illumination signal for illuminating the field of view for a duration of time y using the visible-light source at a time t; integrating a reflection energy for a first time period from a time t−x to a time t+x; determining a first integration value for the first time period; integrating the reflection energy for a second time period from a time t+y−x to a time t+y+x; determining a second integration value for the second time period; calculating a difference value between the first integration value and the second integration value; determining a propagation delay value proportional to the difference value; determining the distance to the object from the propagation delay value.
Having thus generally described the nature of the invention, reference will now be made to the accompanying drawings, showing by way of illustration a preferred embodiment thereof and in which:
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTIONThe visible-light source 112 is connected to a source controller 114, so as to be driven into producing visible light. In addition to emitting light, the system 100 performs detection of objects and particles (vehicles, passengers, pedestrians, airborne particles, gases and liquids) when these objects are part of the environment/scene illuminated by the light source 112. Accordingly, the source controller 114 drives the visible-light source 112 in a predetermined mode, such that the emitted light takes the form of a light signal, for instance by way of amplitude-modulated or pulsed light emission.
These light signals are such that they can be used to provide the lighting illumination level required by the application, through data/signal processor 118 and source controller 114, while producing a detectable signal. Accordingly, it is possible to obtain a light level equivalent to a continuous light source by modulating the light signal fast enough (e.g., frequency more than 100 Hz) to be generally imperceptible to the human eye and having an average light power equivalent to a continuous light source.
In an embodiment, the source controller 114 is designed to provide an illumination drive signal, such as a constant DC signal or a pulse-width modulated (PWM) signal, that is normally used in lighting systems to produce the required illumination and control its intensity. The illumination drive signal is produced by the illumination driver sub-module 114A of the controller 114.
A modulated/pulsed driving signal supplies the fast modulation/pulse sequence required for remote object detection. This modulated/pulsed drive signal is produced by a modulation driver sub-module 114B of the controller 114. The amplitude of short-pulse (typ. <50 ns) can be several time the nominal value while the duty cycle is low (typ. <0.1%).
The modulator driver 114B can also be used to send data for optical communication. Both driving signals can be produced independently or in combination. Sequencing of the drive signals is controlled by the data/signal processor 118. The light source 112 can be monitored by the optical detector 116 and the resulting parameters sent to the data/signal processor 118 for optimization of data processing.
An alternative for sourcing the light signal for detection involves an auxiliary light source (ALS) 122, which can be a visible or non-visible source (e.g., UV or IR light, LEDs or laser) using the modulation driver 14B 114B. The auxiliary light source 122 provides additional capabilities for detecting objects and particles. UV light source (particularly around 250 nm) can be used to limit the impact of the sunlight when used with a UV detector. IR light can be used to increase the performance and the range of the detection area. IR lights and other types of light can be used to detect several types of particles by selecting specific wavelengths. The auxiliary light source 122 can also be useful during the installation of the system by using it as a pointer and distance meter reference. It can also be used to determine the condition of the lens.
The visible-light source 112 is preferably made up of LEDs. More specifically, LEDs are well suited to be used in the lighting system 100 since LED intensity can be efficiently modulated/pulsed at suitable speed. Using this feature, current lighting systems already installed and featuring LEDs for standard lighting applications can be used as the light source 112 for detection applications, such as presence detection for energy savings, distance and speed measurements, fog, rain, snow or smoke detection and spectroscopic measurements for gas emission or smog detection.
The system 100 has at least one lens 130 through which light is emitted in an appropriate way for specific applications. At least one input lens section 130a of at least one lens 130 is used for receiving the light signal, for instance reflected or diffused (i.e., backscattered) by the objects/particles 134. This input lens section 130a can be at a single location or distributed (multiple zone elements) over the lens 130 and have at least one field of view. Several types of lens 130 can be used, such as Fresnel lenses for example. A sub-section of the lens 130 can be used for infrared wavelength. A sub-section of the lens 130 can be used for optical data reception.
A detector 116 is associated with the visible-light source 112 and/or auxiliary light source 122 and the lens 130. The detector module 116 is an optical detector (or detectors) provided so as to collect light emitted by the light source 112/ALS 122 and back-scattered (reflected) by the objects/particles 134. Detector module 116 can also monitor the visible-light source 112 or auxiliary light source 122. The light signal can also come from an object 134 being the direct source of this light (such as a remote control) in order to send information to the data/signal processor through the optical detector module 116. The optical detector module 116 is, for example, composed of photodiodes, avalanche photodiodes (APD), photomultipliers (PMT), complementary metal-oxide semiconductor (CMOS) or charge-coupled device (CCD) array sensors.
Filters are typically provided with the detector module 116 to control background ambient light emitted from sources other than the lighting system 100. Filters can also be used for spectroscopic measurements and to enhance performance of the light source 112.
A front-end and analog-to-digital converter (ADC) 124 is connected to detector 116 and receives detected light data therefrom and controls the detector 116. For instance, adjusting the Vbias of an APD detector can be one of the detector controls to optimize the gain of the receiver section for an Automatic Gain Control (AGC). Analog filters can be used for discriminating specific frequencies or to measure the DC level.
A detection and ranging digital processing unit 126 is connected to the front-end 124, and controls parameters such as gain of amplifier, synchronization and sample rate of the ADC. The detection and ranging digital processing unit 126 receives data from ADC and pre-processes the data.
The data/signal processor 118 is connected to the detection and ranging processing module 126 and receives pre-processed data. The data/signal processor 118 is also connected to the source controller 114, so as to receive driving data therefrom. The data/signal processor 118 has a processing unit (e.g., CPU) so as to interpret the pre-processed data from the detection module 126, in comparison with the driving data of the source controller 114, which provides information about the predetermined mode of emission of the light signals emitted by the visible-light source 112.
Accordingly, information about the object (e.g., presence, distance, speed of displacement, composition, dimension, etc.) is calculated by the data/signal processor 118 as a function of the relationship (e.g., phase difference, relative intensity, spectral content, time of flight, etc.) between the driving data and the detected light data, is optionally pre-processed by the front-end and ADC 24 124 and the detection and ranging processing unit 126. A database 120 may be provided in association with the data/signal processor 118 so as to provide historical data or tabulated data to accelerate the calculation of the object parameters.
In view of the calculation it performs, the data/signal processor 118 controls the source controller 114 and thus the light output of the visible-light source 112. For instance, the visible-light source 112 may be required to increase or reduce its intensity, or change the parameters of its output. For example, changes in its output power can adapt the lighting level required in daytime conditions versus nighttime conditions or in bad visibility conditions such as fog, snow or rain.
The system 100 can be provided with sensors 132 connected to the data/signal processor 118. Sensors 132 can be an inclinometer, accelerometer, temperature sensor, day/night sensors, etc. Sensors 132 can be useful during the installation of the system and during operation of the system. For example, data from an inclinometer and accelerometer can be used to compensate for the impact on the field of view of an effect of the wind or any kind of vibration. Temperature sensors are useful to provide information about weather (internal, external or remote temperature with FIR lens). Information from sensors 132 and data/signal processor 118 and light from light source 112 and auxiliary light source 122 can be used during installation, in particular for adjusting the field of view of the optical receiver. The auxiliary light source 112 122 can be used as a pointer and distance meter.
The system 100 has a power supply and interface 128. The interface section is connected to a Data/signal processor and communicates to an external traffic management system 140 (via wireless, power line, Ethernet, CAN bus, USB, etc.).
Segmentation of the Digital Processing as a Function of the Range
Several range finding applications need different performances as a function of the range. For automotive applications, such as Adaptive Cruise Control (ACC), it could be useful to detect a vehicle more than 100 meters ahead but the needs in terms of accuracy and repetition rate are not the same as for short range applications such as pre-crash mitigation. Basically, for a short range application, the reflected signal is strong but, usually, the needs for a good resolution and fast refresh rate of the data are high. For a long range application, the opposite is true, the reflected signal is weak and noisy but the need for resolution and refresh rate is less demanding.
Phase shifting control techniques can improve accuracy using a digital acquisition system with low sample rate. For instance, a relatively low cost ADC (ex.: 50 MSPS) can have an improved temporal resolution if successive acquisitions are delayed by an equivalent fraction of the acquisition time period but this technique has an impact on SNR and refresh rate when averaging is used.
To optimize the performance, one can adjust specific parameters as a function of the distance. Using the detection and ranging digital processing unit 126 and the Data/signal Processor 118, allows to control the number of shift delay by period, the number of accumulation and the refresh rate for each data point sampled or for several segments. For shorter distances, with an echo back signal which is relatively strong, the number of shift delays and the refresh rate can be higher to improve the resolution and the response time. The number of accumulation (or other time-integration techniques) would be lower but sufficient at short distances (trade-off between signal-to-noise ratio, resolution and number of results per second).
The accumulation technique improves the signal-to-noise ratio of the detected light signal using multiple measurements. In order to produce one distance measurement, the technique uses M light pulses and for each light pulse, a signal detected by the optical detector is sampled by the ADC with an ADC time resolution of 1/F second thereby generating M lidar traces of j points (S1 to Sj) each. Points of the M lidar traces are added point per point to generate one accumulated digital lidar trace of j points.
The phase shift technique is used to improve the time resolution of the trace acquired by the ADC and limited by its sample rate F Hz. The phase shift technique allows for the use of a low cost ADC having a low sample rate F by virtually increasing the effective sample rate. The effective sample rate is increased by a factor P by acquiring P sets corresponding to P light pulses while shifting the phase between the emitted light pulse and the ADC sampling rate. The phase shifting between each acquisition corresponds to 2π/P. The P sets obtained are then combined in a single trace by interleaving the P sets such that the resulting trace is equivalent to a single measurement with a temporal resolution (1/F×P) second.
By combining the accumulation and the phase shift techniques, an accumulation of M sets is performed for each one of the P phase shifts, for a total of N=M×P acquisition sets. Using the N sets, the detection and ranging digital processing unit 126 and the Data/signal Processor 118 creates one combined trace of the reflected light pulse. Each point in the combined trace is an accumulation of M=N/P sets and the effective time resolution of the combined trace is 1/(F×P) second. To store one complete trace, the length of the buffer is at least j×P elements and the number of bit of each element is a function of the resolution of the ADC (number of bits, B) and the number of accumulations M. To prevent overflow, each element of the buffer should have at least B+log2M bits. Example results of the accumulation and phase shift techniques are shown in
Accumulation and shift control can be done by a programmable logic, a Field Programmable Gate Array (FPGA) for example. Phase shifting can be controlled by delaying the clock of the ADC converter 130 by a fraction of a period or by delaying the driver of the optical source.
The value of each parameter can be adaptive as a function of the echo back signal. After analyzing the level of the noise, the system can optimize the process by adjusting parameters as a function of the priority (resolution, refresh rate, SNR). For example, if the noise is lower than expected, the system can reduce the number of accumulation and increase the number of shift delays to improve the resolution.
Based on shift delay and accumulation techniques, it is possible to optimize the cost of optical range finder systems particularly for short range distance measurement. By using only one sample per optical pulse, the ADC has to acquire samples at the frequency of the optical pulse emission. For a system driving optical pulses at L Hz, the ADC converts L samples per second with P shift delay of D ns of delay.
Nowadays, embedded processors, microcontrollers and digital signal processor, have a lot of processing power with fixed-point or floating-point units with hundreds of Mega FLOating point Operations per Second (MFLOPS) of performance. They are highly integrated with analog-to-digital converters, timers, PWM modules and, several types of interface (USB, Ethernet, CAN bus, etc). Using the last technique described, mainly because the requirement in terms of speed of the ADC is low, the major part of the range finder system can be integrated in an embedded processor.
Moving Average, Filters, Frequency Analysis and Peak Detection
Instead of collecting N data and then performing an average (one average at each 1/N×[frequency of the source]), moving average techniques permit to constantly have the last N samples to perform an average. Using a FIFO by adding a new data and subtracting the first data accumulated is an example of an implementation of that technique.
Using too much integration time for averaging can generate a problem when detecting moving objects. Averaging techniques can consider a signal from moving objects as noise and will fail to discriminate it. Frequency domain analysis can be useful for this kind of situation. Wavelet transform is very efficient for signal analysis in time/frequency domain and is sensitive to the transient signals. By separating the echo back signal in several segments and analyzing the spectral frequency, the system can detect the frequency of the pulse of the source in a specific segment. Averaging parameters can be adjusted as a function of events detected by the spectral analysis process. For instance, the number of averages should be reduced when moving objects are detected sequentially in different segments.
Low pass filters can be used as pre-processes on each trace before averaging. Filters may be particularly efficient when more than one sample is available on an echo pulse. Information from noise analysis and from the information of the signal waveform emitted by the source can also help to discriminate a signal and to adjust the parameters. Specific processing functions can be used for each point of the trace or by segment.
Another way to optimize the detection of an object and the measurement of the distance is using a reference signal and making a fit with the lidar trace. The reference signal can be a pattern signal stored in memory or a reference reflection signal of an optical pulse detected by a reference optical detector. This reference optical detector acquires a reference zero value and this reference signal is compared to the lidar trace. Detection and distance is based on comparison between both signals. Fit can be made by convolution.
When a signal waveform has a Gaussian profile, it is possible to use a method based on a zero-crossing point of the first derivative to detect the peak of the waveform. This technique requires a previous filtering to remove the noise. When the detection of an event (echo back pulse from an object) occurs, the system will detect N consecutive points over a predetermined threshold. The value of N depends notably on the sample rate and the width of the pulse from the source. By computing the first derivative of those selected points and interpolating to find the zero-crossing point, an estimation of the peak of the signal can be found.
Illumination Driver as a Source for Rangefinder with Edge Detection
Switch-mode LED drivers are very useful notably for their efficiency compared to linear drivers. PWMs permit a very high dimming ratio without drifting the wavelength usually generated by linear drivers. Their performance is particularly well suited for high power LEDs. However, switch-mode LED drivers are noisier and the EMI can be an issue for some applications. One way to address this issue is to use a gate rising/falling slope adjust circuit to decrease the speed of transitions. Transitions at lower speed mean less EMI.
For range-finding applications, the rapid transition of the signal is generally required. Usually, to get good performance, electronic circuits need to detect fast transition signals within a few nanosecond of resolution. Using a LED light source with a PWM driver with adjustment to diminish the speed of the slope as the source for detection and ranging is, in principle, not very helpful.
One solution is to use the same LED light source for illumination and for detection and ranging with a PWM circuit controlling the intensity of illumination. The PWM LED light source has a relatively constant slope during its rising/falling edge to reduce EMI (rising/falling edge of 100 ns for example). The optical signal from the source is sampled to be able to determine the starting time of the pulse (T0). Electrical synchronization signal can also be used to indicate the starting point. The reflected signal is sampled with enough temporal resolution to have several points during the slope of the signal when an object in the field of view returns a perceptible echo.
This method can be improved by using demodulation and spectral analysis techniques. The base frequency of the PWM can be demodulated and the result of this demodulation will give an indication of a presence of an object. By selecting a frequency based on an harmonic coming from the slopes of the PWM signal, one can estimate the position of the object by spectral analysis of different segments. Knowing the approximated position, the acquisition of samples will be adjusted to target the rising and the falling edge.
By using the edge detection technique, one can use a standard LED driver for the purpose of lighting and also for the purpose of detection and ranging. The frequency of the PWM might be in the range from a few KHz up to 1 MHz. High frequency modulation can improve the SNR notably by averaging techniques. When the optical output of the source is coupled by optical path (reflection from lens or mirror or use of fiber optic), this method permits using a PWM source for a LED lighting system completely electrically isolated from the receiver.
Other types of rising/falling edge detection can be used with this method with the appropriate curve fitting technique. If EMI is not an issue, the electronic driver can generate a fast rising edge and/or falling edge with some overshoot at a resonance frequency. This signal adds more power at a specific frequency and increase the signal that can be detected by the receiver.
Recognition of Predetermined Patterns
Different shapes of objects reflect a modified waveform of the original signal. The echo back signal from a wall is different when compared to the echo back signal from an object with an irregular shape. Reflection from two objects with a short longitudinal distance between them also generates a distinct waveform. By memorizing in database a several types of waveforms, this data can be used to improve the digital processing performance. Digital correlation can be done to detect a predetermined pattern.
Tracking
Averaging techniques do not perform very well with moving objects. By tracking a moving object, one can anticipate the position of the object and adapt to the situation. Averaging with shifting proportional to the estimated position is a way to improve the SNR even in the case of moving objects. Tracking edges is another way to adjust the acquisition of the waveform with more points in the region of interest. Spectral analysis can also be used to lock and track an object.
Weather Information and Condition Monitoring
The system can be used as a road weather information system (RWIS) and thus provide information about temperature, visibility (fog, snow, rain, dust), condition of the road (icy) and pollution (smog). Pattern recognition based on low frequency signals and spikes can be implemented to do so. The recognition of bad weather condition patterns helps to discriminate noise from objects. The system can be used to adjust the intensity of light depending on weather conditions. Monitoring the condition of the lens is also possible (dirt, accumulation of snow, etc). This monitoring can be done by the measurement of the reflection on the lens from the source or from an auxiliary source.
Detection Based on Integration Time
This method uses a sensor or an array of sensors (1D or 2D array—CCD, CMOS) with an integrator, or electronic shutter, and a PWM light source or a pulsed auxiliary light source.
Distance=c×(INT/4)*(P2−P1)/(P2+P1),
where c represents the velocity of light, INT represents the integration time, P1 represents the integration value synchronized with the rising edge of the optical pulse and P2 represents the integration value synchronized on the falling edge of the optical pulse.
When an illumination background from other lighting sources is not negligible, measurement of the background B during an integration time INT when the optical source of the system is off can be made and subtracted from each integration value P1 and P2. The relationship with non negligible background is:
Distance=c×(INT/4)*((P2−B)−(P1−-B))/(P2+P1−2B),
where B is the integration value of the optical background level when the optical source of the system is off.
In the case where the integration time is larger than the width of the pulse of the optical source, the same technique can be used by switching the synchronisation of the signal of the optical source and the signal to the sensor integration time. The result becomes:
Distance=c×(INT/4)*(P1−P2)/(P2+P1),
where c represents the velocity of light, INT represents the integration time, P1 represents the integration value when optical pulse is synchronized with the rising edge of integration and P2 represents the integration value when the optical pulse is synchronized with the falling edge of integration.
When an illumination background from other lighting sources is not negligible, the relationship is:
Distance=c×(INT/4)*((P1−B)−(P2−B))/(P2+P1−2B).
Values from the signal integration are memorized. In the case of an array of sensors, each “pixel” is memorized. Several integrations can be performed and an averaging process can be done to improve signal to noise ratio. In the case of an array, we also can improve signal to noise ratio by using a groups of pixel and combining them to form a larger pixel (binning)
In summary, with reference to
Additionally, the combined trace can be compared 1720 to a detected reference reflection signal of the pulse to determine 1722 a distance traveled by the pulse.
Alternatively, a timer can be triggered to calculate a time elapsed 1724 between the emission of the pulse and the detection of the reflection signal to determine a distance traveled 1722 by the pulse based on the time elapsed.
In summary, with reference to
While illustrated in the block diagrams as groups of discrete components communicating with each other via distinct data signal connections, it will be understood by those skilled in the art that the illustrated embodiments may be provided by a combination of hardware and software components, with some components being implemented by a given function or operation of a hardware or software system, and many of the data paths illustrated being implemented by data communication within a computer application or operating system. The structure illustrated is thus provided for efficiency of teaching the described embodiment.
Claims
1. A method for detecting a distance to an object, comprising:
- providing a lighting system having at least one pulse width modulated visible-light source for illumination of a field of view;
- emitting an illumination signal for illuminating said field of view for a duration of time y using said visible-light source at a time t, said time t being a center of a transition from a non-illuminated state to an illuminated state of said field of view, for at least one pulse;
- starting an optical sensor for integrating a reflection energy captured by said visible-light source, of a reflection of said illumination signal, for a first time period at a time t−x of a first one of said at least one pulse;
- stopping said optical sensor for said first time period at a time t+x for said first one of said at least one pulse and determining a first integration value for said first time period;
- starting said optical sensor for integrating said reflection energy captured by said visible-light source, of said reflection of said illumination signal, for a second time period at a time t+y−x for a second one of said at least one pulse, said second one being one of said first one and another one of said at least one pulse, y being greater than x;
- stopping said optical sensor for said second time period at a time t+y+x for said second one of said at least one pulse and determining a second integration value for said second time period;
- measuring a background integration value for non-negligible illumination background from other lighting sources during an integration time 2x when said visible-light source is not emitting;
- subtracting from each said first integration value and said second integration value said background integration value to obtain background compensated first integration value and second integration value;
- calculating a difference value between said background compensated first integration value and said background compensated second integration value;
- determining a propagation delay value proportional to said difference value;
- determining said distance to said object from said propagation delay value.
2. A method as claimed in claim 1, further comprising:
- providing a threshold distance to a pre-identified object;
- comparing said distance to said object with said threshold distance;
- determining said object to be said pre-identified object if said comparison is positive.
3. A method as claimed in claim 1, further comprising, when said x is greater than said y, said integrating being larger than a width of the pulse,
- switching a synchronisation of said illumination signal with said starting said optical sensor.
4. A ranging system comprising:
- a. a driver circuit configured to produce a driving signal for causing a light source to emit pulsed light toward a scene containing an object,
- b. an optical detector configured to collect pulsed light emitted from the light source and back-scattered from the object and to produce an output signal conveying acquisitions of light pulses,
- c. an adaptive signal processing system coupled to the optical detector, configured to perform an adaptive processing of the output signal, including: (i) sampling the output signal to obtain sampled acquisitions of light pulses, (ii) performing an accumulation of a number of the sampled acquisitions of light pulses to define an accumulated digital signal varying with time, the accumulation of the number of the sampled acquisitions of light pulses including performing integration over time of the number of sampled acquisitions of light pulses, (iii) varying the number of accumulated sampled acquisitions of light pulses to obtain a modified accumulated digital signal, based on a parameter of the object, (iv) obtaining a distance measurement from the modified accumulated digital signal.
5. The ranging system of claim 4, wherein the accumulated digital signal defines a signal trace with a pulse-shaped segment.
6. The ranging system of claim 5, wherein the signal processing system is configured for adjusting an intensity of the driving signal based on the estimated distance to the object.
7. The ranging system of claim 5, wherein the light is non-visible light.
8. The ranging system of claim 4, wherein the parameter of the object includes a distance to the object, the processing of the output signal comprises increasing the number of accumulated sampled acquisitions of light pulses to obtain a distance measurement, with an increasing distance to the object.
9. The ranging system of claim 4, wherein the parameter of the object includes a distance to the object, the processing of the output signal comprises decreasing the number of accumulated sampled acquisitions of light pulses to obtain a distance measurement, with a decreasing distance to the object.
10. The ranging system as defined in claim 4, wherein the optical detector comprises an array of pixels, each pixel outputting a respective output signal.
11. The ranging system as defined in claim 10, wherein the array is a 2D array.
12. The ranging system as defined in claim 11, wherein the array is a 1D array.
13. The ranging system as defined in claim 4, wherein the sampled acquisitions of light pulses include respective sets of j points, the accumulation of the number of sampled acquisitions of light pulses including adding the number of sets of j points, point by point to generate the accumulated digital signal.
14. The ranging system as defined in claim 13, wherein the processing of the output signal includes phase-shifting the sampled acquisitions of light pulses.
3045231 | July 1962 | Lakatos |
3680085 | July 1972 | Del Signore |
3954335 | May 4, 1976 | Bodlaj |
4717862 | January 5, 1988 | Anderson |
4808997 | February 28, 1989 | Barkley et al. |
4891624 | January 2, 1990 | Ishikawa et al. |
4928232 | May 22, 1990 | Gentile |
4987832 | January 29, 1991 | Klink et al. |
5102218 | April 7, 1992 | Min et al. |
5134393 | July 28, 1992 | Henson |
5179286 | January 12, 1993 | Akasu |
5298905 | March 29, 1994 | Dahl |
5317311 | May 31, 1994 | Martell et al. |
5357331 | October 18, 1994 | Flockencier |
5381155 | January 10, 1995 | Gerber |
5389921 | February 14, 1995 | Whitton et al. |
5396510 | March 7, 1995 | Wilson |
5471215 | November 28, 1995 | Fukuhara |
5519209 | May 21, 1996 | Rapoport et al. |
5565870 | October 15, 1996 | Fukuhara |
5587908 | December 24, 1996 | Kajiwara |
5621518 | April 15, 1997 | Beller |
5633629 | May 27, 1997 | Hochstein |
5633801 | May 27, 1997 | Bottman |
5633901 | May 27, 1997 | Bottman |
5699151 | December 16, 1997 | Akasu |
5714754 | February 3, 1998 | Nicholas |
5760686 | June 2, 1998 | Toman |
5760887 | June 2, 1998 | Fink et al. |
5764163 | June 9, 1998 | Waldman et al. |
5777564 | July 7, 1998 | Jones |
5805468 | September 8, 1998 | Blohbaum |
5812249 | September 22, 1998 | Johnson et al. |
5828320 | October 27, 1998 | Buck |
5838116 | November 17, 1998 | Katyl et al. |
5852491 | December 22, 1998 | Kato |
5889477 | March 30, 1999 | Fastenrath |
5896190 | April 20, 1999 | Wangler et al. |
5933225 | August 3, 1999 | Yamabuchi |
5942753 | August 24, 1999 | Dell |
5987395 | November 16, 1999 | Donges |
5995900 | November 30, 1999 | Hsiao et al. |
6044336 | March 28, 2000 | Marmarelis et al. |
6094159 | July 25, 2000 | Osterfeld et al. |
6100539 | August 8, 2000 | Blumcke |
6104314 | August 15, 2000 | Jiang |
6107942 | August 22, 2000 | Yoo et al. |
6115112 | September 5, 2000 | Hertzman |
6115113 | September 5, 2000 | Flockencier |
6142702 | November 7, 2000 | Simmons |
6147624 | November 14, 2000 | Clapper |
6166645 | December 26, 2000 | Blaney |
6252655 | June 26, 2001 | Tanaka |
6259515 | July 10, 2001 | Benz et al. |
6259862 | July 10, 2001 | Marino et al. |
6266609 | July 24, 2001 | Fastenrath |
6285297 | September 4, 2001 | Ball |
6340935 | January 22, 2002 | Hall |
6377167 | April 23, 2002 | Juds et al. |
6404506 | June 11, 2002 | Cheng et al. |
6411221 | June 25, 2002 | Hörber |
6417783 | July 9, 2002 | Gabler et al. |
6426708 | July 30, 2002 | Trajkovic et al. |
6502011 | December 31, 2002 | Haag |
6502053 | December 31, 2002 | Hardin et al. |
6516286 | February 4, 2003 | Aebischer et al. |
6548967 | April 15, 2003 | Dowling et al. |
6556916 | April 29, 2003 | Waite et al. |
6559776 | May 6, 2003 | Katz |
6587185 | July 1, 2003 | Ide |
6606054 | August 12, 2003 | Okamura |
6642854 | November 4, 2003 | McMaster |
6650403 | November 18, 2003 | Ogawa |
6657704 | December 2, 2003 | Shirai |
6665057 | December 16, 2003 | Schellmann |
6665250 | December 16, 2003 | Minamino et al. |
6665621 | December 16, 2003 | Drinkard et al. |
6710859 | March 23, 2004 | Shirai |
6753766 | June 22, 2004 | Patchell |
6753950 | June 22, 2004 | Morcom |
6765495 | July 20, 2004 | Dunning et al. |
6771185 | August 3, 2004 | Yoo et al. |
6794831 | September 21, 2004 | Leeb et al. |
6825778 | November 30, 2004 | Bergan et al. |
6829043 | December 7, 2004 | Lewis |
6831576 | December 14, 2004 | Geiger et al. |
6836317 | December 28, 2004 | Perger |
6842231 | January 11, 2005 | Nourrcier et al. |
6850156 | February 1, 2005 | Bloomfield et al. |
6885311 | April 26, 2005 | Howard et al. |
6885312 | April 26, 2005 | Kirkpatrick |
6897465 | May 24, 2005 | Remillard |
6917307 | July 12, 2005 | Li |
6927700 | August 9, 2005 | Quinn |
6946974 | September 20, 2005 | Racunas Jr. |
6989781 | January 24, 2006 | Steinbuch |
7023531 | April 4, 2006 | Gogolla |
7026954 | April 11, 2006 | Slemmer et al. |
7068214 | June 27, 2006 | Kakishita |
7081832 | July 25, 2006 | Nelson et al. |
7106214 | September 12, 2006 | Jesadanont et al. |
7116246 | October 3, 2006 | Winter et al. |
7119674 | October 10, 2006 | Sefton |
7119715 | October 10, 2006 | Orita |
7123166 | October 17, 2006 | Haynes et al. |
7135991 | November 14, 2006 | Slemmer et al. |
7148813 | December 12, 2006 | Bauer |
7177014 | February 13, 2007 | Mori |
7221271 | May 22, 2007 | Reime |
7236102 | June 26, 2007 | Shimotani |
7250605 | July 31, 2007 | Zhevelev et al. |
7253747 | August 7, 2007 | Noguchi |
7317384 | January 8, 2008 | Lefranc |
7321317 | January 22, 2008 | Nath |
7350945 | April 1, 2008 | Albou et al. |
7352972 | April 1, 2008 | Franklin |
7405676 | July 29, 2008 | Janssen |
7417718 | August 26, 2008 | Wada et al. |
7426450 | September 16, 2008 | Arnold et al. |
7486204 | February 3, 2009 | Quintos |
7573400 | August 11, 2009 | Arnold et al. |
7957900 | June 7, 2011 | Chowdhary et al. |
8310655 | November 13, 2012 | Mimeault |
8619241 | December 31, 2013 | Mimeault |
20010024271 | September 27, 2001 | Takayanagi |
20030154017 | August 14, 2003 | Ellis |
20030189500 | October 9, 2003 | Lim |
20040035620 | February 26, 2004 | McKeefery |
20040083035 | April 29, 2004 | Ellis |
20040135992 | July 15, 2004 | Munro |
20040233416 | November 25, 2004 | Doemens et al. |
20050046597 | March 3, 2005 | Hutchison et al. |
20050117364 | June 2, 2005 | Rennick et al. |
20050187701 | August 25, 2005 | Baney |
20050225478 | October 13, 2005 | Nakamura |
20050231384 | October 20, 2005 | Shimotani |
20050269481 | December 8, 2005 | David et al. |
20050270175 | December 8, 2005 | Peddie et al. |
20060033641 | February 16, 2006 | Jaupitre et al. |
20060072099 | April 6, 2006 | Hoashi |
20060145824 | July 6, 2006 | Frenzel et al. |
20060147089 | July 6, 2006 | Han et al. |
20060149472 | July 6, 2006 | Han et al. |
20060180670 | August 17, 2006 | Acosta et al. |
20060192938 | August 31, 2006 | Kawahito |
20060274545 | December 7, 2006 | Rosenstein |
20070018106 | January 25, 2007 | Zhevelev et al. |
20070024841 | February 1, 2007 | Kloza |
20070061192 | March 15, 2007 | Chew |
20070091294 | April 26, 2007 | Hipp |
20070096943 | May 3, 2007 | Arnold et al. |
20070097349 | May 3, 2007 | Wada |
20070187573 | August 16, 2007 | Aoki |
20070205918 | September 6, 2007 | Riesco Prieto et al. |
20070222639 | September 27, 2007 | Giles et al. |
20070228262 | October 4, 2007 | Cantin et al. |
20070255525 | November 1, 2007 | Lee |
20080006762 | January 10, 2008 | Fadell et al. |
20080046150 | February 21, 2008 | Breed |
20090059201 | March 5, 2009 | Willner |
20090102699 | April 23, 2009 | Behrens et al. |
20090119044 | May 7, 2009 | Levesque |
20090251680 | October 8, 2009 | Farsaie |
20090299631 | December 3, 2009 | Hawes et al. |
20110134249 | June 9, 2011 | Wood et al. |
20110301914 | December 8, 2011 | Maltseff |
2527895 | January 2005 | CA |
2710212 | July 2009 | CA |
4133196 | August 1997 | DE |
19604338 | July 2004 | DE |
102004035856 | March 2005 | DE |
102006025020 | November 2007 | DE |
202008007078 | September 2008 | DE |
102009013841 | September 2009 | DE |
0318260 | May 1989 | EP |
0424097 | April 1991 | EP |
0476562 | March 1992 | EP |
0494815 | July 1992 | EP |
0838695 | October 1997 | EP |
0866434 | February 1998 | EP |
0612049 | September 1998 | EP |
0988624 | March 1999 | EP |
0912970 | April 2000 | EP |
1034522 | September 2000 | EP |
1188067 | December 2000 | EP |
0798684 | January 2001 | EP |
1296302 | June 2002 | EP |
1224632 | July 2002 | EP |
0779990 | March 2003 | EP |
0935764 | March 2003 | EP |
1435036 | April 2003 | EP |
0789342 | June 2003 | EP |
0784302 | September 2003 | EP |
1611458 | July 2004 | EP |
1521226 | June 2006 | EP |
1049064 | September 2006 | EP |
1832897 | September 2007 | EP |
1997090 | September 2007 | EP |
2136550 | June 2009 | EP |
1048961 | July 2009 | EP |
2690519 | October 1992 | FR |
2264411 | August 1993 | GB |
2354898 | April 2001 | GB |
2431498 | April 2007 | GB |
2445767 | July 2008 | GB |
04-145391 | May 1992 | JP |
04145390 | May 1992 | JP |
04145391 | May 1992 | JP |
04-172285 | June 1992 | JP |
07-280940 | October 1995 | JP |
07-333339 | December 1995 | JP |
912723 | May 1997 | JP |
9-178786 | July 1997 | JP |
09178786 | July 1997 | JP |
09222476 | August 1997 | JP |
10-170652 | June 1998 | JP |
10-171497 | June 1998 | JP |
11101637 | April 1999 | JP |
2000149161 | May 2000 | JP |
2002181934 | June 2002 | JP |
2002372578 | December 2002 | JP |
2004102889 | April 2004 | JP |
2004538491 | December 2004 | JP |
2005170184 | June 2005 | JP |
2005300233 | October 2005 | JP |
2005331468 | December 2005 | JP |
2006172210 | June 2006 | JP |
2006226931 | August 2006 | JP |
2006521536 | September 2006 | JP |
2007121116 | May 2007 | JP |
2007132848 | May 2007 | JP |
2007248227 | September 2007 | JP |
4-145390 | June 2008 | JP |
09178786 | August 2009 | JP |
2010538303 | December 2010 | JP |
2014194950 | October 2014 | JP |
2016121676 | July 2016 | JP |
2002059608 | February 2022 | JP |
8705138 | August 1987 | WO |
WO-9107672 | May 1991 | WO |
9203808 | March 1992 | WO |
9634252 | October 1996 | WO |
0139153 | May 2001 | WO |
0215334 | February 2002 | WO |
02057714 | July 2002 | WO |
03007269 | January 2003 | WO |
2004100103 | November 2004 | WO |
2005008271 | January 2005 | WO |
WO2005008271 | January 2005 | WO |
2006044758 | April 2006 | WO |
2006092659 | September 2006 | WO |
2006061572 | May 2007 | WO |
2007071032 | June 2007 | WO |
2009079789 | July 2007 | WO |
2007096814 | August 2007 | WO |
2009117197 | September 2007 | WO |
2008037049 | April 2008 | WO |
2008154737 | December 2008 | WO |
2009013739 | January 2009 | WO |
2007026779 | March 2009 | WO |
2009087536 | July 2009 | WO |
2009104955 | August 2009 | WO |
- Braun et al., “Nanosecond transient electroluminescence from polymer light emitting diodes”, Applied Physics Letters, vol. 61(26):3092-3094 (Dec. 1992).
- Hussain, “Infrared Vehicle Sensor for Traffic Control,” Thesis for Doctorate City University of New York, Dissertation Abstracts International, vol. 55-07, Section A, p. 2176, 1994.
- Loukakos, Active Laser Infrared Detectors, Intelligent Transportation Systems, Traffic Surveillance, California Center for Innovative Transportation at the University of California, Dec. 20, 2001, 6 pages.
- VTU elearning, “Architecture for Programmable Digital Signal Processing Devices”, DSP Algorithms and Architecture, Subject code 06EC74, part A, Unit 2, 24 pages.
- Akindinov et al., “Detection of Light Pulses Using an Avalanche-Photodiode Array with a Metal-Resistor-Semiconductor Structure”, Instruments and Experimental Techniques, May 2005, 48(3)1355-363.
- Braun et al., “Nanosecond transient electroluminescence from polymer light-emitting diodes”, Applied Physics Letters, Dec. 1992, 61(26):3092-3094.
- digitalsignallabs.com [online], “Practical Considerations in Fixed-Point FIR Filter Implementations”, Sep. 2010, retrieved on May 25, 2022, retrieved from URL<http://www.digitalsignallabs.com/fir.pdf>,15 pages.
- The Vehicle Detector Cleaninghouse, “A summary of vehicle detection and surveillance technologies used in intelligent transportation systems”, Fall 2000, Southwest Technology Development Institute (SWTDI) at New Mexico State University (NMSU), 211 pages.
- Kon Tayfun, “Collision Warning and Avoidance System for Crest Vertical Curves”, Thesis for the degree of Master in Science, Virginia Tech, May 1998, Appendix B2, pp. 51-92.
- Traffic Detector Handbook, 3rd ed., Klein, Oct. 2006, Chapter 2, 104 pages.
- Lawrence A. Klein, Vehicle Detector Technologies for Traffic Management Applications, Part 1, Colorado Department of Transportation, Intelligent Transportation Systems (ITS), 1997.
- Hussain, Tarik Mustafa, City University of New York, Infrared Vehicle Sensor for Traffic Control, Thesis (PHD) City University of New York, Dissertation Abstracts International, vol. 55-07, Section A, p. 2176, 1994.
- Dimitri Loukakos, Active Laser Infrared Detectors, Intelligent Transportation Systems, Traffic Surveillance, California Center for Innovative Transportation at the University of California, Dec. 20, 2001.
- Office Action in European Appln. No. 08863916.6 dated Sep. 19, 2013, 5 pages.
- Decision to Grant in Japanese Appln. No. 2016-121676 dated Oct. 18, 2018, 3 pages (English Translation).
- Office Action in U.S. Appl. No. 12/809,235, dated Jul. 6, 2012, 10 pages.
- Notice of Allowance in U.S. Appl. No. 12/809,235, dated Aug. 9, 2012, 7 pages.
- Examiner's Report in Canadian Appln. No. 2,710,212, dated Jan. 20, 2014, 2 pages.
- Supplementary European Search Report in European Appln. No. 08863916.6 dated Sep. 11, 2013, 4 pages.
- Office Action in European Appln. No. 08863916.6 dated Sep. 11, 2013, 5 pages.
- Intention to Grant in European Appln. No. 08863916.6 dated Oct. 27, 2016, 5 pages.
- Decision to Grant in European Appln. No. 08863916.6, dated Mar. 9, 2017, 2 pages.
- Search Report in European Appln. No. 17162120.4, dated Jun. 21, 2017, 2 pages.
- Office Action in European Appln. No. 17162120.4, dated Jun. 21, 2017, 5 pages.
- Office Action in European Appln. No. 17162120.4 dated Oct. 2, 2018, 3 pages.
- Intention to Grant in European Appln. No. 17162120.4 dated Mar. 25, 2021, 5 pages.
- Decision to grant in European Appln. No. 17162120.4 dated Jul. 29, 2021, 2 pages.
- Notice of Allowance in U.S. Appl. No. 12/809,235, dated Aug. 9, 2012, 5 pages.
- Supplemental Notice of Allowability in U.S. Appl. No. 12/809,235, dated Sep. 28, 2012, 2 pages.
- Office Action in U.S. Appl. No. 13/632,191, dated May 13, 2013, 6 pages.
- Notice of Allowance U.S. Appl. No. 13/632,191, dated Aug. 30, 2013, 6 pages.
- Office Action in U.S. Appl. No. 14/984,704, dated Jun. 15, 2017, 13 pages.
- Notice of Allowance in U.S. Appl. No. 14/984,704, dated Mar. 8, 2018, 9 pages.
- International Preliminary Report on Patentability in International Appln. No. PCT/CA2008/002268, dated Jun. 22, 2010, 6 pages.
- Written Opinion of the International Searching Authority in International Appln. No. PCT/CA2008/002268, dated Jun. 21, 2010, 5 pages.
- Search Report in Japanese Appln. No. 2010-538303, dated Apr. 25, 2013, 23 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2010-538303, dated May 8, 2013, 4 pages (English Translation).
- Decision of Refusal in Japanese Appln. No. 2010-538303, dated May 28, 2014, 4 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2010-538303, dated Nov. 10, 2014, 4 pages (English Translation).
- Decision to Grant in Japanese Appln. No. 2010-538303, dated Dec. 8, 2014, 3 pages (English Translation).
- Search Report in Japanese Appln. No. 2014-194950, dated Jul. 21, 2015, 24 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2014-194950, dated Jul. 27, 2015, 7 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2014-194950, dated Mar. 22, 2016, 4 pages (English Translation).
- Decision to Grant a Patent in Japanese Appln. No. 2014-194950, dated Sep. 7, 2016, 3 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2016-121676, dated Jul. 3, 2017, 7 pages (English Translation).
- Notice of Reasons for Refusal in Japanese Appln. No. 2016-121676, dated May 1, 2018, 4 pages (English Translation).
- FHWA.dot.gov [online], “Detailed Monitoring Protocol,” upon information and belief, available no later than Oct. 25, 2011, retrieved on Nov. 29, 2021, retrieved from URL <https://www.fhwa.dot.gov/environment/air_quality/air_toxics/research_and_analysis/near_road_study/protocol/protocol04.cfm>, 7 pages.
- Akindinov et al., “Detection of Light Pulses Using an Avalanche-Photodiode Array with a Metal-Resistor-Semiconductor Structure”, Instruments and Experimental Techniques, Nov. 2004, vol. 48, No. 3 205, pp. 355-363, Russia.
- Braun et al., “Nanosecond transient electroluminescence from polymer lightemitting diodes”, Applied Physics Letters Dec. 1992, vol. 61, No. 26, pp. 3092-3094, California.
Type: Grant
Filed: Jun 19, 2018
Date of Patent: Dec 20, 2022
Assignee: LeddarTech Inc. (Quebec)
Inventor: Yvan Mimeault (Québec)
Primary Examiner: Christopher E. Lee
Application Number: 16/011,820
International Classification: G01C 3/08 (20060101); G01S 7/487 (20060101); G01S 7/4861 (20200101); G01S 7/4865 (20200101); G01S 17/10 (20200101);