Abstract: Time-of-flight (TOF) phase-derived data is dealiased by operating the TOF system using at least two close-together modulation frequencies f1 and f2 that are close to the TOF system maximum modulation frequency fm. On one hand, phase data acquired by the TOF is associated with a desirably long aliasing interval range ZAIR normally associated with a rather low modulation frequency. On the other hand, phase data acquired by the TOF system is also associated with the high precision certainty as to Z value normally associated with high modulation frequency. Preferably the TOF system operates always close to fm such that TOF operating efficiency is high, and system signal/noise ratio is not substantially degraded using the present invention.

Abstract: An obstacle detection and tracking system identifies objects in the path of a vehicle equipped with the system and issues a visual, audible, and/or control system warning. The system includes a depth imaging system that acquires depth data from objects in the field of view of a detection zone encompassing at least a portion of the road to be driven upon. It is assumed most of the acquired data represents road plane information. Statistical analysis of the depth image data identifies in (X,Y,Z) space at least one plane of the road being driven, after which identification threshold normal heights above and below the road plane are defined. Imaged objects within the detection zone that are higher or lower than a threshold normal are deemed of potential concern and will generate a warning to the vehicle operator or vehicle.

Abstract: Rapid calibration of a TOF system uses a stationary target object and electrically introduces phase shift into the TOF system to emulate target object relocation. Relatively few parameters suffice to model a parameterized mathematical representation of the transfer function between measured phase and Z distance. The phase-vs-distance model is directly evaluated during actual run-time operation of the TOF system. Preferably modeling includes two components: electrical modeling of phase-vs-distance characteristics that depend upon electrical rather than geometric characteristics of the sensing system, and elliptical modeling that phase-vs-distance characteristics that depending upon geometric rather than electrical characteristics of the sensing system.

Abstract: A sensor system is provided for determining a deployment level of an airbag in a vehicle. A light source of the sensor system emits light onto a region around a vehicle seat. An array of light-sensitive pixels which capture reflected light from the scene, including reflected light that originated from the light source. Processing resources are provided that determine depth information for an object in the scene based on a time-of-flight characteristic of the reflected light from the light source captured on the array. The processing resources may be configured to determine occupancy data for the object based on the captured reflected light from the scene. The processing resources are configured to determine the deployment level of the airbag based at least in part on the occupancy data in when a collision of the vehicle occurs.

Abstract: Performance of pixel detectors in a TOF imaging system is dynamically adjusted to improve dynamic range to maximize the number of pixel detectors that output valid data. The invention traverses the system-acquired z depth, the brightness, and the active brightness images, and assigns each pixel a quantized value. Quantization values encompass pixels receiving too little light, normal light, to too much light. Pixels are grouped into quantized category groups, whose populations are represented by a histogram. If the number of pixels in the normal category exceeds a threshold, no immediate corrective action is taken. If the number of pixel receiving too little (or too much) light exceeds those receiving too much (or too little) light, the invention commands at least one system parameter change to increase (or decrease) light reaching the pixels. Controllable TOF system parameters can include exposure time, common mode resets, video gain, among others.

Abstract: Effective differential dynamic range and common mode rejection in a differential pixel detector are enhanced by capturing and isolating differential detector charge output before using common mode reset to avoid detector saturation due to common mode components of optical energy to be detected. Differential charge is stored into an integration capacitor associated with an operational amplifier coupled to receive as input the differential detector outputs. Common mode reset is achieved by setting storage capacitors coupled to the outputs of the differential detector at least once within an integration time T before storage potential exceeds a saturation voltage Vsat for the photodetector.

Abstract: Rapid calibration of a TOF system uses a stationary target object and electrically introduces phase shift into the TOF system to emulate target object relocation. Relatively few parameters suffice to model a parameterized mathematical representation of the transfer function between measured phase and Z distance. The phase-vs-distance model is directly evaluated during actual run-time operation of the TOF system. Preferably modeling includes two components: electrical modeling of phase-vs-distance characteristics that depend upon electrical rather than geometric characteristics of the sensing system, and elliptical modeling that phase-vs-distance characteristics that depending upon geometric rather than electrical characteristics of the sensing system.

Abstract: TOF system shutter time needed to acquire image data in a time-of-flight (TOF) system that acquires consecutive images is reduced, thus decreasing the time in which relative motion can occur. In one embodiment, pixel detectors are clocked with multi-phase signals and integration of the four signals occurs simultaneously to yield four phase measurements from four pixel detectors within a single shutter time unit. In another embodiment, phase measurement time is reduced by a factor (1/k) by providing super pixels whose collection region is increased by a factor “k” relative to a normal pixel detector. Each super pixel is coupled to k storage units and four-phase sequential signals. Alternatively, each pixel detector can have k collector regions, k storage units, and share common clock circuitry that generates four-phase signals. Various embodiments can reduce the mal-effects of clock signal transients upon signals, and can be dynamically reconfigured as required.

Abstract: A preferably parametrically defined calibration target pattern definable in real-world coordinates (Xi,Yi) is used to spatially calibrate a camera system acquiring images in pixel coordinates (xi,yi). The calibration target pattern is used to produce a unique 1:1 mapping enabling the camera system to accurately identify each point in the calibration target pattern point mapped to each pixel in the acquired image. Preferably the calibration target pattern is pre-distorted and includes at least two sinusoids that create a pattern of distorted wavefronts that when imaged by the camera system will appear substantially linearized. Since wavefront locations on the calibration target pattern were known, a mapping between those wavefronts and the substantially linearized wavefront pattern on the camera system captured image can be carried out. Demodulation of the captured image enables recovery of the continuous wave functions therein, using spectral analysis and iteration.

Abstract: A method and system dynamically calculates confidence levels associated with accuracy of Z depth information obtained by a phase-shift time-of-flight (TOF) system that acquires consecutive images during an image frame. Knowledge of photodetector response to maximum and minimum detectable signals in active brightness and total brightness conditions is known a priori and stored. During system operation brightness threshold filtering and comparing with the a priori data permits identifying those photodetectors whose current output signals are of questionable confidence. A confidence map is dynamically generated and used to advise a user of the system that low confidence data is currently being generated. Parameter(s) other than brightness may also or instead be used.

Abstract: Inter-system interference cross-produce P12 is reduced in a phase-based TOF system by randomizing instantaneous phase and/or frequency within a capture interval (or detection integration period). In one aspect, the TOF clock system frequency preserves long-term clock frequency stability but intentionally includes random or pseudo-random clock noise. The noise ensures the generated clock signals are temporally imperfect and lack substantial perfect periodicity. A second aspect causes the TOF clock system to hop frequency, preferably pseudo-randomly. TOF system homodyning favors detection of optical energy whose frequency correlates to the time-varying frequency of the emitted optical energy. Thus, the varying spectral spacing of the emitted optical energy reduces likelihood that an adjacent TOF system at any given time will emit optical energy of an interfering frequency.

Abstract: Dynamic range of photodetector sensors useable in a TOF system is enhanced by capturing images of an object using multiple exposure time settings. Longer exposure settings more appropriately capture non-reflective and/or distant objects, while shorter exposure settings more appropriately capture reflective and/or closer objects. During parallel mode operation, detection signal readouts are taken from each photodetector at different time intervals within an overall exposure time. In sequential mode operation, detection signal readouts are taken and stored for each photodetector at the end of a first exposure time interval and the photodetectors are reset. After a second, different exposure time interval readouts are taken and stored, and the photodetectors reset, etc. In these modes one of the time exposure intervals will be relatively optimum for enhanced dynamic range operation.

Abstract: Performance of pixel detectors in a TOF imaging system is dynamically adjusted to improve dynamic range to maximize the number of pixel detectors that output valid data. The invention traverses the system-acquired z depth, the brightness, and the active brightness images, and assigns each pixel a quantized value. Quantization values encompass pixels receiving too little light, normal light, to too much light. Pixels are grouped into quantized category groups, whose populations are represented by a histogram. If the number of pixels in the normal category exceeds a threshold, no immediate corrective action is taken. If the number of pixel receiving too little (or too much) light exceeds those receiving too much (or too little) light, the invention commands at least one system parameter change to increase (or decrease) light reaching the pixels. Controllable TOF system parameters can include exposure time, common mode resets, video gain, among others.

Abstract: For use with an imaging system, in one aspect, the present invention implements a filter system that provides a precise narrow band pass for IR-NIR wavelengths, while also providing individual dye-type filters that can be disposed above individual RGB pixels to create dedicated red, green, and blue pixel responses. An interference dichotic filter provides a non-critical first pass band that adequately encompassed RGB wavelengths, and provides a more critical IR-NIR pass band for Z-pixels. The individual dye-type filters have individual R, G, B pass band shapes that fall within the interference filter. Preferably a dye-type NIR-IR filter is also in a common optical path with the other filters to contribute to the overall filtering. In a second aspect, the invention provides an RGB-Z system with dynamically updated image renderings to better enable a viewer of the image to acquire a sense of depth.

Abstract: TOF and color sensing detector structures have x-axis spaced-apart y-axis extending finger-shaped gate structures with adjacent source collection regions. X-dimension structures are smaller than y-dimension structure and govern performance, characterized by high x-axis electric fields and rapid charge movement, contrasted with lower y-axis electric fields and slower charge movement. Preferably a potential barrier is implanted between adjacent gates and a bias gate is formed intermediate a gate and associated source region. Resultant detector structures can be operated at the more extreme gate voltages that are desirable for high performance.

Abstract: Dynamic range of a differential pixel is enhanced by injecting, synchronously or asynchronously, a compensating offset (?COMP) into a differential signal capacitor whenever magnitude of the differential signal across the capacitor exceeds a predetermined value. Positive and negative magnitudes of ?COMP need not be equal. The number (N) of ?COMP offsets made is counted. Effective differential signal capacitor voltage V(t)=Vo±N·?COMP, where Vo is capacitor voltage. In other embodiments magnitude of ?COMP in a sequence of compensations can differ, and the sum total of compensations in recorded. Differential pixel signal/noise ratio is increased by dynamically maximizing operational amplifier gain AG for each differential pixel.

Abstract: Effective differential dynamic range and common mode rejection in a differential pixel detector are enhanced by capturing and isolating differential detector charge output before using common mode reset to avoid detector saturation due to common mode components of optical energy to be detected. Differential charge is stored into an integration capacitor associated with an operational amplifier coupled to receive as input the differential detector outputs. Common mode reset is achieved by resetting storage capacitors coupled to the outputs of the differential detector at least once within an integration time T before storage potential exceeds a saturation voltage Vsat for the photodetector.