Abstract: A system recognizes user-object gesture interactions with the surface of a monitor display, with hover space defined spaced-apart from the display surface, or in virtual scroll regions defined on the periphery of the monitor display. The system recognizes user-object interactions, e.g., gestures, and can affect what is displayed commensurately. The system includes at least a first time-of-flight (TOF) system and at least one of a second TOF, a two-dimensional camera, and a mirror, each TOF system processing at least one of z-depth data and A-brightness data. User-object interactions, e.g., touching(s) of the display surface, location(s) in a hover region, or location(s) in a virtual scroll region, are recognized passively in that the user-object need not have capacitance, resistance, exert force, or deform during gesture interaction. The system may be attached retroactively to the monitor, which may be a large (>22 cm) monitor, or a small cell phone sized monitor.

Abstract: A user-centric method and system to identify user-made gestures to control a remote device images the user using a three-dimensional image system, and defines at least one user-centric three-dimensional detection zone dynamically sized appropriately for the user, who is free to move about. Images made within the detection zone are compared to a library of stored gestures, and the thus identified gesture is mapped to an appropriate control command signal coupleable to the remote device. The method and system also provides of a first user to hand off control of the remote device to a second user.

Abstract: A CMOS detector with pairs of interdigitated elongated finger-like collection gates includes p+ implanted regions that create charge barrier regions that can intentionally be overcome. These regions steer charge to a desired collection gate pair for collection. The p+ implanted regions may be formed before and/or after formation of the collection gates. These regions form charge barrier regions when an associated collection gate is biased low. The barriers are overcome when an associated collection gate is high. These barrier regions steer substantially all charge to collection gates that are biased high, enhancing modulation contrast. Advantageously, the resultant structure has reduced power requirements in that inter-gate capacitance is reduced in that inter-gate spacing can be increased over prior art gate spacing and lower swing voltages may be used. Also higher modulation contrast is achieved in that the charge collection area of the low gate(s) is significantly reduced.

Abstract: A CMOS-implementable TOF detector promptly collects charge whose creation time can be precisely known, while rejecting collection of potentially late arriving charge whose creation time may not be precisely known. Charges created in upper regions of the detector structure are ensured to be rapidly collected, while charges created in the lower regions of the detector structure, potentially late arriving charges, are inhibiting from being collected.

Abstract: An analytical tool useable with complex systems receives as input various system parameters to predict whether sufficiently accurate quality depth data will be provided by the TOF system. Depth data quality estimates involve dividing system operation into smaller operations whose individual depth data quality contributions can be more readily computed. The effect of the individual operations is combined and the tool outputs a depth data quality estimate accounting for the net result of the various unique operations performed by the system. When used with a TOF system, input parameters may include magnitude and angular distribution of TOF emitted optical energy, desired signal/noise, sensor characteristics, TOF imaging optics, target object distances and locations, and magnitude of ambient light. Analytical tool output data can ensure adequate calculation accuracy to optimize the TOF system pre-mass production, even for TOF systems whose sequence of operations and sensor operations are flexibly programmable.

Abstract: Time-of-flight (TOF) three-dimensional sensing systems are deployed on or in a motor vehicle to image contact zones associated with potential contact between an avoidable object and the vehicle or vehicle frame and/or remotely controllable motorized moving door or liftgate. An algorithm processes depth data acquired by each TOF system to determine whether an avoidable object is in the associated contact zone. If present, a control signal issues to halt or reverse the mechanism moving the door. A stored database preferably includes a depth image of the contact zone absent any object, an image of the door, and volume of the door. Database images are compared to newly acquired depth images to identify pixel sensors whose depth values are statistically unlikely to represent background or the door. Pixels within the contact zone so identified are an object, and the control signal is issued.

Abstract: Time-of-flight (TOF) phase-derived data is dealiased by operating the TOF system using at least two close-together modulation frequencies f1 and f2 that are close to the TOF system maximum modulation frequency fm. On one hand, phase data acquired by the TOF is associated with a desirably long aliasing interval range ZAIR normally associated with a rather low modulation frequency. On the other hand, phase data acquired by the TOF system is also associated with the high precision certainty as to Z value normally associated with high modulation frequency. Preferably the TOF system operates always close to fm such that TOF operating efficiency is high, and system signal/noise ratio is not substantially degraded using the present invention.

Abstract: An obstacle detection and tracking system identifies objects in the path of a vehicle equipped with the system and issues a visual, audible, and/or control system warning. The system includes a depth imaging system that acquires depth data from objects in the field of view of a detection zone encompassing at least a portion of the road to be driven upon. It is assumed most of the acquired data represents road plane information. Statistical analysis of the depth image data identifies in (X,Y,Z) space at least one plane of the road being driven, after which identification threshold normal heights above and below the road plane are defined. Imaged objects within the detection zone that are higher or lower than a threshold normal are deemed of potential concern and will generate a warning to the vehicle operator or vehicle.

Abstract: Rapid calibration of a TOF system uses a stationary target object and electrically introduces phase shift into the TOF system to emulate target object relocation. Relatively few parameters suffice to model a parameterized mathematical representation of the transfer function between measured phase and Z distance. The phase-vs-distance model is directly evaluated during actual run-time operation of the TOF system. Preferably modeling includes two components: electrical modeling of phase-vs-distance characteristics that depend upon electrical rather than geometric characteristics of the sensing system, and elliptical modeling that phase-vs-distance characteristics that depending upon geometric rather than electrical characteristics of the sensing system.

Abstract: A method and system to enhance accuracy of measurement of distance Z in a TOF system dynamically provides tight control over the phase and/or timing relationship of clock pulses used in the TOF system. Enhanced frequency control is imposed over a high speed oscillator whose output(s) control a timing generator, whose outputs are coupled to circuitry associated with the detection array in the TOF system, and with the TOF clock timing circuitry. The timing generator is coupled to a delay locked loop (DLL) and/or phase lock loop (PLL), which loop(s) are feedback coupled to the waveform circuit that drives the source of electromagnetic energy emitted by the TOF system.

Abstract: Rapid calibration of a TOF system uses a stationary target object and electrically introduces phase shift into the TOF system to emulate target object relocation. Relatively few parameters suffice to model a parameterized mathematical representation of the transfer function between measured phase and Z distance. The phase-vs-distance model is directly evaluated during actual run-time operation of the TOF system. Preferably modeling includes two components: electrical modeling of phase-vs-distance characteristics that depend upon electrical rather than geometric characteristics of the sensing system, and elliptical modeling that phase-vs-distance characteristics that depending upon geometric rather than electrical characteristics of the sensing system.

Abstract: A sensor system is provided for determining a deployment level of an airbag in a vehicle. A light source of the sensor system emits light onto a region around a vehicle seat. An array of light-sensitive pixels which capture reflected light from the scene, including reflected light that originated from the light source. Processing resources are provided that determine depth information for an object in the scene based on a time-of-flight characteristic of the reflected light from the light source captured on the array. The processing resources may be configured to determine occupancy data for the object based on the captured reflected light from the scene. The processing resources are configured to determine the deployment level of the airbag based at least in part on the occupancy data in when a collision of the vehicle occurs.

Abstract: Performance of pixel detectors in a TOF imaging system is dynamically adjusted to improve dynamic range to maximize the number of pixel detectors that output valid data. The invention traverses the system-acquired z depth, the brightness, and the active brightness images, and assigns each pixel a quantized value. Quantization values encompass pixels receiving too little light, normal light, to too much light. Pixels are grouped into quantized category groups, whose populations are represented by a histogram. If the number of pixels in the normal category exceeds a threshold, no immediate corrective action is taken. If the number of pixel receiving too little (or too much) light exceeds those receiving too much (or too little) light, the invention commands at least one system parameter change to increase (or decrease) light reaching the pixels. Controllable TOF system parameters can include exposure time, common mode resets, video gain, among others.

Abstract: Effective differential dynamic range and common mode rejection in a differential pixel detector are enhanced by capturing and isolating differential detector charge output before using common mode reset to avoid detector saturation due to common mode components of optical energy to be detected. Differential charge is stored into an integration capacitor associated with an operational amplifier coupled to receive as input the differential detector outputs. Common mode reset is achieved by setting storage capacitors coupled to the outputs of the differential detector at least once within an integration time T before storage potential exceeds a saturation voltage Vsat for the photodetector.

Abstract: Rapid calibration of a TOF system uses a stationary target object and electrically introduces phase shift into the TOF system to emulate target object relocation. Relatively few parameters suffice to model a parameterized mathematical representation of the transfer function between measured phase and Z distance. The phase-vs-distance model is directly evaluated during actual run-time operation of the TOF system. Preferably modeling includes two components: electrical modeling of phase-vs-distance characteristics that depend upon electrical rather than geometric characteristics of the sensing system, and elliptical modeling that phase-vs-distance characteristics that depending upon geometric rather than electrical characteristics of the sensing system.

Abstract: CMOS implementable three-dimensional silicon sensors are fabricated using a standard fab but using augmented rules that create mask patterns not expressible with existing fab rules. Standard fab rules are not optimized to produce high quality three-dimensional silicon sensors. Accordingly, the normal set of rules does not permit creating the fab mask patterns necessary for high performance such sensors. However, the present invention can use the fab standard mask set with a rich set of fab instructions to express mask patterns from the mask set that would not otherwise be expressible. The resultant method enables high quality silicon sensors for three-dimensional sensing to be readily mass produced from a standard fab.

Abstract: TOF system shutter time needed to acquire image data in a time-of-flight (TOF) system that acquires consecutive images is reduced, thus decreasing the time in which relative motion can occur. In one embodiment, pixel detectors are clocked with multi-phase signals and integration of the four signals occurs simultaneously to yield four phase measurements from four pixel detectors within a single shutter time unit. In another embodiment, phase measurement time is reduced by a factor (1/k) by providing super pixels whose collection region is increased by a factor “k” relative to a normal pixel detector. Each super pixel is coupled to k storage units and four-phase sequential signals. Alternatively, each pixel detector can have k collector regions, k storage units, and share common clock circuitry that generates four-phase signals. Various embodiments can reduce the mal-effects of clock signal transients upon signals, and can be dynamically reconfigured as required.

Abstract: A preferably parametrically defined calibration target pattern definable in real-world coordinates (Xi,Yi) is used to spatially calibrate a camera system acquiring images in pixel coordinates (xi,yi). The calibration target pattern is used to produce a unique 1:1 mapping enabling the camera system to accurately identify each point in the calibration target pattern point mapped to each pixel in the acquired image. Preferably the calibration target pattern is pre-distorted and includes at least two sinusoids that create a pattern of distorted wavefronts that when imaged by the camera system will appear substantially linearized. Since wavefront locations on the calibration target pattern were known, a mapping between those wavefronts and the substantially linearized wavefront pattern on the camera system captured image can be carried out. Demodulation of the captured image enables recovery of the continuous wave functions therein, using spectral analysis and iteration.

Abstract: A method and system dynamically calculates confidence levels associated with accuracy of Z depth information obtained by a phase-shift time-of-flight (TOF) system that acquires consecutive images during an image frame. Knowledge of photodetector response to maximum and minimum detectable signals in active brightness and total brightness conditions is known a priori and stored. During system operation brightness threshold filtering and comparing with the a priori data permits identifying those photodetectors whose current output signals are of questionable confidence. A confidence map is dynamically generated and used to advise a user of the system that low confidence data is currently being generated. Parameter(s) other than brightness may also or instead be used.

Abstract: Inter-system interference cross-produce P12 is reduced in a phase-based TOF system by randomizing instantaneous phase and/or frequency within a capture interval (or detection integration period). In one aspect, the TOF clock system frequency preserves long-term clock frequency stability but intentionally includes random or pseudo-random clock noise. The noise ensures the generated clock signals are temporally imperfect and lack substantial perfect periodicity. A second aspect causes the TOF clock system to hop frequency, preferably pseudo-randomly. TOF system homodyning favors detection of optical energy whose frequency correlates to the time-varying frequency of the emitted optical energy. Thus, the varying spectral spacing of the emitted optical energy reduces likelihood that an adjacent TOF system at any given time will emit optical energy of an interfering frequency.