Abstract: Geiger mode photo diodes are solid state photodetectors that are able to detect single photons. Such Geiger mode photo diodes are also referred to as single-photon detectors (SPDs). An array of SPDs can be used as a single detector element in an active sensing system, but sensor systems based on SPD arrays have at least two shortcomings due to ambient light. First, solar background light can hamper the ability to accurately determine depth. Second, ambient light impacts the reflectivity precision because of challenges differentiating between reflected light and ambient light. Embodiments enable active sensors that remove the ambient signal from a sensor's optical input. Other embodiments produce sensor intensity values that have higher precision than typical SPD array devices. Further embodiments produce sensor depth values that have higher precision than typical SPD array devices.

Abstract: Geiger mode avalanche photo diodes are solid state photodetectors that are able to detect single photons. Such Geiger mode avalanche photo diodes are also referred to as single-photon avalanche diodes (SPADs). An array of SPADs can be used as a single detector element in an active sensing system, but camera/sensor systems based on SPAD arrays have at least two shortcomings due to ambient light. First, solar background light can hamper the ability to accurately determine depth. Second, ambient light impacts the reflectivity precision because of challenges differentiating between reflected light and ambient light. Embodiments enable active sensors that remove the ambient signal from a sensor's optical input. Other embodiments produce sensor intensity values that have higher precision than typical SPAD array devices. Further embodiments produce sensor depth values that have higher precision than typical SPAD array devices.

Abstract: Exterior lighting on vehicles and buildings is typically used to illuminate scenes for better vision. The same exterior lighting can be used as part of an active sensor at discrete times during the sensor's active imaging cycles. In embodiments, an intelligent control module enables emitter output in accordance with the imaging system during active imaging cycles and enables emitter output in accordance with the non-imaging lighting control unit during non-imaging cycles. Embodiments of intelligent control modules can be used in security applications, in Automatic Driving Alert Systems and Autonomous Control Systems for commercial and passenger vehicles, and in low-altitude aircraft applications.

Abstract: Range gated imaging systems utilize short light pulses and synchronized detector cycles to image objects that are contained within a distance range. Single-image range gating allows depth estimation for static scenes, but this technique is not well-suited for in-motion applications or attenuating environments. In various embodiments, a multi-frame range gating system uses a series of range gate frames that are produced within a brief timing window, whereby each range-gate frame illuminates a different lighting-invariant depth range within the field of view. Multi-frame range gate cycles of as little as three frames are sufficient to produce precise lighting-invariant depth information for each pixel in a sensor for in-motion applications. Lighting-invariant depth information is produced with multi-frame range gate cycles of as little as four frames for in-motion applications for attenuating environments like fog, rain, dust, smoke, smog, and underwater.

Abstract: An image processing system with a camera system and a processing system analyzes a series of images of a scene to assess an optical property of an object in the scene. A surface of an object that is differentiable from other objects and has a common point that can be identified and analyzed in the series of images captured from different distances of the camera system to the object and different angular orientations of the camera system relative to the object. A set of characteristic values of the image pixels corresponding to the common point is determined that include a point intensity value, a distance from the camera system to the common point, a normal vector for the common point, and an angular orientation between an optical path of the image pixel and the normal vector. The set of characteristics values are used to create an optical profile of the common point that is compared to a set of predefined characteristic profiles to identify the object.

Abstract: An active camera system images successive frames of a scene utilizing an array of detectors configured to produce a response having a linear relationship to a number of incident photons. Multi-frame capture is utilized with differentiated frame illumination for successive frames. Frame processing allows the camera to produce, at the pixel level, different image intensities representing maximum signal intensity, ambient signal intensity, and object signal intensity. The linearized response of detectors in the lighting-invariant image sensor is used to establish non-attenuated signal strength that enables shadow removal and glare removal for one or more of the image signals. Embodiments of a lighting-invariant image sensor may be used in Autonomous and Semi-Autonomous Vehicle Control/Assist Systems.

Abstract: A display system for use in a vehicle is disclosed including a camera configured to capture frames corresponding to a field of view. The camera is in communication with a processing unit configured to receive data representative of objects within the captured frames from the camera. A display is in communication with the processing unit which is configured to display objects based on the data representative of the captured frames received by the processing unit. Multi-frame capture is utilized with differential inter-frame illumination to provide low-visibility object detection and display. Adverse environmental conditions whereby image display is enhanced include fog, rain, snow, dust, nighttime, and high-glare scenarios.

Abstract: An active-pulsed four-dimensional camera system that utilizes a precisely-controlled light source produces spatial information and human-viewed or computer-analyzed images. The acquisition of four-dimensional optical information is performed at a sufficient rate to provide accurate image and spatial information for in-motion applications where the camera is in motion and/or objects being imaged, detected and classified are in motion. Embodiments allow for the reduction or removal of image-blocking conditions like fog, snow, rain, sleet and dust from the processed images. Embodiments provide for operation in daytime or nighttime conditions and can be utilized for day or night full-motion video capture with features like shadow removal. Multi-angle image analysis is taught as a method for classifying and identifying objects and surface features based on their optical reflective characteristics.