Abstract: Methods, systems, and computer program products for acquiring three-dimensional LiDAR information of a scene are disclosed. According to one aspect, acquiring three-dimensional information includes emitting N pulses in a sequence with each successive pulse having a relative time shift to the sampling reference, thus producing a reconstructed sampled signal with an effective sampling rate of N times the sampling reference. According to another aspect, acquiring three-dimensional information includes emitting two or more frequencies, the differences of each pair of differing frequencies being designated as ?f, and sampling the return information with the use of a sampling reference. Frequency analysis is performed on the sampled information to determine the reference times at which the ?f signals occur and the signal intensity of the ?f signals at each time.

Abstract: A two-layer retroreflective article construction is enabled that produces higher wide-entrance-angle performance for signs and pavement markings. A single-layer overlay is enabled for existing signs and pavement markers that improve their entrance angle performance. Materials used in the construction of an article or an overlay are transparent to radiation in the range of 400 to 1000 nanometers and utilize TIR (total internal reflection). Minimum performance specifications are proposed that extend sign sheeting retroreflectivity specifications to entrance angles of 60 degrees. An innovative traffic sign design is enabled that increases the positioning performance of safety systems and automated navigation systems.

Abstract: An in-pixel embedded analog image processing system performs analog image computation within an image pixel. In embodiments, each in-pixel processing element includes a photodetector, photodetector control circuitry, analog circuitry configured to process both neighbor-in-space and neighbor-in-time functions for analog data representing an electrical current from the photodetector control circuitry, and a set of north-east-west-south (NEWS) registers, each register interconnected between a unique pair of neighboring in-pixel processing elements to transfer analog data between the pair of neighboring in-pixel processing elements. In embodiments, the in-pixel embedded analog image processing device takes advantage of high parallelism because each pixel has its own processor, and takes advantage of locality of data because all data is located within a pixel or within a neighboring pixel.

Abstract: An active-pulsed four-dimensional camera system that utilizes a precisely-controlled light source produces spatial information and human-viewed or computer-analyzed images. The acquisition of four-dimensional optical information is performed at a sufficient rate to provide accurate image and spatial information for in-motion applications where the camera is in motion and/or objects being imaged, detected and classified are in motion. Embodiments allow for the reduction or removal of image-blocking conditions like fog, snow, rain, sleet, and dust from the processed images. Embodiments provide for operation in daytime or nighttime conditions and can be utilized for day or night full-motion video capture with features like shadow removal. Multi-angle image analysis is taught as a method for classifying and identifying objects and surface features based on their optical reflective characteristics.

Abstract: A two-layer retroreflective article construction is enabled that produces higher wide-entrance-angle performance for signs and pavement markings. A single-layer overlay is enabled for existing signs and pavement markers that improve their entrance angle performance. Materials used in the construction of an article or an overlay are transparent to radiation in the range of 400 to 1000 nanometers and utilize TIR (total internal reflection). Minimum performance specifications are proposed that extend sign sheeting retroreflectivity specifications to entrance angles of 60 degrees. An innovative traffic sign design is enabled that increases the positioning performance of safety systems and automated navigation systems.

Abstract: Various embodiments of a 3D+ imaging system include imaging systems with on-chip neighbor-in-time analog sub-pixel processing and single-pixel motion determination. In embodiments, range gating imaging techniques are used to generate a composite image depth map of a scene based on analog sub-pixel processing are implemented. In embodiments, high-intensity rate of change of neighboring pixels techniques are used to generate a composite image two-axis motion map of a scene at a pixel level. In embodiments, an analog pixel circuit is disclosed for use with an array of photodetectors for a sub-frame composite imaging system. In embodiments, an extended-dynamic-range imaging technique is used in imaging to reproduce a greater dynamic range of luminosity.

Abstract: Range gated imaging systems utilize short light pulses and synchronized detector cycles to image objects that are contained within a distance range. Single-image range gating allows depth estimation for static scenes, but this technique is not well-suited for in-motion applications or attenuating environments. In various embodiments, a multi-frame range gating system uses a series of range gate frames that are produced within a brief timing window, whereby each range-gate frame illuminates a different lighting-invariant depth range within the field of view. Multi-frame range gate cycles of as little as three frames are sufficient to produce precise lighting-invariant depth information for each pixel in a sensor for in-motion applications. Lighting-invariant depth information is produced with multi-frame range gate cycles of as little as four frames for in-motion applications for attenuating environments like fog, rain, dust, smoke, smog, and underwater.

Abstract: LiDAR (light detection and ranging) systems use one or more emitters and a detector array to cover a given field of view where the emitters each emit a single pulse or a multi-pulse packet of light that is sampled by the detector array. On each emitter cycle the detector array will sample the incoming signal intensity at the pre-determined sampling frequency that generates two or more samples per emitted light packet to allow for volumetric analysis of the retroreflected signal portion of each emitted light packet as reflected by one or more objects in the field of view and then received by each detector.

Abstract: An image processing system with a camera system and a processing system analyzes a series of images of a scene to assess an optical property of an object in the scene. A surface of an object that is differentiable from other objects and has a common point that can be identified and analyzed in the series of images captured from different distances of the camera system to the object and different angular orientations of the camera system relative to the object. A set of characteristic values of the image pixels corresponding to the common point is determined that include a point intensity value, a distance from the camera system to the common point, a normal vector for the common point, and an angular orientation between an optical path of the image pixel and the normal vector. The set of characteristics values are used to create an optical profile of the common point that is compared to a set of predefined characteristic profiles to identify the object.

Abstract: LiDAR (light detection and ranging) systems use one or more emitters and a detector array to cover a given field of view where the emitters each emit a single pulse or a multi-pulse packet of light that is sampled by the detector array. On each emitter cycle the detector array will sample the incoming signal intensity at the pre-determined sampling frequency that generates two or more samples per emitted light packet to allow for volumetric analysis of the retroreflected signal portion of each emitted light packet as reflected by one or more objects in the field of view and then received by each detector.

Abstract: A two-layer retroreflective article construction is enabled that produces higher wide-entrance-angle performance for signs and pavement markings. A single-layer overlay is enabled for existing signs and pavement markers that improve their entrance angle performance. Materials used in the construction of an article or an overlay are transparent to radiation in the range of 400 to 1000 nanometers and utilize TIR (total internal reflection). Minimum performance specifications are proposed that extend sign sheeting retroreflectivity specifications to entrance angles of 60 degrees. An innovative traffic sign design is enabled that increases the positioning performance of safety systems and automated navigation systems.

Abstract: An active-pulsed four-dimensional camera system that utilizes a precisely-controlled light source produces spatial information and human-viewed or computer-analyzed images. The acquisition of four-dimensional optical information is performed at a sufficient rate to provide accurate image and spatial information for in-motion applications where the camera is in motion and/or objects being imaged, detected and classified are in motion. Embodiments allow for the reduction or removal of image-blocking conditions like fog, snow, rain, sleet, and dust from the processed images. Embodiments provide for operation in daytime or nighttime conditions and can be utilized for day or night full-motion video capture with features like shadow removal. Multi-angle image analysis is taught as a method for classifying and identifying objects and surface features based on their optical reflective characteristics.

Abstract: An image processing system with a camera system and a processing system analyzes a series of images of a scene to assess an optical property of an object in the scene. A surface of an object that is differentiable from other objects and has a common point that can be identified and analyzed in the series of images captured from different distances of the camera system to the object and different angular orientations of the camera system relative to the object. A set of characteristic values of the image pixels corresponding to the common point is determined that include a point intensity value, a distance from the camera system to the common point, a normal vector for the common point, and an angular orientation between an optical path of the image pixel and the normal vector. The set of characteristics values are used to create an optical profile of the common point that is compared to a set of predefined characteristic profiles to identify the object.

Abstract: An active camera system images successive frames of a scene utilizing an array of detectors configured to produce a response having a linear relationship to a number of incident photons. Multi-frame capture is utilized with differentiated frame illumination for successive frames. Frame processing allows the camera to produce, at the pixel level, different image intensities representing maximum signal intensity, ambient signal intensity, and object signal intensity. The linearized response of detectors in the lighting-invariant image sensor is used to establish non-attenuated signal strength that enables shadow removal and glare removal for one or more of the image signals. Embodiments of a lighting-invariant image sensor may be used in Autonomous and Semi-Autonomous Vehicle Control/Assist Systems.

Abstract: A display system for use in a vehicle is disclosed including a camera configured to capture frames corresponding to a field of view. The camera is in communication with a processing unit configured to receive data representative of objects within the captured frames from the camera. A display is in communication with the processing unit which is configured to display objects based on the data representative of the captured frames received by the processing unit. Multi-frame capture is utilized with differential inter-frame illumination to provide low-visibility object detection and display. Adverse environmental conditions whereby image display is enhanced include fog, rain, snow, dust, nighttime, and high-glare scenarios.

Abstract: Methods, systems, and computer program products for acquiring three-dimensional LiDAR information of a scene are disclosed. According to one aspect, acquiring three-dimensional information includes emitting N pulses in a sequence with each successive pulse having a relative time shift to the sampling reference, thus producing a reconstructed sampled signal with an effective sampling rate of N times the sampling reference. According to another aspect, acquiring three-dimensional information includes emitting two or more frequencies, the differences of each pair of differing frequencies being designated as ?f, and sampling the return information with the use of a sampling reference. Frequency analysis is performed on the sampled information to determine the reference times at which the ?f signals occur and the signal intensity of the ?f signals at each time.

Abstract: An active-pulsed four-dimensional camera system that utilizes a precisely-controlled light source produces spatial information and human-viewed or computer-analyzed images. The acquisition of four-dimensional optical information is performed at a sufficient rate to provide accurate image and spatial information for in-motion applications where the camera is in motion and/or objects being imaged, detected and classified are in motion. Embodiments allow for the reduction or removal of image-blocking conditions like fog, snow, rain, sleet, and dust from the processed images. Embodiments provide for operation in daytime or nighttime conditions and can be utilized for day or night full-motion video capture with features like shadow removal. Multi-angle image analysis is taught as a method for classifying and identifying objects and surface features based on their optical reflective characteristics.

Abstract: A system for classifying different types of sheeting materials of road signs depicted in a videostream compares estimated retroreflectivity values against known minimum retroreflectivity values for each of a plurality of colors. Once a road sign has been identified in the videostream, the frames associated with that road sign are analyzed to determine each of a plurality of colors present on the road sign. An estimated retroreflectivity for each of the plurality of colors present on the road sign is then determined. By comparing the estimated retroreflectivity for each of the plurality of colors against known minimum retroreflectivity values for the corresponding color for different types of sheeting materials, an accurate determination of the classification of the sheeting material of the road sign is established. Preferably, certain conditions of gross failure of the sheeting material are filtered out before classification of the sheeting material is determined.

Abstract: An active-pulsed four-dimensional camera system that utilizes a precisely-controlled light source produces spatial information and human-viewed or computer-analyzed images. The acquisition of four-dimensional optical information is performed at a sufficient rate to provide accurate image and spatial information for in-motion applications where the camera is in motion and/or objects being imaged, detected and classified are in motion. Embodiments allow for the reduction or removal of image-blocking conditions like fog, snow, rain, sleet, and dust from the processed images. Embodiments provide for operation in daytime or nighttime conditions and can be utilized for day or night full-motion video capture with features like shadow removal. Multi-angle image analysis is taught as a method for classifying and identifying objects and surface features based on their optical reflective characteristics.

Abstract: Methods, systems, and computer program products for acquiring three-dimensional LiDAR information of a scene are disclosed. According to one aspect, acquiring three-dimensional information includes emitting N pulses in a sequence with each successive pulse having a relative time shift to the sampling reference, thus producing a reconstructed sampled signal with an effective sampling rate of N times the sampling reference. According to another aspect, acquiring three-dimensional information includes emitting two or more frequencies, the differences of each pair of differing frequencies being designated as ?f, and sampling the return information with the use of a sampling reference. Frequency analysis is performed on the sampled information to determine the reference times at which the ?f signals occur and the signal intensity of the ?f signals at each time.