Abstract: A methodology and apparatus is described that registers images outputted by at least two video camera sensors that are not necessarily bore-sighted nor co-located together. Preferably this can be performed in real-time at least at video rate. The two video camera sensors can be either of similar or two different modalities (e.g., one can be intensified visible, while the other can be thermal infrared) each possibly with a different field-of-view. The methodology and apparatus take advantage of a combination of Inertial Measurement Units (IMUs) information and image registration between the two camera sensors from computational image processing. In one preferred embodiment, the system uses a rifle mounted weapon sight camera sensor and a helmet mounted sensor camera. The aim point of the weapon sight camera sensor (e.g., typically at the image center) zeroed to the true rifle aim point is digitally overlayed as a reticle on the video image from the helmet sensor, displayed on a head mounted display (HMD).

Abstract: A methodology for forming a composite color image fusion from a set of N gray level images takes advantage of the natural decomposition of color spaces into 2-D chromaticity planes and 1-D intensity. This is applied to the color fusion of thermal infrared and reflective domain (e.g., visible) images whereby chromaticity representation of this fusion is invariant to changes in reflective illumination.

Abstract: A methodology and apparatus is described that incorporates the use of thermal infrared imaging into a complete end-to-end face recognition system. Since thermal infrared primarily images emissive phenomenology there are advantages over video imaging in the reflective domain (e.g., visible, near-infrared) for face recognition, particularly with respect to image invariance in the presence of varying illumination incident on the subject. On the other hand video cameras in the reflective domain provide important image detail not apparent in thermal infrared imagery. Fusion of thermal infrared imagery with reflective domain (e.g., visible, near-infrared) imagery provides even further advantages. Embodiments of such systems that incorporate thermal infrared imaging for automatic face recognition are important for access control, verification, identification, and surveillance and monitoring.

Abstract: A sensor fusion system simultaneously acquires at least two images in a subspectrum of the visible/NIR/SWIR (0.4-2.0 micron) reflective spectrum and in a subspectrum of the thermal infrared (3.0-15 micron) spectral regions using respective sensing arrays viewing a common aperture. Although sensed by separate focal plane arrays, radiation enters at the front-end of a commonly shared focusing optical system so that all sensed radiation originates along exactly the same optical path and then is directed to each sensing plane. This provides precise co-registration of reflective and thermal infrared imagery regardless of the depth-of-field range of the scene being imaged, and enables the precise integration of image fusion processing and algorithms to fully exploit the complementary properties of reflected and thermally emitted radiation from a scene.

Abstract: A methodology and apparatus is described that incorporates the use of thermal infrared imaging into a complete end-to-end face recognition system. Since thermal infrared primarily images emissive phenomenology there are advantages over video imaging in the reflective domain (e.g., visible, near-infrared) for face recognition, particularly with respect to image invariance in the presence of varying illumination incident on the subject. On the other hand video cameras in the reflective domain provide important image detail not apparent in thermal infrared imagery. Fusion of thermal infrared imagery with reflective domain (e.g., visible, near-infrared) imagery provides even further advantages. Embodiments of such systems that incorporate thermal infrared imaging for automatic face recognition are important for access control, verification, identification, and surveillance and monitoring.

Abstract: A method is presented for the treatment and visualization of local contrast in n-dimensional multispectral images, which directly applies to n-dimensional multisensor images as well. A 2×2 matrix called the contrast form is defined comprised of the first derivatives of the n-dimenional image function with respect to the image plane, and a local metric defined on n-dimensional photometric space. The largest eigenvector of this 2×2 contrast form encodes the inherent local contrast at each point on the image plane. It is shown how a scalar intensity function defined on n-dimensional photometric space is used to select a preferred orientation for this eigenvector at each image point in the n-dimensional image defining the contrast vector field for an n-dimensional image.

Abstract: A polarization viewer comprising a mechanism for forming a broadview image having a spectral width greater than 2 angstroms and 0.50° based on polarization information of a scene. The polarization viewer is also comprised of a mechanism for providing polarization information to the forming mechanism. The providing mechanism is in communication with the forming mechanism. In a first embodiment, the providing mechanism includes a camera mechanism in communication with the forming mechanism. The camera mechanism includes a fixed polarizer analyzer disposed such that electromagnetic radiation entering the camera mechanism passes through the polarizer analyzer. The providing mechanism can also include a mechanism for steering a polarization plane of the radiation. The steering mechanism is disposed such that radiation passing through the polarizer analyzer first passes through the steering mechanism.