Abstract: A methodology and apparatus is described that registers images outputted by at least two video camera sensors that are not necessarily bore-sighted nor co-located together. Preferably this can be performed in real-time at least at video rate. The two video camera sensors can be either of similar or two different modalities (e.g., one can be intensified visible, while the other can be thermal infrared) each possibly with a different field-of-view. The methodology and apparatus take advantage of a combination of Inertial Measurement Units (IMUs) information and image registration between the two camera sensors from computational image processing. In one preferred embodiment, the system uses a rifle mounted weapon sight camera sensor and a helmet mounted sensor camera. The aim point of the weapon sight camera sensor (e.g., typically at the image center) zeroed to the true rifle aim point is digitally overlayed as a reticle on the video image from the helmet sensor, displayed on a head mounted display (HMD).

Abstract: A methodology for forming a composite color image fusion from a set of N gray level images takes advantage of the natural decomposition of color spaces into 2-D chromaticity planes and 1-D intensity. This is applied to the color fusion of thermal infrared and reflective domain (e.g., visible) images whereby chromaticity representation of this fusion is invariant to changes in reflective illumination.

Abstract: A methodology and apparatus is described that incorporates the use of thermal infrared imaging into a complete end-to-end face recognition system. Since thermal infrared primarily images emissive phenomenology there are advantages over video imaging in the reflective domain (e.g., visible, near-infrared) for face recognition, particularly with respect to image invariance in the presence of varying illumination incident on the subject. On the other hand video cameras in the reflective domain provide important image detail not apparent in thermal infrared imagery. Fusion of thermal infrared imagery with reflective domain (e.g., visible, near-infrared) imagery provides even further advantages. Embodiments of such systems that incorporate thermal infrared imaging for automatic face recognition are important for access control, verification, identification, and surveillance and monitoring.

Abstract: A sensor fusion system simultaneously acquires at least two images in a subspectrum of the visible/NIR/SWIR (0.4-2.0 micron) reflective spectrum and in a subspectrum of the thermal infrared (3.0-15 micron) spectral regions using respective sensing arrays viewing a common aperture. Although sensed by separate focal plane arrays, radiation enters at the front-end of a commonly shared focusing optical system so that all sensed radiation originates along exactly the same optical path and then is directed to each sensing plane. This provides precise co-registration of reflective and thermal infrared imagery regardless of the depth-of-field range of the scene being imaged, and enables the precise integration of image fusion processing and algorithms to fully exploit the complementary properties of reflected and thermally emitted radiation from a scene.

Abstract: A methodology and apparatus is described that incorporates the use of thermal infrared imaging into a complete end-to-end face recognition system. Since thermal infrared primarily images emissive phenomenology there are advantages over video imaging in the reflective domain (e.g., visible, near-infrared) for face recognition, particularly with respect to image invariance in the presence of varying illumination incident on the subject. On the other hand video cameras in the reflective domain provide important image detail not apparent in thermal infrared imagery. Fusion of thermal infrared imagery with reflective domain (e.g., visible, near-infrared) imagery provides even further advantages. Embodiments of such systems that incorporate thermal infrared imaging for automatic face recognition are important for access control, verification, identification, and surveillance and monitoring.

Abstract: A method is presented for the treatment and visualization of local contrast in n-dimensional multispectral images, which directly applies to n-dimensional multisensor images as well. A 2×2 matrix called the contrast form is defined comprised of the first derivatives of the n-dimenional image function with respect to the image plane, and a local metric defined on n-dimensional photometric space. The largest eigenvector of this 2×2 contrast form encodes the inherent local contrast at each point on the image plane. It is shown how a scalar intensity function defined on n-dimensional photometric space is used to select a preferred orientation for this eigenvector at each image point in the n-dimensional image defining the contrast vector field for an n-dimensional image.

Abstract: An apparatus for determining electrical conductivity of a surface of an object. The apparatus comprises a first polarizer for polarizing light incident upon the surface of the object. The apparatus also comprises a camera mechanism for receiving the polarized light reflected from the surface of the object and identifying the electrical conductivity of the surface of the object from phase retardance of polarization of the polarized light upon reflection from the surface of the object. The present invention pertains to a method for determining electrical conductivity of a surface of an object. The method comprises the steps of polarizing light. Next there is the step of reflecting the polarized light off the surface of the object. Then there is the step of receiving the reflected polarized light at a camera mechanism. Next there is the step of converting the received polarized light into a corresponding electrical signal with the camera mechanism.

Abstract: An apparatus comprising an optical filter which resolves electromagnetic radiation into a sequence of resolved polarization components. The apparatus is also comprised of an imaging device having a storage device. The imaging device is disposed adjacent to the optical filter to receive the sequence of resolved polarization components from the optical filter and store them in the storage device for subsequent processing. The present invention pertains to an apparatus for viewing. The apparatus comprises a frame. The apparatus also is comprised of a first optical filter mounted on the frame to cover one eye of a viewer when the viewer wears the frame. The first optical filter resolves electromagnetic radiation into a sequence of resolved polarization components so the viewer can view the sequence of resolved polarization components. The present invention also pertains to an apparatus for viewing. The apparatus is comprised of a housing.

Abstract: A polarization viewer comprising a mechanism for forming a broadview image having a spectral width greater than 2 angstroms and 0.50.degree. based on polarization information of a scene. The polarization viewer is also comprised of a mechanism for providing polarization information to the forming mechanism. The providing mechanism is in communication with the forming mechanism. In a first embodiment, the providing mechanism includes a camera mechanism in communication with the forming mechanism. The camera mechanism includes a fixed polarizer analyzer disposed such that electromagnetic radiation entering the camera mechanism passes through the polarizer analyzer. The providing mechanism can also include a mechanism for steering a polarization plane of the radiation. The steering mechanism is disposed such that radiation passing through the polarizer analyzer first passes through the steering mechanism.

Abstract: A method and apparatus for determining object characteristics such as shape and relative electrical conductivity and for resolving specular and diffuse components of reflection are disclosed. These object characteristics are determined by measuring the following polarization parameters of reflected light from the object surface: (i) the magnitude of the minimum polarization component, (ii) the magnitude of the maximum polarization component, and (ii) the directional orientation of the minimum polarization component. These parameters are used to ascertain at an object point the specular plane and the ratio of the Fresnel reflection coefficients, perpendicular to parallel, with respect to the specular plane. Both of these are used for the determination of the surface normal at object points.

Abstract: A polarization viewer comprising a mechanism for forming a broadview image having a spectral width greater than 2 angstroms and 0.50° based on polarization information of a scene. The polarization viewer is also comprised of a mechanism for providing polarization information to the forming mechanism. The providing mechanism is in communication with the forming mechanism. In a first embodiment, the providing mechanism includes a camera mechanism in communication with the forming mechanism. The camera mechanism includes a fixed polarizer analyzer disposed such that electromagnetic radiation entering the camera mechanism passes through the polarizer analyzer. The providing mechanism can also include a mechanism for steering a polarization plane of the radiation. The steering mechanism is disposed such that radiation passing through the polarizer analyzer first passes through the steering mechanism.