Abstract: A three-dimensional, real-time, multi-phenomenology data reconstruction and fusion system and method are described for scanning bags, luggage, and the like. The approach blends 3D computed topography with other sensing modalities such as magnetic resonance and an embedded decision-directed data reconstruction/exploitation structure to ensure high performance and real-time operation. A 2D array architecture provides sets of 2D projections immediately, which can be exploited as a precursor to a full 3D data reconstruction and exploitation to enhance system speed. Various processing algorithms to determine object type and next best view or reconstructed slice for fast operation at high classification rates; to provide significantly enhanced impulse response performance, such that subtle details are not obscured by bright scattering objects; and to exploit both the multi-modality data and exploited entities for explosive detection, for example.