Abstract: A computationally efficient missile detection and tracking system, operating on data samples from a focal plane assembly (FPA) of an electro-optical sensor which is observing the earth and space, detects missiles, aircraft, resident space objects or other objects in the presence of background clutter, determines missile types and estimates missile position and velocity components in an inertial reference frame. Digitized samples from an array of electro-optical detectors which are viewing the earth and/or space are processed to detect and track missiles, aircraft and resident space objects. Streak detection is used for this purpose, where the target is separated from a background scene by exploiting target motion relative to the background scene. This processing system provides superior performance and simplified implementation as compared to conventional methods. The weight and power of a computer which can implement the processing system is much reduced as compared to conventional implementation.