Abstract: Techniques are provided for detection, classification and tracking of surface contacts based on multispectral image data from sensors on maritime assets. An example system may include an anomaly detection circuit configured to detect an object based on anomalies in the variance of pixels of water surface image data. The system may also include an object motion tracking circuit configured to analyze motion of the object relative to water surface waves. The analysis may compensate for motion of the asset and sensors. The system may further include an object classification circuit configured to classify the object as an object of interest, based on the analyzed motion of the object, and as a threat, further based on size estimation, edge detection, surface texture analysis, and volume analysis. The range from the asset to the object may be estimated based on the relation of the object to a detected or estimated horizon line.