Abstract: A system and method for processing acquired images to develop useful classifications of subjects such as occupants of a vehicle preferably employs a hierarchical and probabilistic structure, such as a Bayesian Network to analyze acquired images and produce a meaningful classification. The structure preferably includes set of analyzers, a set of Scenario analyzers and a set of Temporal models which are arranged in three respective hierarchical layers. Each respective analyzer operates on the acquired image and, in some circumstances, feedback from the Scenario analyzers, to produce an output representing the probability that a feature that the respective analyzer is concerned with is present in the acquired image.