Abstract: A method and system for simultaneously recognizing contextually related images is disclosed. The image of two separate fields is captured to form two captured data images such as a word and numerical amount. Each captured image is cut to form a segmentation graph based on the cuts. The shortest path in each segmentation graph is found wherein the additive length corresponds to a score and is associated with each directed arc of the segmentation graph. The segmentation graphs are combined into a joint segmentation graph and the highest scoring mutually consistent interpretations are found.