Abstract: A segment labeler/extractor outputs segments of video data stored in Random Access Memory for feature extraction and classification as targets. This function is accomplished by labeling the segments of a video frame as the segments are stored in a mass segment memory, sorting the mass segment memory to extract individual segment data, and storing this data in a segment memory where it can be accessed by an algorithm processor. Included in the subject invention is a segment labeler which consists of a segment label filter, adjacent label filter, memory, and sorter. The inputs to the segment labeler are a segment designator discrete which is set for only pixels which are in segments and a segment boundary designation discrete which is set for only pixels which are in segments and on the perimeter of the segment. The output of the segment labeler is a unique group of labels which define each segment. The groups of labels are then passed on to a control processor and handed to a segment extractor upon request.