Abstract: A method and apparatus for tracking of objects in video images. The tracking process includes the steps of: receiving an initial image with the object to be tracked; performing a color histogram on the initial image in the region where the object is located; receiving the next frame of the video sequence and specifying candidate regions in that image; using color histogram analysis on the candidate regions to find a match performing motion analysis to correct the analysis and to provide a prediction for the next frame; and, identifying and providing the tracked object's image for output. Apparatus that can use this method can be either video capture or video display. In video capture, a user interface allows the user to designate the object to be tracked during capture. The tracking module than controls the capture system to track that object. In video display systems, a user interface allows the user to identify the object in the display that should be tracked.