Abstract: A method of tracking an object in an input image stream, the method comprising iteratively applying the steps of: (a) rendering a three-dimensional object model according to a previously predicted state vector from a previous tracking loop or the state vector from an initialization step; (b) extracting a series of point features from the rendered object; (c) localizing corresponding point features in the input image stream; (d) deriving a new state vector from the point feature locations in the input image stream.

Abstract: The invention relates to the application area of camera-based head and eye tracking systems. The performance of such systems typically suffers when eye glasses are worn, as the frames of the glasses interfere with the tracking of the facial features utilized by the system. This invention describes how the appearance of the glasses can be utilized by such a tracking system, not only eliminating the interference of the glasses with the tracking but also aiding the tracking of the facial features. The invention utilizes a shape model of the glasses which can be tracked by a specialized tracker to derive 3D pose information.

Abstract: A method of tracking an expected location of a head in a computerized headtracking environment having a delayed processing requirement for locating a current head position, the method comprising the step of: utilizing previously tracked positions to estimate a likely future tracked position; outputting the likely future tracked position as the expected location of the head. Kalman filtering of the previously tracked positions can be utilized in estimating the likely future tracked position.

Abstract: A method of utilizing a computer system to automatically detect the location of a face within a series of images, the method comprising the steps of: detecting eye like regions within the series of images; utilizing the eye like regions to extract potential face regions within the series of images; enhancing the facial features in the extracted potential face regions; classifying the features; and verifying the face topology within the potential face regions.

Abstract: A method of determining an eye gaze direction of an observer is disclosed comprising the steps of: (a) capturing at least one image of the observer and determining a head pose angle of the observer; (b) utilizing the head pose angle to locate an expected eye position of the observer, and (c) analyzing the expected eye position to locate at least one eye of the observer and observing the location of the eye to determine the gaze direction.