Abstract: A system and methods are provided to manage gestures and positional data from a pointing device, considering an attention sensing device with known accuracy characteristics. The method uses the state of the user's attention and the pointing device data as input, mapping them against predefined regions on the device's screen(s). It then uses both the mapping results and raw inputs to affect the device, such as sending instructions or moving the pointing cursor.

Abstract: A system and an apparatus are provided, for gaze tracking within a defined operating range. The apparatus includes at least one optical system, which capable of capturing radiation in a wavelength range produced by a composite illumination source. The apparatus also includes at least one set of illumination sources creating the composite illumination source, wherein: at least one of the illumination sources is positioned relative to the optical system such that it ensures a user bright pupil response at the beginning of the apparatus operating range; and the composite illumination source size is such that it creates a Purkinje image on a user's eye capable of being distinguished by the optical system at the end of the apparatus operating range. The apparatus also includes an illumination controller for activating and deactivating the at least one composite illumination source, and a signal processing controller for transmitting generated images from the at least one optical system.

Abstract: A method is provided for estimating the orientation of a user's eyes in a scene in a system-agnostic manner. The method approximates pose-invariant, user-independent feature vectors by transforming the input coordinate to a pose-invariant coordinate and then normalizing the data considering the statistical distributions of previously collected data used to create a learned mapping method. It then uses the learned mapping method to estimate the orientation of the user's eyes in the pose invariant coordinate system, and finalizes by transforming these to a world coordinate system.

Abstract: A system and methods are provided to manage gestures and positional data from a pointing device, considering an attention sensing device with known accuracy characteristics. The method uses the state of the user's attention and the pointing device data as input, mapping them against predefined regions on the device's screen(s). It then uses both the mapping results and raw inputs to affect the device, such as sending instructions or moving the pointing cursor.

Abstract: A system and method are provided that use eye gaze as a pointing or selection tool, which enables hands-free operation of a display such as a television. wherein the use of eye gaze as an input can also lead to easier and faster interactions when compared to traditional remote controls. A system and method are also provided that use eye tracking on displays such as televisions to determine what content was viewed and, by association, what content was of most interest to the user. Systems and methods are also described that enable interaction with elements displayed in an augmented reality environment using gaze tracking and for controlling gaze tracking on a portable electronic device.

Abstract: A method is provided for determining a point of gaze directed at a graphical display. The method comprises: a) acquiring an image of at least one eye of a user containing at least one gaze aspect and at least one reference aspect; b) extracting image aspects from the image, the image aspects comprising a set of reference aspects and a set of gaze aspects corresponding to the image; c) extracting a set of features for each of said image aspects; d) computing a set of feature vectors between said set of gaze aspects and said set of reference aspects; e) computing a point of gaze for each of said set of feature vectors, using a predefined mathematical relationship; and f) using a predefined rule to combine the computed points of gaze into a final point of gaze on the graphical display.

Abstract: A system and method are provided for object tracking in a scene over time. The method comprises obtaining tracking data from a tracking device, the tracking data comprising information associated with at least one point of interest being tracked; obtaining position data from a scene information provider, the scene being associated with a plurality of targets, the position data corresponding to targets in the scene; applying a probabilistic graphical model to the tracking data and the target data to predict a target of interest associated with an entity being tracked; and performing at least one of: using the target of interest to determine a refined point of interest; and outputting at least one of the refined point of interest and the target of interest.

Abstract: A system and method are provided for calibrating an eye gaze tracking system. The method comprises obtaining gaze data; obtaining at least one key point corresponding to a portion of media content being displayed; linking the gaze data to the at least one key point; and generating one or more calibration parameters by comparing gaze data with associated ones of the at least one key point.

Abstract: A system and method are provided for performing eye gaze tracking. The system is configured for and the method comprises optimizing illumination of a scene for a single on-axis imaging apparatus, capturing an image using the single on-axis imaging apparatus under the optimized illumination, and processing the captured image to perform a gaze estimation. Dynamic illumination control, eye candidate detection and filtering, and gaze estimation techniques are also provided.

Abstract: Methods for determining a point-of-gaze (POG) of a user in three dimensions are disclosed. In particular embodiments, the methods involve: presenting a three-dimensional scene to both eyes of the user; capturing image data including both eyes of the user; estimating first and second line-of-sight (LOS) vectors in a three-dimensional coordinate system for the user's first and second eyes based on the image data; and determining the POG in the three-dimensional coordinate system using the first and second LOS vectors.

Abstract: A system and method are provided that use point of gaze information to determine what portions of 3D media content are actually being viewed to enable a 3D media content viewing experience to be improved. Tracking eye movements of viewers to obtain such point of gaze information are used to control characteristics of the 3D media content during consumption of that media, and/or to improve or otherwise adjust or refine the 3D media content during creation thereof by a media content provider. Outputs may be generated to illustrate what in the 3D media content was viewed at incorrect depths. Such outputs may then be used in subsequent or offline analysis, e.g., by editors for media content providers when generating the 3D media itself, in order to gauge the 3D effects. A quality metric can be computed based on the point of gaze information, which can be used to analyze the interactions between viewers and the 3D media content being displayed.