Abstract: Methods and systems for gaze assisted interaction with a pointing device on a display screen. In response to receiving an activation input, a user's point of gaze (POG) on a display is received and a gaze region of the display corresponding to the POG is extracted, enlarged and transposed on the display according to a first cursor location, generating an interaction region on the display. A user interaction with the pointing device at a second cursor location on the display associated with the interaction region is intercepted in a system hook, mapped to a location on the display corresponding to the gaze region and passed to an application. The disclosed method and system may enable improved GUI interaction with pointing devices on displays while overcoming challenges associated with the precision of eye-gaze assisted interaction, including the impact of eye jittering on gaze estimation.

Abstract: Systems and methods are described for performing a computer vision task on a sequence of frames. A first frame and a second frame are obtained, corresponding to a first timestep and a second timestep, respectively, in a sequence of frames. A differential image is computed between the first frame and the second frame. A predicted output is generated by forward propagating the differential image through a neural network that is trained to perform a computer vision task.