Abstract: A system for determining a gaze direction of a user in a wearable device is disclosed. The system may include a display device, a primary lens, an illuminator, and a plurality of imaging device. The primary lens may be disposed in front of the display device. The illuminator may be configured to illuminate an eye of a user. The plurality of imaging devices may be disposed on or in the primary lens to detect light reflected by the eye of the user.

Abstract: A graphics presentation apparatus including a display unit, an eye-tracking module, and a data output module. The eye-tracking module registers image data representing at least one eye of a user of the apparatus. Furthermore, the eye-tracking module determines, based on the registered image data, an orientation of the at least one eye relative to the display unit. Finally, in response thereto, the eye-tracking module generates a control signal controlling the data output module to produce visual content with such orientation on the display unit that a misalignment between the orientation of said at least one part and the orientation of the at least one eye of the user is minimized.

Abstract: Disclosed herein is a system comprising a display, at least one imaging device for capturing at least one user image of at least part of the user, a determination unit connected to the at least one imaging device, said determination unit being used for determining information relating to the user's eye based on the at least one user image. The system further comprises a scene renderer connected to the display and the determination unit, the scene renderer being used to generate a first image on the display, whereby the scene renderer is configured to generate at least a partially modified image relative to the first image in real time, without the user noticing, based on the information relating to the user's eye.

Abstract: According to the invention, a system for converting sound to electrical signals is disclosed. The system may include a gaze tracking device and a microphone. The gaze tracking device may determine a gaze direction of a user. The microphone may be more sensitive in a selected direction than at least one other direction and alter the selected direction based at least in part on the gaze direction determined by the gaze tracking device.

Abstract: A computer system can be controlled with non-contact inputs, such as eye-tracking devices. A computer can enlarge a portion of a display adjacent a first gaze target in response to detecting a first action (e.g., pressing a touchpad). The computer can then allow a user to position a second gaze target in the enlarged portion (e.g., by looking at the desired location) and perform a second action in order to perform a computer function at that location. The enlarging can allow a user to identify a desired location for a computer function (e.g., selecting an icon) with greater precision.

Abstract: The present invention relates to control of a computer system, which includes a data processing unit, a display and an eye tracker adapted to register a user's gaze point with respect to the display. The data processing unit is adapted to present graphical information on the display, which includes feedback data reflecting the user's commands entered into the unit. The data processing unit is adapted to present the feedback data such that during an initial phase, the feedback data is generated based on an absolute position of the gaze point. An imaging device of the system is also adapted to register image data representing movements of a body part of the user and to forward a representation of the image data to the data processing unit. Hence, during a phase subsequent to the initial phase, the data is instead generated based on the image data.

Abstract: Techniques for generating 3D gaze predictions based on a deep learning system are described. In an example, the deep learning system includes a neural network. A scaled image is generated from 2D image showing a user face based on a rough distance between the user eyes and a camera that generated the 2D image. Image crops at different resolutions are generated from the scaled image and include a crop around each of the user eyes and a crop around the user face. These crops are input to the neural network. In response, the neural network outputs a distance correction and a 2D gaze vector per user eye. A corrected eye-to-camera distance is generated by correcting the rough distance based on the distance correction. A 3D gaze vector for each of the user eyes is generated based on the corresponding 2D gaze vector and the corrected distance.

Abstract: Techniques for generating 3D gaze predictions based on a deep learning system are described. In an example, the deep learning system includes a neural network. The neural network is trained with training images generated by cameras and showing eyes of user while gazing at stimulus points. Some of the stimulus points are in the planes of the camera. Remaining stimulus points are not un the planes of the cameras. The training includes inputting a first training image associated with a stimulus point in a camera plane and inputting a second training image associated with a stimulus point outside the camera plane. The training minimizes a loss function of the neural network based on a distance between at least one of the stimulus points and a gaze line.

Abstract: A visual display includes hidden reference illuminators adapted to emit invisible light for generating corneo-scleral reflections on an eye watching a screen surface of the display. The tracking of such reflections and the pupil center provides input to gaze tracking. A method for equipping and an LCD with a reference illuminator are also provided. Also provides are a system and method for determining a gaze point of an eye watching a visual display that includes reference illuminators. The determination of the gaze point may be based on an ellipsoidal cornea model.

Abstract: Methods and corresponding systems of controlling illuminators in an eye tracking system are disclosed. The system includes a first image sensor, a second image sensor, a first close illuminator arranged to capture bright pupil images by the first image sensor, a second close illuminator arranged to capture bright pupil images by the second image sensor and one or more far illuminators arranged to capture dark pupil images by the first image sensor and the second image sensor. In the methods main and support illuminators are controlled during exposure of a first and a second image sensor to produce enhanced contrast and glint position for eye/gaze tracking.

Abstract: Methods and corresponding systems of for the collection, transportation and analysis of attention data is disclosed. The system includes a gaze determination device, a beacon, an attention data processing engine, and a correlation engine that receives the attention data to generate correlated attention data. In the methods, correlated attention data is used to modify a content that is provided to the user in real time and is used to modify that audience of users that the content is provided to.

Abstract: Techniques for generating 3D gaze predictions based on a deep learning system are described. In an example, the deep learning system includes a neural network. The neural network is trained with training images. During the training, calibration parameters are initialized and input to the neural network, and are updated through the training. Accordingly, the network parameters of the neural network are updated based in part on the calibration parameters. Upon completion of the training, the neural network is calibrated for a user. This calibration includes initializing and inputting the calibration parameters along with calibration images showing an eye of the user to the neural network. The calibration includes updating the calibration parameters without changing the network parameters by minimizing the loss function of the neural network based on the calibration images. Upon completion of the calibration, the neural network is used to generate 3D gaze information for the user.

Abstract: According to the invention, a method for changing the behavior of computer program elements is disclosed. The method may include determining, with an eye tracking device, a gaze point of a user. The method may also include causing, with a computer system, an interactive event controlled by the computer system to alter its behavior based at least in part on the gaze point of the user.

Abstract: A wearable device is disclosed. The wearable device may include a display, a lens, an illuminator, an image sensor, and at least one processor. The display may be configured to present images. The lens may be configured to provide a view of the display to an eye of a user. The illuminator may be configured to illuminate the eye. The image sensor may be configured to detect illumination reflected by the eye. The at least one processor may be configured to cause the display to present an image, receive data from the image sensor, determine a gaze direction of the eye based at least in part on the data from the image sensor, and cause at least one of the display or the lens to be moved until the gaze direction is directed toward the image.

Abstract: An eye-tracking system (e.g., a virtual reality or augmented realty headset) can be used for eye tracking and for iris recognition. Illuminators used to illuminate eyes of a user during eye tracking can be selectively powered on and off in connection with capturing image information in order to obtain image information that suitably depicts an iris region of an eye of the user. This image information can be used to recognize the iris region and by so doing authenticate and/or identify the user.

Abstract: A portable computing device is disclosed which may include a base element, a lid element, a first motion sensor, a second motion sensor, a processor, and an eye tracking system. The first motion sensor may be disposed in the base element. The second motion sensor may be disposed in the lid element. The processor may be configured to control the first motion sensor to detect first motion information, control the second motion sensor to detect second motion information; and determine final motion information based at least in part on the first motion information and the second motion information. The eye tracking system may be configured to determine a gaze position of a user based at least in part on the final motion information, wherein the processor is further configured to execute one or more control processes based at least in part on the determined gaze position meeting a predetermined condition.

Abstract: According to the invention, a method for changing information on a display in a vehicle based on a gaze direction of a driver is disclosed. The method may include displaying information on the display in the vehicle. The method may also include receiving gaze data indicative of the gaze direction of a user. The method may further include changing the display based at least in part on the gaze data.

Abstract: Methods and systems are disclosed for assisting a user using a system including an eye tracker and a device, the device being configured to be worn on a limb of the user or held in the hands of the user. The methods and uses of systems disclosed include the steps of (1) tracking the user's gaze direction in a real world environment and determining a real world object, subject, or item the user is currently focusing on based on the user's gaze direction; and (2) providing information and/or an option to adjust at least one parameter, preferably via the device, based on the identified real world object, subject or item.

Abstract: A gaze tracking system, leaving a low power mode in response to an activation signal, initial burst of eye pictures in short time by restricting the image area of a sensor, purpose of enabling an increased frame rate. Subsequent eye pictures are captured at le rate. The first gaze point value is computed memorylessly based on the initial burst res and no additional imagery, while subsequent values may be computed recursively to account previous gaze point values or information from previous eye pictures. The restriction of the image area may be guided by a preliminary overview picture captured using the different sensor. From the gaze point values, the system may derive a control signal to a computer device with a visual display.

Abstract: A system for providing an image on a display is disclosed. The system may include a scaler chip. The scaler chip may be configured to receive video data. The scaler chip may be configured to receive eye tracking data. The scaler chip may be configured to cause a display to present an image, where the image is based on the video data and the eye tracking data.