Abstract: A gaze tracking model is adapted to predict a gaze ray using an image of the eye. The model is trained using training data which comprises a first image of an eye, reference gaze data indicating a gaze point towards which the eye was gazing when the first image was captured, and images of an eye captured by first and second cameras at a point in time. The training comprises forming a distance between the gaze point and a gaze ray predicted by the model using the first image, forming a consistency measure based on a gaze ray predicted by the model using the image captured by the first camera and a gaze ray predicted by the model using the image captured by the second camera, forming an objective function based on at least the formed distance and the consistency measure, and training the model using the objective function.

Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.

Abstract: Data packets containing gaze data are streamed from an eyetracker to a client via a driver unit by receiving, repeatedly, gaze data packets in a first interface; and, providing, repeatedly, via a second interface, gaze data packets. The client sends a request message to the driver unit. The request message defines a delivery point in time in a first time frame structure at which delivery point in time in each frame of the first time frame structure the gaze data packet shall be provided to the client via the second interface. An offset is calculated between a reception point in time and the delivery point in time. The reception point in time indicates when a gaze data packet is received from the eyetracker relative to the first time structure. An adjusted data acquisition instance is assigned based on the offset. The adjusted data acquisition instance represents a modified point in time in a second time frame structure when at least one future gaze data packet shall be produced by the eyetracker.

Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.

Abstract: The present disclosure generally relates to the field of eye tracking systems. An eye tracking system is provided. The eye tracking system comprises an illuminator arrangement, including at least one light source, configured to illuminate an eye of a user. The eye tracking system is configured to enable a reduction of reflections from an optic arrangement (e.g., a pair of glasses) that is located in a light beam path between the illuminator arrangement and the eye when the eye tracking system is in use. The illuminator arrangement is configured to emit p-polarized light to be incident on a surface of the optic arrangement at an angle corresponding to, or substantially corresponding to, Brewster's angle.

Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second ex

Abstract: Systems and methods for gaze origin selection based on dominant eye shift of a user. Systems and methods described herein include eye tracking devices and computing devices. The first eye is initially set as the dominant eye. A first gaze ray for the first eye and a second gaze ray for a second eye are determined by an eye tracking system. The first gaze ray intersects a first object and the second gaze ray intersects a second object within the field of view, at a first depth and a second depth respectively. A convergence depth of the first gaze ray and the second gaze ray is determined and compared against the first depth and the second depth. When a second offset between the second depth and the convergence depth is smaller than a first offset between the first depth and the convergence depth, the second eye is set as the dominant eye.

Abstract: Techniques for data sharing between two computing devices are described. In an example, a computer system determines a first presence of a first user relative to a first computing device. The computer system also determines a first identifier of the first user. The first identifier is associated with operating the first computing device. The operating comprises sharing data with a second computing device. The computer system also determines a second presence of a second user relative to the second computing device. The computer system also determines a second identifier of the second user. The second identifier associated with operating the second computing device. The computer system cause the data to be shared with the second computing device based on the first presence, the first identifier, the second presence, and the second identifier.

Abstract: A preliminary path for light travelling towards a camera via corneal reflection is estimated based on a preliminary position and orientation of an eye. A position where the reflection would appear in images captured by the camera is estimated. A distance is formed between a detected position of a corneal reflection of an illuminator and the estimated position. A second preliminary path for light travelling through the cornea or from the sclera towards a camera is estimated based on the preliminary position and orientation, and a position where the second preliminary path would appear to originate in images captured by this camera is estimated. A distance is formed between a detected edge of a pupil or iris and the estimated position where the second preliminary path would appear to originate. An updated position and/or orientation of the eye is determined using an objective function formed based on the formed distances.

Abstract: Head pose information may be determined using information describing a fixed gaze and image data corresponding to a user's eyes. The head pose information may be determined in a manner that is disregards facial features with the exception of the user's eyes. The head pose information may be useable to interact with a user device.

Abstract: Computer display privacy and security for computer systems. In one aspect, the invention provides a computer-controlled system for regulating the interaction between a computer and a user of the computer based on the environment of the computer and the user. For example, the computer-controlled system provided by the invention comprises an input-output device including an image sensor configured to collect facial recognition data proximate to the computer. The system also includes a user security parameter database encoding security parameters associated with the user; the database is also configured to communicate with the security processor. The security processor is configured to receive the facial recognition data and the security parameters associated with the user, and is further configured to at least partially control the operation of the data input device and the data output device in response to the facial recognition data and the security parameters associated with the user.

Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.

Abstract: A method for detecting the physical presence of a person at an expected person location, the method comprising the steps: a) providing a sensor device comprising one or several sensors, the sensor device being arranged to perform at least one high-power type measurement and at least one low-power type measurement, wherein the sensor device comprises at least one image sensor arranged to depict the person by a measurement of said high-power type, and wherein each of said low-power type measurements over time requires less electric power for operation as compared to said high-power type measurement; b) the sensor device detecting said potential presence of the person using at least one of said low-power type measurements; c) using one of said high-power type measurements, the sensor device producing an image depicting the person and detecting the presence of the person based on image analysis of said image; d) using at least one of said low-power type measurements, the sensor device detecting a maintained pr

Abstract: Disclosed is a method for calibrating an eye-tracking device to suit a user of the eye-tracking device, wherein a calibration setting of the eye-tracking device—associated with a user is calculated based on acquired eye data of the user when looking at a set of reference points. The method comprises displaying a reference point of the set to the user; acquiring, by means of at least one camera of the eye-tracking device, eye data for at least one of the eyes of the user when looking at the reference point; comparing the acquired eye data to stored eye data sets related to the reference point, wherein each of the stored eye data sets is associated with a calibration setting of the eye-tracking device; and if the acquired eye data matches one of the stored eye data sets, abandoning the calibration process and loading the calibration setting associated with the matching stored eye data.

Abstract: Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device displays a representation of a second user on a display of the first computing device. Further, the first computing device receives from the first user, communication data generated by an input device. The first computing device determines if the gaze direction of the first user is directed to the representation of the second user. If the gaze direction of the first user is directed to the representation of the second user, the first computing device transmits the communication data to a second computing device of the second user.

Abstract: According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.

Abstract: The present disclosure relates to a method for calibrating a camera of a head-mounted display, HMD. The method comprises providing a calibration target in front of a lens of the HMD. Each of the calibration target and the lens basically extend in a corresponding two-dimensional plane. The method further comprises determining a lateral position of the calibration target. The lateral position relates to a position of the calibration target in the two-dimensional plane. The method even further comprises determining a lateral position of the lens. The lateral position relates to a position of the lens in the two-dimensional plane. The method yet even further comprises determining a calibration target misalignment based on the determined lateral position of the calibration target and based on the determined lateral position of the lens. The method also comprises performing a hardware calibration of the HMD. The hardware calibration is adapted for the calibration target misalignment.

Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit.

Abstract: An eye tracking system, a head mounted device, a computer program, a carrier and a method in an eye tracking system for determining a refined gaze point of a user are disclosed. In the method a gaze convergence distance of the user is determined. Furthermore, a spatial representation of at least a part of a field of view of the user is obtained and depth data for at least a part of the spatial representation are obtained. Saliency data for the spatial representation are determined based on the determined gaze convergence distance and the obtained depth data, and a refined gaze point of the user is determined based on the determined saliency data.

Abstract: There is disclosed a computer implemented eye tracking system and corresponding method and computer readable storage medium, for detecting three dimensional, 3D, gaze, by obtaining at least one head pose parameter using a head pose prediction algorithm, the head pose parameter(s) comprising one or more of a head position, pitch, yaw, or roll; and to input the at least one head pose parameter along with at least one image of a user's eye, generated from a 2D image captured using an image sensor associated with the eye tracking system, into a neural network configured to generate 3D gaze information based on the at least one head pose parameter and the at least one eye image.