Abstract: A method for determining a current gaze direction of a user in relation to a three-dimensional (“3D”) scene, the 3D scene sampled by a rendering function to produce a two-dimensional (“2D”) projection image of the 3D scene, the sampling performed based on a virtual camera in turn being associated with a camera position and camera direction in the 3D scene. The method includes determining, by a gaze direction detection means, a first gaze direction of the user related to the 3D scene at a first gaze time point. The method includes determining a time-dependent virtual camera 3D transformation representing a change of a virtual camera position and/or virtual camera direction between the first gaze time point and a second sampling. The method includes determining the current gaze direction as a modified gaze direction calculated based on the first gaze direction and an inverse of the time-dependent virtual camera 3D transformation.

Abstract: The present invention provides improved methods and systems for assisting a user when interacting with a graphical user interface by combining gaze based input with gesture based user commands. The present invention provide systems, devices and method that enable a user of a computer system without a traditional touch-screen to interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. Furthermore, the present invention offers a solution for touch-screen like interaction using gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen, such as for instance in situations where interaction with the regular touch-screen is cumbersome or ergonomically challenging.

Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second ex

Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.

Abstract: Disclosed is a method for detecting a shadow in an image of an eye region of a user wearing a Head Mounted Device, HMD. The method comprises obtaining, from a camera of the HMD, an image of the eye region of the user wearing a HMD and determining an area of interest in the image, the area of interest comprising a plurality of subareas. The method further comprises determining a first brightness level for a first subarea of the plurality of subareas and determining a second brightness level for a second subarea of the plurality of subareas. The method further comprises comparing the first brightness level with the second brightness level, and, based on the comparing, selectively generating a signal indicating a shadow.

Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.

Abstract: A method for controlling the transparency level of a transparent displaying device arranged to display one or more virtual objects, the method comprising the steps of: obtaining a gaze point of a user; obtaining a position of at least one virtual object displayed by the displaying device; determining whether the attention of the user is directed to the virtual object based on the obtained gaze point; and if so, adjusting a transparency level of the displaying device. A system operative for controlling the transparency level in a displaying device, as well as a displaying device comprising such a system is also disclosed.

Abstract: Techniques for distributed foveated rendering based on user gaze are described. In an example, an end user device is communicatively coupled with a remote computer and presents images on a display based on gaze data. The user device receives a low resolution background image and high resolution foreground image from the remote computer based on the gaze data. The foreground image is constrained to a foveated region according to the gaze data. The end user device generates a composite image by scaling up the background image and overlaying the foreground image. The composite image is then presented on the display.

Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.

Abstract: A method for improved compression and filtering of images for foveated transport applications. The improvements including calculating along at least one axis of the full-resolution image data set, the distance from the foveal point to edges of full-resolution image data set, calculating the distance from each edge of the full resolution data set to the closest point on a foveal region surrounding the foveal point, calculating the distribution of available space in the adjacent peripheral regions of the image using a compression parameter, and calculating a compression curve wherein the compression of both adjacent peripheral regions is such that neither side of the adjacent peripheral regions are compressed more than the other.

Abstract: The invention is related to a method and system for calibrating an eye tracking device configured to track a gaze point of a user on a display The method comprises: presenting a video on the display to a user, the video having a start size and a start position; tracking the gaze of the user, using an image sensor of the eye tracking device; and sequentially completing, for at least one calibration position, the steps of: resizing the video to a calibration size, wherein the calibration size is smaller than the start size, and translating the video to a calibration position; recording calibration data, using the eye tracking device, for the user viewing the video in the calibration position; and resizing the video to a second size that is greater than the start size.

Abstract: The invention is related to an eye tracking system for determining reference gaze data of a user in a scene exposing a pupil of the user.

Abstract: Head pose information may be determined using information describing a fixed gaze and image data corresponding to a user's eyes. The head pose information may be determined in a manner that is disregards facial features with the exception of the user's eyes. The head pose information may be usable to interact with a user device.

Abstract: A computer-implemented method of selecting a sequence of images of a user's eye for an eye tracking application wherein each image is captured when a stationary stimulus point is displayed to the user, the method comprising: for a plurality of different pairs of the images: comparing the pair of images with each other to determine an image-score that represents a degree of difference between the compared images; and calculating a sequence-score based on the image-scores for the plurality of pairs of images.

Abstract: A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.

Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit.

Abstract: There is provided systems, methods and computer program products for generating motion blur on image frames, comprising: obtaining gaze data related to an eye movement between consecutive images, determining movement of at least one object in relation to said gaze data by calculating the difference in position of said at least one object and said gaze data between the image frames, forming a motion blur vector and applying a motion blur on an image frame based on said motion blur vector.

Abstract: Techniques for controlling light sources used in eye tracking are described. In an example, an eye tracking system generates a first image and a second image showing at least a portion of the user eye illuminated by a predetermined set of illuminators of the eye tracking system. The eye tracking system determines a first position of a glint in the first image and a second position of the glint in the second image. Each of the first position and the second position is relative to a pupil edge. The eye tracking system predicts a third position of the glint relative to the pupil edge based on the first position and the second position. Further, the eye tracking system determines, from the predetermined set, an illuminator that corresponds to the glint and determines, based on the third position, whether to power off the illuminator to generate a third image of at least the portion of the user eye.

Abstract: A computer system can be controlled with non-contact inputs through zonal control. In an embodiment, a non-contact input that is an eye-tracking device is used to track the gaze of a user. A computer's display, and beyond, can be separated into a number of discrete zones according to a configuration. Each zone is associated with a computer function. The zones and/or their functions can, but need not, be indicated to the user. The user can perform the various functions by moving gaze towards the zone associated with that function and providing an activation signal of intent. The activation signal of intent can be a contact-required or non-contact action, such as a button press or dwelling gaze, respectively.

Abstract: Computer display privacy and security for computer systems. In one aspect, the invention provides a computer-controlled system for regulating the interaction between a computer and a user of the computer based on the environment of the computer and the user. For example, the computer-controlled system provided by the invention comprises an input-output device including an image sensor configured to collect facial recognition data proximate to the computer. The system also includes a user security parameter database encoding security parameters associated with the user; the database is also configured to communicate with the security processor. The security processor is configured to receive the facial recognition data and the security parameters associated with the user, and is further configured to at least partially control the operation of the data input device and the data output device in response to the facial recognition data and the security parameters associated with the user.