Patents Assigned to TOBII AB
  • Patent number: 11061473
    Abstract: A method of updating a cornea model for a cornea of an eye is disclosed, as well as a corresponding system and storage medium. The method comprises controlling a display to display a stimulus at a first depth, wherein the display is capable of displaying objects at different depths, receiving first sensor data obtained by an eye tracking sensor while the stimulus is displayed at the first depth by the display, controlling the display to display a stimulus at a second depth, wherein the second depth is different than the first depth, receiving second sensor data obtained by the eye tracking sensor while the stimulus is displayed at the second depth by the display, and updating the cornea model based on the first sensor data and the second sensor data.
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: July 13, 2021
    Assignee: Tobii AB
    Inventors: Mark Ryan, Jonas Sjöstrand, Erik Lindén, Pravin Rana
  • Publication number: 20210208403
    Abstract: A method for controlling the transparency level of a transparent displaying device arranged to display one or more virtual objects, the method comprising the steps of: obtaining a gaze point of a user; obtaining a position of at least one virtual object displayed by the displaying device; determining whether the attention of the user is directed to the virtual object based on the obtained gaze point; and if so, adjusting a transparency level of the displaying device. A system operative for controlling the transparency level in a displaying device, as well as a displaying device comprising such a system is also disclosed.
    Type: Application
    Filed: December 17, 2020
    Publication date: July 8, 2021
    Applicant: Tobii AB
    Inventor: Henrik Andersson
  • Patent number: 11054903
    Abstract: An eyetracker obtains a digital image representing at least one eye of a subject. The eyetracker then searches for pupil candidates in the digital image according to a search algorithm and, based on the searching, determines a position for the at least one eye in the digital image. The eyetracker also obtains light-intensity information expressing an estimated amount of light energy exposing the at least one eye when registering the digital image. In response to the light-intensity information, the eye-tracker determines a range of pupil sizes. The search algorithm applies the range of pupil sizes in such a manner that a detected pupil candidate must have size within the range of pupil sizes to be accepted by the search algorithm as a valid pupil of the subject.
    Type: Grant
    Filed: June 26, 2020
    Date of Patent: July 6, 2021
    Assignee: Tobii AB
    Inventor: Richard Andersson
  • Publication number: 20210199957
    Abstract: An eye-tracking system for performing a pupil-detection process, the eye-tracking system configured to: receive image-data comprising a plurality of pixel-arrays, each pixel-array having a plurality of pixel locations and an intensity-value at each of the pixel locations; for each pixel location of a region of pixel locations: define an intensity-value-set comprising the intensity-values at the pixel location for two or more of the plurality of pixel-arrays; and determine the pixel location to be an excluded pixel location if the intensity-value-set does not satisfy an intensity condition; and exclude the excluded pixel locations from the pupil-detection process.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Applicant: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Johannes Kron
  • Patent number: 11042205
    Abstract: A personal computer system comprises a visual display, an imaging device adapted to provide eye-tracking data by imaging at least one eye of a viewer of the visual display, and identifying means for recognizing the viewer with reference to one of a plurality of predefined personal profiles. The personal computer system further comprises an eye-tracking processor for processing the eye-tracking data. According to the invention, the eye-tracking processor is selectively operable in one of a plurality of personalized active sub-modes associated with said personal profiles. The sub-modes may differ with regard to eye-tracking related or power-management related settings. Further, the identifying means may sense an identified viewer's actual viewing condition (e.g., use of viewing aids or wearing of garments), wherein the imaging device is further operable in a sub-profile mode associated with the determined actual viewing condition.
    Type: Grant
    Filed: October 16, 2017
    Date of Patent: June 22, 2021
    Assignee: Tobii AB
    Inventors: John Mikael Elvesjö, Anders Kingbäck, Gunnar Troili, Mårten Skogö, Henrik Eskilsson, Peter Blixt
  • Publication number: 20210173477
    Abstract: A method for determining gaze calibration parameters for gaze estimation of a viewer using an eye-tracking system. The method comprises obtaining a set of data points including gaze tracking data of the viewer and position information of at least one target visual; selecting a first subset of the data points and determining gaze calibration parameters using said first subset. A score for the gaze calibration parameters is determined by using the gaze calibration parameters with a second subset of data points, wherein at least one data point of the subset is not included in the first subset. The score is indicative of the capability of the gaze calibration parameters to reflect position information of the at least one target visual based on the gaze tracking data. The score is compared to a candidate score and if it is higher, the calibration parameters are set to the candidate calibration parameters and the score to the candidate score.
    Type: Application
    Filed: November 16, 2020
    Publication date: June 10, 2021
    Applicant: Tobii AB
    Inventors: Patrik Barkman, David Molin
  • Publication number: 20210173479
    Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.
    Type: Application
    Filed: December 10, 2020
    Publication date: June 10, 2021
    Applicant: Tobii AB
    Inventor: Andreas Klingström
  • Patent number: 11023040
    Abstract: Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device determines if the gaze direction of the first user is directed to a first display. Further, the first computing device receives information regarding if a gaze direction of a second user is directed to a second display. If the gaze direction of the first user is directed to the first display and the gaze direction of the second user is directed to the second display, the first computing device continuously updates content on the first display. If the gaze direction of the second user is not directed to the second display, the first computing device pauses the content on the first display.
    Type: Grant
    Filed: September 19, 2018
    Date of Patent: June 1, 2021
    Assignee: Tobii AB
    Inventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Andrew Ratcliff, Regimantas Vegele, Geoffrey Cooper, Niklas Blomqvist
  • Publication number: 20210141451
    Abstract: A computer system can be controlled with non-contact inputs, such as eye-tracking devices. A computer can enlarge a portion of a display adjacent a first gaze target in response to detecting a first action (e.g., pressing a touchpad). The computer can then allow a user to position a second gaze target in the enlarged portion (e.g., by looking at the desired location) and perform a second action in order to perform a computer function at that location. The enlarging can allow a user to identify a desired location for a computer function (e.g., selecting an icon) with greater precision.
    Type: Application
    Filed: January 22, 2021
    Publication date: May 13, 2021
    Applicant: Tobii AB
    Inventors: Erland George-Svahn, David Figgins Henderek, Rebecka Lannsjö, Mårten Skogö, John Elvesjö
  • Patent number: 11003936
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: May 11, 2021
    Assignee: Tobii AB
    Inventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
  • Patent number: 10996751
    Abstract: A gaze tracking model is adapted to predict a gaze ray using an image of the eye. The model is trained using training data which comprises a first image of an eye, reference gaze data indicating a gaze point towards which the eye was gazing when the first image was captured, and images of an eye captured by first and second cameras at a point in time. The training comprises forming a distance between the gaze point and a gaze ray predicted by the model using the first image, forming a consistency measure based on a gaze ray predicted by the model using the image captured by the first camera and a gaze ray predicted by the model using the image captured by the second camera, forming an objective function based on at least the formed distance and the consistency measure, and training the model using the objective function.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: May 4, 2021
    Assignee: Tobii AB
    Inventors: David Mohlin, Erik Lindén
  • Patent number: 10983359
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: April 20, 2021
    Assignee: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Publication number: 20210109591
    Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
    Type: Application
    Filed: February 15, 2019
    Publication date: April 15, 2021
    Applicant: Tobii AB
    Inventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
  • Publication number: 20210112107
    Abstract: Data packets containing gaze data are streamed from an eyetracker to a client via a driver unit by receiving, repeatedly, gaze data packets in a first interface; and, providing, repeatedly, via a second interface, gaze data packets. The client sends a request message to the driver unit. The request message defines a delivery point in time in a first time frame structure at which delivery point in time in each frame of the first time frame structure the gaze data packet shall be provided to the client via the second interface. An offset is calculated between a reception point in time and the delivery point in time. The reception point in time indicates when a gaze data packet is received from the eyetracker relative to the first time structure. An adjusted data acquisition instance is assigned based on the offset. The adjusted data acquisition instance represents a modified point in time in a second time frame structure when at least one future gaze data packet shall be produced by the eyetracker.
    Type: Application
    Filed: August 31, 2020
    Publication date: April 15, 2021
    Applicant: Tobii AB
    Inventors: Anders Clausen, Daniel Tornéus
  • Publication number: 20210099631
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second ex
    Type: Application
    Filed: September 30, 2020
    Publication date: April 1, 2021
    Applicant: Tobii AB
    Inventors: Magnus Ivarsson, Niklas Ollesson, Viktor Åberg, Anna Redz
  • Publication number: 20210097319
    Abstract: The present disclosure generally relates to the field of eye tracking systems. An eye tracking system is provided. The eye tracking system comprises an illuminator arrangement, including at least one light source, configured to illuminate an eye of a user. The eye tracking system is configured to enable a reduction of reflections from an optic arrangement (e.g., a pair of glasses) that is located in a light beam path between the illuminator arrangement and the eye when the eye tracking system is in use. The illuminator arrangement is configured to emit p-polarized light to be incident on a surface of the optic arrangement at an angle corresponding to, or substantially corresponding to, Brewster's angle.
    Type: Application
    Filed: September 28, 2020
    Publication date: April 1, 2021
    Applicant: Tobii AB
    Inventor: Magnus Arvidsson
  • Publication number: 20210089121
    Abstract: Systems and methods for gaze origin selection based on dominant eye shift of a user. Systems and methods described herein include eye tracking devices and computing devices. The first eye is initially set as the dominant eye. A first gaze ray for the first eye and a second gaze ray for a second eye are determined by an eye tracking system. The first gaze ray intersects a first object and the second gaze ray intersects a second object within the field of view, at a first depth and a second depth respectively. A convergence depth of the first gaze ray and the second gaze ray is determined and compared against the first depth and the second depth. When a second offset between the second depth and the convergence depth is smaller than a first offset between the first depth and the convergence depth, the second eye is set as the dominant eye.
    Type: Application
    Filed: September 23, 2019
    Publication date: March 25, 2021
    Applicant: Tobii AB
    Inventor: Denny Rönngren
  • Patent number: 10955912
    Abstract: Techniques for data sharing between two computing devices are described. In an example, a computer system determines a first presence of a first user relative to a first computing device. The computer system also determines a first identifier of the first user. The first identifier is associated with operating the first computing device. The operating comprises sharing data with a second computing device. The computer system also determines a second presence of a second user relative to the second computing device. The computer system also determines a second identifier of the second user. The second identifier associated with operating the second computing device. The computer system cause the data to be shared with the second computing device based on the first presence, the first identifier, the second presence, and the second identifier.
    Type: Grant
    Filed: November 9, 2018
    Date of Patent: March 23, 2021
    Assignee: Tobii AB
    Inventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Regimantas Vegele, Andrew Ratcliff, Guido Hermans, Mattias Hanqvist, Simon Hugosson, Dmitrios Koufos, Morgan Viktorsson, Jonas Alexanderson, Siavash Moghaddam, Jimmy Carlsten, Martin Chrzan
  • Patent number: 10955915
    Abstract: A preliminary path for light travelling towards a camera via corneal reflection is estimated based on a preliminary position and orientation of an eye. A position where the reflection would appear in images captured by the camera is estimated. A distance is formed between a detected position of a corneal reflection of an illuminator and the estimated position. A second preliminary path for light travelling through the cornea or from the sclera towards a camera is estimated based on the preliminary position and orientation, and a position where the second preliminary path would appear to originate in images captured by this camera is estimated. A distance is formed between a detected edge of a pupil or iris and the estimated position where the second preliminary path would appear to originate. An updated position and/or orientation of the eye is determined using an objective function formed based on the formed distances.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: March 23, 2021
    Assignee: Tobii AB
    Inventor: Erik Lindén
  • Patent number: 10957069
    Abstract: Head pose information may be determined using information describing a fixed gaze and image data corresponding to a user's eyes. The head pose information may be determined in a manner that is disregards facial features with the exception of the user's eyes. The head pose information may be useable to interact with a user device.
    Type: Grant
    Filed: September 28, 2018
    Date of Patent: March 23, 2021
    Assignee: Tobii AB
    Inventor: Mårten Skogö