Patents by Inventor Andreas Klingström

Andreas Klingström has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11669162
    Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.
    Type: Grant
    Filed: April 5, 2022
    Date of Patent: June 6, 2023
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Patent number: 11353952
    Abstract: Techniques for controlling light sources used in eye tracking are described. In an example, an eye tracking system generates a first image and a second image showing at least a portion of the user eye illuminated by a predetermined set of illuminators of the eye tracking system. The eye tracking system determines a first position of a glint in the first image and a second position of the glint in the second image. Each of the first position and the second position is relative to a pupil edge. The eye tracking system predicts a third position of the glint relative to the pupil edge based on the first position and the second position. Further, the eye tracking system determines, from the predetermined set, an illuminator that corresponds to the glint and determines, based on the third position, whether to power off the illuminator to generate a third image of at least the portion of the user eye.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: June 7, 2022
    Assignee: Tobii AB
    Inventors: Daniel Johansson Tornéus, Andreas Klingström, Martin Skärbäck
  • Patent number: 11294460
    Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: April 5, 2022
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Patent number: 11275437
    Abstract: A method and a corresponding apparatus for mitigating motion sickness in a virtual reality VR/augmented reality (AR) system using a head mounted display (HMD) are disclosed. The method comprises receiving data from a sensor indicating a current orientation of the HMD in real space, and superimposing a visual indication on a display of the HMD. The visual indication provides visual information to a user of the current orientation of the HMD in real space. Furthermore, methods and corresponding apparatuses are disclosed of calculating gaze convergence distance in an eye tracking system, and of gaze based virtual reality (VR)/augmented reality (AR) menu expansion.
    Type: Grant
    Filed: October 19, 2020
    Date of Patent: March 15, 2022
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Per Fogelström, Andrew Ratcliff
  • Patent number: 11209901
    Abstract: The present disclosure relates to an eye tracking method as well as a corresponding system and computer-readable storage medium. Calibration is performed. The calibration comprises estimating values for a plurality of parameters defining respective optical properties of an eye. The plurality of parameters includes a radius of a cornea of the eye. Eye tracking for the eye is performed using the values estimated at the calibration. An updated value of the cornea radius is estimated. Eye tracking for the eye is performed using the updated value of the cornea radius and a value estimated at the calibration for a parameter other than the cornea radius of the eye. The cornea radius of an eye may change over time. This may cause degradation of eye tracking performance. This problem may be reduced or prevented by estimating an updated value of the cornea radius.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 28, 2021
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Publication number: 20210173479
    Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.
    Type: Application
    Filed: December 10, 2020
    Publication date: June 10, 2021
    Applicant: Tobii AB
    Inventor: Andreas Klingström
  • Patent number: 10928897
    Abstract: According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: February 23, 2021
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Publication number: 20210034152
    Abstract: A method and a corresponding apparatus for mitigating motion sickness in a virtual reality VR/augmented reality (AR) system using a head mounted display (HMD) are disclosed. The method comprises receiving data from a sensor indicating a current orientation of the HMD in real space, and superimposing a visual indication on a display of the HMD. The visual indication provides visual information to a user of the current orientation of the HMD in real space. Furthermore, methods and corresponding apparatuses are disclosed of calculating gaze convergence distance in an eye tracking system, and of gaze based virtual reality (VR)/augmented reality (AR) menu expansion.
    Type: Application
    Filed: October 19, 2020
    Publication date: February 4, 2021
    Applicant: Tobii AB
    Inventors: Andreas Klingström, Per Fogelström, Andrew Ratcliff
  • Patent number: 10809800
    Abstract: A method and a corresponding eye tracking system for providing an approximate gaze convergence distance of a user in an eye tracking system are disclosed. The method comprises determining calibration data in relation to interpupillary distance between a pupil of a left eye and a pupil of a right eye of a user, determining, based on the determined calibration data, a gaze convergence function providing an approximate gaze convergence distance of the user based on a determined interpupillary distance of the user. The method further comprises receiving, from one or more imaging devices, one or more images of the left eye and the right eye of the user, determining a current interpupillary distance of the user based on the one or more images and determining a current approximate gaze convergence distance based on the current interpupillary distance and the gaze convergence function.
    Type: Grant
    Filed: December 14, 2018
    Date of Patent: October 20, 2020
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Per Fogelström
  • Publication number: 20200257359
    Abstract: The present disclosure relates to an eye tracking method as well as a corresponding system and computer-readable storage medium. Calibration is performed. The calibration comprises estimating values for a plurality of parameters defining respective optical properties of an eye. The plurality of parameters includes a radius of a cornea of the eye. Eye tracking for the eye is performed using the values estimated at the calibration. An updated value of the cornea radius is estimated. Eye tracking for the eye is performed using the updated value of the cornea radius and a value estimated at the calibration for a parameter other than the cornea radius of the eye. The cornea radius of an eye may change over time. This may cause degradation of eye tracking performance. This problem may be reduced or prevented by estimating an updated value of the cornea radius.
    Type: Application
    Filed: December 23, 2019
    Publication date: August 13, 2020
    Applicant: Tobii AB
    Inventor: Andreas Klingström
  • Publication number: 20200257360
    Abstract: The disclosure relates to a method performed by a computer, the method comprising visualizing a plurality of objects, each at a known 3D position, using a 3 display, determining an object of the visualized objects at which a user is watching based on a gaze point, obtaining a gaze convergence distance indicative of a depth the user is watching at, obtaining a reference distance based on the 3D position of the determined object, calculating an updated convergence distance using the obtained gaze convergence distance and the reference distance.
    Type: Application
    Filed: December 23, 2019
    Publication date: August 13, 2020
    Applicant: Tobii AB
    Inventors: Andreas Klingström, Mattias Brand
  • Publication number: 20200166994
    Abstract: Techniques for controlling light sources used in eye tracking are described. In an example, an eye tracking system generates a first image and a second image showing at least a portion of the user eye illuminated by a predetermined set of illuminators of the eye tracking system. The eye tracking system determines a first position of a glint in the first image and a second position of the glint in the second image. Each of the first position and the second position is relative to a pupil edge. The eye tracking system predicts a third position of the glint relative to the pupil edge based on the first position and the second position. Further, the eye tracking system determines, from the predetermined set, an illuminator that corresponds to the glint and determines, based on the third position, whether to power off the illuminator to generate a third image of at least the portion of the user eye.
    Type: Application
    Filed: November 26, 2018
    Publication date: May 28, 2020
    Applicant: Tobii AB
    Inventors: Daniel Johansson Tornéus, Andreas Klingström, Martin Skärbäck
  • Patent number: 10614303
    Abstract: Circuitry of a gaze/eye tracking system obtains one or more images of a left eye and one or more images a right eye, determines a gaze direction of the left eye based on at least one obtained image of the left eye, determines a gaze direction of the right eye based on at least one obtained image of the right eye, determines a first confidence value based on the one or more obtained images of the left eye, determines a second confidence value based on the one or more obtained images of the right eye, and determines a final gaze direction based at least in part on the first confidence value and the second confidence value. The first and second confidence values represent indications of the reliability of the determined gaze directions of the left eye and the right eye, respectively. Corresponding methods and computer-readable media are also provided.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: April 7, 2020
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Mattias Kuldkepp, Mårten Skogö
  • Patent number: 10540008
    Abstract: A method and system for assisting a user when interacting with a graphical user interface combines gaze based input with gesture based user commands. A user of a computer system without a traditional touch-screen can interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. A solution for touch-screen like interaction uses gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen. Combined gaze and gesture based interaction with graphical user interfaces can be used to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavorable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.
    Type: Grant
    Filed: March 31, 2016
    Date of Patent: January 21, 2020
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Mårten Skogö, Richard Hainzl, John Elvesjö
  • Publication number: 20190369719
    Abstract: A method and a corresponding eye tracking system for providing an approximate gaze convergence distance of a user in an eye tracking system are disclosed. The method comprises determining calibration data in relation to interpupillary distance between a pupil of a left eye and a pupil of a right eye of a user, determining, based on the determined calibration data, a gaze convergence function providing an approximate gaze convergence distance of the user based on a determined interpupillary distance of the user. The method further comprises receiving, from one or more imaging devices, one or more images of the left eye and the right eye of the user, determining a current interpupillary distance of the user based on the one or more images and determining a current approximate gaze convergence distance based on the current interpupillary distance and the gaze convergence function.
    Type: Application
    Filed: December 14, 2018
    Publication date: December 5, 2019
    Applicant: Tobii AB
    Inventors: Andreas Klingström, Per Fogelström
  • Publication number: 20190346919
    Abstract: According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.
    Type: Application
    Filed: November 13, 2018
    Publication date: November 14, 2019
    Applicant: Tobii AB
    Inventor: Andreas Klingström
  • Publication number: 20190108383
    Abstract: Circuitry of a gaze/eye tracking system obtains one or more images of a left eye and one or more images a right eye, determines a gaze direction of the left eye based on at least one obtained image of the left eye, determines a gaze direction of the right eye based on at least one obtained image of the right eye, determines a first confidence value based on the one or more obtained images of the left eye, determines a second confidence value based on the one or more obtained images of the right eye, and determines a final gaze direction based at least in part on the first confidence value and the second confidence value. The first and second confidence values represent indications of the reliability of the determined gaze directions of the left eye and the right eye, respectively. Corresponding methods and computer-readable media are also provided.
    Type: Application
    Filed: April 3, 2018
    Publication date: April 11, 2019
    Applicant: Tobii AB
    Inventors: Andreas Klingström, Mattias Kuldkepp, Mårten Skogö
  • Patent number: 10152122
    Abstract: According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.
    Type: Grant
    Filed: July 18, 2016
    Date of Patent: December 11, 2018
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Patent number: 9940518
    Abstract: Circuitry of a gaze/eye tracking system obtains one or more images of a left eye and one or more images a right eye, determines a gaze direction of the left eye based on at least one obtained image of the left eye, determines a gaze direction of the right eye based on at least one obtained image of the right eye, determines a first confidence value based on the one or more obtained images of the left eye, determines a second confidence value based on the one or more obtained images of the right eye, and determines a final gaze direction based at least in part on the first confidence value and the second confidence value. The first and second confidence values represent indications of the reliability of the determined gaze directions of the left eye and the right eye, respectively. Corresponding methods and computer-readable media are also provided.
    Type: Grant
    Filed: September 11, 2017
    Date of Patent: April 10, 2018
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Mattias Kuldkepp, Mårten Skogö
  • Publication number: 20180018018
    Abstract: According to the invention, a method for changing a display based on a gaze point of a user on the display is disclosed. The method may include determining a gaze point of a user on a display. The method may also include causing a first area of the display to be displayed in a first manner, the first area including the gaze point and a surrounding area. The method may further include causing a second area of the display to be displayed in a second manner, the second area being different than the first area, and the second manner being different than the first manner.
    Type: Application
    Filed: July 18, 2016
    Publication date: January 18, 2018
    Applicant: Tobii AB
    Inventor: Andreas Klingström