Patents by Inventor Mikael Rosell

Mikael Rosell has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240153136
    Abstract: A method of determining a presence of a tear in an eye of a user of an eye tracking system, the method comprising receiving an image of the eye of the user, processing the image to identify one or more features of the image, comparing the one or more identified features to one or more expected features, and determining that a tear is present in the eye of the user if the one or more identified features differs from the one or more expected features by at least a threshold amount.
    Type: Application
    Filed: October 17, 2023
    Publication date: May 9, 2024
    Inventor: MIKAEL ROSELL
  • Patent number: 11854213
    Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.
    Type: Grant
    Filed: December 7, 2021
    Date of Patent: December 26, 2023
    Assignee: Tobii AB
    Inventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell
  • Patent number: 11823413
    Abstract: An eye tracking system configured to: receive a plurality of right eye images of a right eye of a user; receive a plurality of left eye images of a left eye of a user, each left eye image corresponding to a right eye image in the plurality of right eye images; detect a pupil and determine an associated pupil signal, for each of the plurality of right eye images and each of the plurality of left eye images; calculate a right eye pupil variation of the pupil signals for the plurality of right eye images and a left eye pupil variation of the pupil signals for the plurality of left eye images; and determine a right eye weighting and a left eye weighting based on the right eye pupil variation and the left eye pupil variation.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: November 21, 2023
    Assignee: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Publication number: 20230319417
    Abstract: The invention is related to a method and arrangement for calibrating the camera of an eye tracking device and compensate for a potential angular offset of the camera. The method comprises: the steps of capturing an eye image of a user, wherein the eye image contains a plurality of glints created by a plurality of illuminators in the eye tracking system; detecting glints in the eye image; projecting illuminator positions onto the eye image to determine expected glint positions; determining an angular offset between expected glint positions and detected glint positions for corresponding pairs of expected and detected glint positions; determining the angular correction for the eye tracking camera using the determined angular offset angle; and applying the angular correction for the eye tracking camera to an eye tracker camera model.
    Type: Application
    Filed: March 29, 2023
    Publication date: October 5, 2023
    Inventors: SIMON JOHANSSON, MIKAEL ROSELL
  • Patent number: 11681371
    Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.
    Type: Grant
    Filed: June 30, 2022
    Date of Patent: June 20, 2023
    Assignee: Tobii AB
    Inventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell, Daniel Wrang
  • Publication number: 20230108738
    Abstract: A method for determining if a head-mounted device for extended reality is correctly positioned and performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned, including performing eye tracking by estimating, based on a first image of a first eye of a user, a position of a pupil in two dimensions. The method also includes determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image. The method also includes, responsive to determining that the estimated position of the pupil of the first eye is inside the predetermined allowable area, that the head-mounted device is correctly positioned on the user, or, responsive to determining that the position of the pupil of the first eye is outside the predetermined allowable area, that the head-mounted device is incorrectly positioned on the user.
    Type: Application
    Filed: December 9, 2022
    Publication date: April 6, 2023
    Inventors: Joakim ZACHRISSON, Mikael ROSELL, Carlos PEDREIRA, Mark RYAN, Simon JOHANSSON
  • Patent number: 11619990
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for classifying glints using an eye tracking system of a head-mounted device, by obtaining the position of any glint present in a current image of the first eye; obtaining a dataset indicative of the respective position of at least one glint detected in one or more previously captured images of the first eye; and, for each glint present in current image, determining if the position of the glint corresponds to the position of a glint in the dataset and, if the positions correspond, classify the glint as a static glint. The static glints may be excluded from further processing in the eye tracking system. If there has been a movement of an eye of the user of the head-mounted device, embodiments may further comprise updating the dataset based on the current image.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: April 4, 2023
    Assignee: TOBII AB
    Inventors: Mikael Rosell, Simon Johansson, Johannes Kron, Macarena Garcia Romero
  • Patent number: 11593962
    Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: February 28, 2023
    Assignee: TOBII AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Patent number: 11551376
    Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: January 10, 2023
    Assignee: TOBII AB
    Inventors: Joakim Zachrisson, Mikael Rosell, Carlos Pedreira, Mark Ryan, Simon Johansson
  • Publication number: 20230005180
    Abstract: An eye tracking system provides a quality measure of a calculated gaze of a user. The eye tracking system receives gaze data including left eye gaze data associated with a left eye of the user and right eye gaze data associated with a right eye of the user. The eye tracking system compares the left eye gaze data and the right eye gaze data to determine a gaze difference value. The eye tracking system provides a gaze quality value of the gaze data based on the gaze difference value.
    Type: Application
    Filed: June 30, 2022
    Publication date: January 5, 2023
    Inventors: Joakim ZACHRISSON, Mikael ROSELL, Ylva BJORK, Simon JOHANSSON
  • Publication number: 20230004223
    Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.
    Type: Application
    Filed: June 30, 2022
    Publication date: January 5, 2023
    Inventors: Joakim ZACHRISSON, Simon JOHANSSON, Mikael ROSELL, Daniel WRANG
  • Publication number: 20220207768
    Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.
    Type: Application
    Filed: December 29, 2020
    Publication date: June 30, 2022
    Applicant: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Publication number: 20220180532
    Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.
    Type: Application
    Filed: December 7, 2021
    Publication date: June 9, 2022
    Applicant: Tobii AB
    Inventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell
  • Patent number: 11156831
    Abstract: An eye-tracking system for performing a pupil-detection process, the eye-tracking system configured to: receive image-data comprising a plurality of pixel-arrays, each pixel-array having a plurality of pixel locations and an intensity-value at each of the pixel locations; for each pixel location of a region of pixel locations: define an intensity-value-set comprising the intensity-values at the pixel location for two or more of the plurality of pixel-arrays; and determine the pixel location to be an excluded pixel location if the intensity-value-set does not satisfy an intensity condition; and exclude the excluded pixel locations from the pupil-detection process.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: October 26, 2021
    Assignee: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Johannes Kron
  • Publication number: 20210199957
    Abstract: An eye-tracking system for performing a pupil-detection process, the eye-tracking system configured to: receive image-data comprising a plurality of pixel-arrays, each pixel-array having a plurality of pixel locations and an intensity-value at each of the pixel locations; for each pixel location of a region of pixel locations: define an intensity-value-set comprising the intensity-values at the pixel location for two or more of the plurality of pixel-arrays; and determine the pixel location to be an excluded pixel location if the intensity-value-set does not satisfy an intensity condition; and exclude the excluded pixel locations from the pupil-detection process.
    Type: Application
    Filed: December 31, 2019
    Publication date: July 1, 2021
    Applicant: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Johannes Kron
  • Patent number: 10928891
    Abstract: The present disclosure relates to a method for calibrating a camera of a head-mounted display, HMD. The method comprises providing a calibration target in front of a lens of the HMD. Each of the calibration target and the lens basically extend in a corresponding two-dimensional plane. The method further comprises determining a lateral position of the calibration target. The lateral position relates to a position of the calibration target in the two-dimensional plane. The method even further comprises determining a lateral position of the lens. The lateral position relates to a position of the lens in the two-dimensional plane. The method yet even further comprises determining a calibration target misalignment based on the determined lateral position of the calibration target and based on the determined lateral position of the lens. The method also comprises performing a hardware calibration of the HMD. The hardware calibration is adapted for the calibration target misalignment.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: February 23, 2021
    Assignee: Tobii AB
    Inventor: Mikael Rosell
  • Publication number: 20200257358
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for classifying glints using an eye tracking system of a head-mounted device, by obtaining the position of any glint present in a current image of the first eye; obtaining a dataset indicative of the respective position of at least one glint detected in one or more previously captured images of the first eye; and, for each glint present in current image, determining if the position of the glint corresponds to the position of a glint in the dataset and, if the positions correspond, classify the glint as a static glint. The static glints may be excluded from further processing in the eye tracking system. If there has been a movement of an eye of the user of the head-mounted device, embodiments may further comprise updating the dataset based on the current image.
    Type: Application
    Filed: December 23, 2019
    Publication date: August 13, 2020
    Applicant: Tobii AB
    Inventors: Mikael Rosell, Johansson Johansson, Johannes Kron, Macarena Garcia Romero
  • Publication number: 20200257356
    Abstract: The present disclosure relates to a method for calibrating a camera of a head-mounted display, HMD. The method comprises providing a calibration target in front of a lens of the HMD. Each of the calibration target and the lens basically extend in a corresponding two-dimensional plane. The method further comprises determining a lateral position of the calibration target. The lateral position relates to a position of the calibration target in the two-dimensional plane. The method even further comprises determining a lateral position of the lens. The lateral position relates to a position of the lens in the two-dimensional plane. The method yet even further comprises determining a calibration target misalignment based on the determined lateral position of the calibration target and based on the determined lateral position of the lens. The method also comprises performing a hardware calibration of the HMD. The hardware calibration is adapted for the calibration target misalignment.
    Type: Application
    Filed: May 29, 2019
    Publication date: August 13, 2020
    Applicant: Tobii AB
    Inventor: Mikael Rosell
  • Publication number: 20200134867
    Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.
    Type: Application
    Filed: October 25, 2019
    Publication date: April 30, 2020
    Applicant: Tobii AB
    Inventors: Joakim Zachrisson, Mikael Rosell, Carlos Pedreira, Mark Ryan, Simon Johansson