Patents by Inventor Mikael Rosell
Mikael Rosell has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240153136Abstract: A method of determining a presence of a tear in an eye of a user of an eye tracking system, the method comprising receiving an image of the eye of the user, processing the image to identify one or more features of the image, comparing the one or more identified features to one or more expected features, and determining that a tear is present in the eye of the user if the one or more identified features differs from the one or more expected features by at least a threshold amount.Type: ApplicationFiled: October 17, 2023Publication date: May 9, 2024Inventor: MIKAEL ROSELL
-
Patent number: 11854213Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.Type: GrantFiled: December 7, 2021Date of Patent: December 26, 2023Assignee: Tobii ABInventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell
-
Patent number: 11823413Abstract: An eye tracking system configured to: receive a plurality of right eye images of a right eye of a user; receive a plurality of left eye images of a left eye of a user, each left eye image corresponding to a right eye image in the plurality of right eye images; detect a pupil and determine an associated pupil signal, for each of the plurality of right eye images and each of the plurality of left eye images; calculate a right eye pupil variation of the pupil signals for the plurality of right eye images and a left eye pupil variation of the pupil signals for the plurality of left eye images; and determine a right eye weighting and a left eye weighting based on the right eye pupil variation and the left eye pupil variation.Type: GrantFiled: January 25, 2023Date of Patent: November 21, 2023Assignee: Tobii ABInventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
-
Publication number: 20230319417Abstract: The invention is related to a method and arrangement for calibrating the camera of an eye tracking device and compensate for a potential angular offset of the camera. The method comprises: the steps of capturing an eye image of a user, wherein the eye image contains a plurality of glints created by a plurality of illuminators in the eye tracking system; detecting glints in the eye image; projecting illuminator positions onto the eye image to determine expected glint positions; determining an angular offset between expected glint positions and detected glint positions for corresponding pairs of expected and detected glint positions; determining the angular correction for the eye tracking camera using the determined angular offset angle; and applying the angular correction for the eye tracking camera to an eye tracker camera model.Type: ApplicationFiled: March 29, 2023Publication date: October 5, 2023Inventors: SIMON JOHANSSON, MIKAEL ROSELL
-
Patent number: 11681371Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.Type: GrantFiled: June 30, 2022Date of Patent: June 20, 2023Assignee: Tobii ABInventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell, Daniel Wrang
-
Publication number: 20230108738Abstract: A method for determining if a head-mounted device for extended reality is correctly positioned and performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned, including performing eye tracking by estimating, based on a first image of a first eye of a user, a position of a pupil in two dimensions. The method also includes determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image. The method also includes, responsive to determining that the estimated position of the pupil of the first eye is inside the predetermined allowable area, that the head-mounted device is correctly positioned on the user, or, responsive to determining that the position of the pupil of the first eye is outside the predetermined allowable area, that the head-mounted device is incorrectly positioned on the user.Type: ApplicationFiled: December 9, 2022Publication date: April 6, 2023Inventors: Joakim ZACHRISSON, Mikael ROSELL, Carlos PEDREIRA, Mark RYAN, Simon JOHANSSON
-
Patent number: 11619990Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for classifying glints using an eye tracking system of a head-mounted device, by obtaining the position of any glint present in a current image of the first eye; obtaining a dataset indicative of the respective position of at least one glint detected in one or more previously captured images of the first eye; and, for each glint present in current image, determining if the position of the glint corresponds to the position of a glint in the dataset and, if the positions correspond, classify the glint as a static glint. The static glints may be excluded from further processing in the eye tracking system. If there has been a movement of an eye of the user of the head-mounted device, embodiments may further comprise updating the dataset based on the current image.Type: GrantFiled: December 23, 2019Date of Patent: April 4, 2023Assignee: TOBII ABInventors: Mikael Rosell, Simon Johansson, Johannes Kron, Macarena Garcia Romero
-
Patent number: 11593962Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.Type: GrantFiled: December 29, 2020Date of Patent: February 28, 2023Assignee: TOBII ABInventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
-
Patent number: 11551376Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.Type: GrantFiled: October 25, 2019Date of Patent: January 10, 2023Assignee: TOBII ABInventors: Joakim Zachrisson, Mikael Rosell, Carlos Pedreira, Mark Ryan, Simon Johansson
-
Publication number: 20230005180Abstract: An eye tracking system provides a quality measure of a calculated gaze of a user. The eye tracking system receives gaze data including left eye gaze data associated with a left eye of the user and right eye gaze data associated with a right eye of the user. The eye tracking system compares the left eye gaze data and the right eye gaze data to determine a gaze difference value. The eye tracking system provides a gaze quality value of the gaze data based on the gaze difference value.Type: ApplicationFiled: June 30, 2022Publication date: January 5, 2023Inventors: Joakim ZACHRISSON, Mikael ROSELL, Ylva BJORK, Simon JOHANSSON
-
Publication number: 20230004223Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.Type: ApplicationFiled: June 30, 2022Publication date: January 5, 2023Inventors: Joakim ZACHRISSON, Simon JOHANSSON, Mikael ROSELL, Daniel WRANG
-
Publication number: 20220207768Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.Type: ApplicationFiled: December 29, 2020Publication date: June 30, 2022Applicant: Tobii ABInventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
-
Publication number: 20220180532Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.Type: ApplicationFiled: December 7, 2021Publication date: June 9, 2022Applicant: Tobii ABInventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell
-
Patent number: 11156831Abstract: An eye-tracking system for performing a pupil-detection process, the eye-tracking system configured to: receive image-data comprising a plurality of pixel-arrays, each pixel-array having a plurality of pixel locations and an intensity-value at each of the pixel locations; for each pixel location of a region of pixel locations: define an intensity-value-set comprising the intensity-values at the pixel location for two or more of the plurality of pixel-arrays; and determine the pixel location to be an excluded pixel location if the intensity-value-set does not satisfy an intensity condition; and exclude the excluded pixel locations from the pupil-detection process.Type: GrantFiled: December 31, 2019Date of Patent: October 26, 2021Assignee: Tobii ABInventors: Mikael Rosell, Simon Johansson, Johannes Kron
-
Publication number: 20210199957Abstract: An eye-tracking system for performing a pupil-detection process, the eye-tracking system configured to: receive image-data comprising a plurality of pixel-arrays, each pixel-array having a plurality of pixel locations and an intensity-value at each of the pixel locations; for each pixel location of a region of pixel locations: define an intensity-value-set comprising the intensity-values at the pixel location for two or more of the plurality of pixel-arrays; and determine the pixel location to be an excluded pixel location if the intensity-value-set does not satisfy an intensity condition; and exclude the excluded pixel locations from the pupil-detection process.Type: ApplicationFiled: December 31, 2019Publication date: July 1, 2021Applicant: Tobii ABInventors: Mikael Rosell, Simon Johansson, Johannes Kron
-
Patent number: 10928891Abstract: The present disclosure relates to a method for calibrating a camera of a head-mounted display, HMD. The method comprises providing a calibration target in front of a lens of the HMD. Each of the calibration target and the lens basically extend in a corresponding two-dimensional plane. The method further comprises determining a lateral position of the calibration target. The lateral position relates to a position of the calibration target in the two-dimensional plane. The method even further comprises determining a lateral position of the lens. The lateral position relates to a position of the lens in the two-dimensional plane. The method yet even further comprises determining a calibration target misalignment based on the determined lateral position of the calibration target and based on the determined lateral position of the lens. The method also comprises performing a hardware calibration of the HMD. The hardware calibration is adapted for the calibration target misalignment.Type: GrantFiled: May 29, 2019Date of Patent: February 23, 2021Assignee: Tobii ABInventor: Mikael Rosell
-
Publication number: 20200257358Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for classifying glints using an eye tracking system of a head-mounted device, by obtaining the position of any glint present in a current image of the first eye; obtaining a dataset indicative of the respective position of at least one glint detected in one or more previously captured images of the first eye; and, for each glint present in current image, determining if the position of the glint corresponds to the position of a glint in the dataset and, if the positions correspond, classify the glint as a static glint. The static glints may be excluded from further processing in the eye tracking system. If there has been a movement of an eye of the user of the head-mounted device, embodiments may further comprise updating the dataset based on the current image.Type: ApplicationFiled: December 23, 2019Publication date: August 13, 2020Applicant: Tobii ABInventors: Mikael Rosell, Johansson Johansson, Johannes Kron, Macarena Garcia Romero
-
Publication number: 20200257356Abstract: The present disclosure relates to a method for calibrating a camera of a head-mounted display, HMD. The method comprises providing a calibration target in front of a lens of the HMD. Each of the calibration target and the lens basically extend in a corresponding two-dimensional plane. The method further comprises determining a lateral position of the calibration target. The lateral position relates to a position of the calibration target in the two-dimensional plane. The method even further comprises determining a lateral position of the lens. The lateral position relates to a position of the lens in the two-dimensional plane. The method yet even further comprises determining a calibration target misalignment based on the determined lateral position of the calibration target and based on the determined lateral position of the lens. The method also comprises performing a hardware calibration of the HMD. The hardware calibration is adapted for the calibration target misalignment.Type: ApplicationFiled: May 29, 2019Publication date: August 13, 2020Applicant: Tobii ABInventor: Mikael Rosell
-
Publication number: 20200134867Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.Type: ApplicationFiled: October 25, 2019Publication date: April 30, 2020Applicant: Tobii ABInventors: Joakim Zachrisson, Mikael Rosell, Carlos Pedreira, Mark Ryan, Simon Johansson