Patents Assigned to TOBII AB
  • Patent number: 11270499
    Abstract: A method for determining a focus target of a user's gaze in a three-dimensional (“3D”) scene is disclosed. The method may include determining a first gaze direction of a user into a 3D scene, where the 3D scene includes a plurality of components. The method may also include executing a first plurality of line traces in the 3D scene, where each of the first plurality of line traces is in proximity to the first gaze direction. The method may further include determining a confidence value for each component intersected by at least one of the first plurality of line traces. The method may additionally include identifying as a focus target of the user the component having the highest confidence value of all components intersected by at least one of the first plurality of line traces.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: March 8, 2022
    Assignee: Tobii AB
    Inventor: Fredrik Lindh
  • Patent number: 11269405
    Abstract: A method for determining correspondence between a gaze direction and an environment around a wearable device is disclosed. The wearable device may include an eye tracking device and an outward facing image sensor. The method may include receiving an input parameter and at least one scene image from the outward facing image sensor. The method may further include determining, with at least the eye tracking device, at least one gaze direction of a wearer of the wearable device at a point in time corresponding to when the scene image was captured by the outward facing image sensor. The method may additionally include determining, based at least in part on the input parameter, that a particular scene image includes at least a portion of a predefined image. The method may moreover include determining, based on the at least one gaze direction, at least one gaze point on the particular scene image.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: March 8, 2022
    Assignee: Tobii AB
    Inventors: André Lovtjärn, Jesper Högström, Jonas Högström, Rasmus Petersson, Mårten Skogö, Wilkey Wong
  • Patent number: 11269190
    Abstract: The present invention relates to a lens for eye-tracking applications. The lens comprises a first protective layer, arranged to face towards the eye to be tracked when the lens is used for eye-tracking. It also comprises at least one light source, at least partly arranged in the first protective layer, arranged to emit a first light from the first protective layer in a direction towards the eye. Moreover, it comprises at least one image capturing device, at least partly arranged in the first protective layer, arranged to receive the first light within the first protective layer. The lens further comprises an absorptive layer, arranged on the far side of the first protective layer seen from the eye to be tracked when the lens is used for eye-tracking, adapted to be absorptive for wavelengths of the majority of the first light.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: March 8, 2022
    Assignee: Tobii AB
    Inventors: Axel Tollin, Daniel Ljunggren
  • Patent number: 11256087
    Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light.
    Type: Grant
    Filed: June 28, 2019
    Date of Patent: February 22, 2022
    Assignee: Tobii Ab
    Inventors: Daniel Tornèus, Peter Schef, Magnus Arvidsson, Peter Blixt, Fredrik Mattinson
  • Patent number: 11259010
    Abstract: Images of an eye are captured at respective time instances by a camera of a head-mounted device. For each time instance, a position of a center of corneal curvature is estimated using an image captured at that time instance, a position of a pupil center is estimated using an image captured at that time instance, and a line is determined through the estimated corneal curvature center position and the estimated pupil center position. A first estimated position of a center of the eye is computed based on the lines determined for time instances in a first time period. A second estimated position of the center of the eye is computed based on the lines determined for time instances in a second time period. Relocation of the head-mounted device relative to a user's head is detected based on the first and second estimated positions of the eye center.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: February 22, 2022
    Assignee: Tobii AB
    Inventors: Tiesheng Wang, Pravin Kumar Rana, Yimu Wang, Mark Ryan
  • Patent number: 11256327
    Abstract: The invention relates to an eye tracking device comprising one or more illuminators, each illuminator comprising a light emitting side, and each illuminator being connected to a first circuitry carrier, an imaging module connected to a second circuitry carrier wherein the image module comprises optical arrangements. The plurality of illuminators, the imaging module and the circuitry carriers are embedded without gaps in a first material. The invention further relates to methods for manufacturing an eye tracking device with over-molded components.
    Type: Grant
    Filed: June 13, 2019
    Date of Patent: February 22, 2022
    Assignee: Tobii AB
    Inventors: Eli Lundberg, Richard Hainzl, Daniel Tornéus
  • Patent number: 11249547
    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: February 15, 2022
    Assignee: Tobii AB
    Inventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
  • Publication number: 20220043509
    Abstract: A system configured to enable operation of an apparatus based on the gaze of a user, the system comprising a processor, and a memory comprising instructions executable by the processor, wherein the system is configured to determine a gaze region of a user among a plurality of regions associated with the apparatus, wherein the plurality of regions comprises at least one primary gaze region and at least one secondary gaze region and perform at least one action based on the determination of the gaze region, wherein the system is configured to determine the gaze region using a first gaze estimation algorithm and/or a second gaze estimation algorithm.
    Type: Application
    Filed: June 29, 2020
    Publication date: February 10, 2022
    Applicant: Tobii AB
    Inventors: Anders Dahl, Tommaso Martini, Oscar Danielsson, Mårten Nilsson, Patrik Barkman
  • Patent number: 11243607
    Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: February 8, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Yimu Wang
  • Patent number: 11232594
    Abstract: The invention is related to a method for calibrating an eye tracking device within a head-mounted display (HMD) comprising the steps of acquiring with the HMD via an image sensor, at least one optical target image from an optical target, wherein the optical target contains image points in a pattern, indexing image points within the optical target image wherein the image points are indexed by, selecting a rigid region of the optical target image, assigning indices to image points within the rigid region, fitting a polynomial approximation function to at least one column and one row of the image points of the region, predicting the location of at least one image point using the fitted polynomial approximation function, assigning the predicted image point an index, inputting indexed image points into an optimization algorithm that calculates a hardware calibration of the HMD, and writing hardware calibration values calculated from the optimization algorithm to the HMD unit.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: January 25, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Macarena Garcia Romero, Yimu Wang, Rickard Lundahl
  • Patent number: 11226682
    Abstract: A lens for eye tracking applications is described. The lens comprises a first protective layer with a first surface, arranged to face towards the eye to be tracked when the lens is used for eye tracking. The lens is characterized in that the lens further comprises a supporting layer and a second protective layer with a second surface, arranged to face away from the eye to be tracked when the lens is used for eye tracking. The supporting layer is arranged between the first protective layer and the second protective layer, and the supporting layer comprises at least a first opening between the first protective layer and the second protective layer. At least one electrical component arranged extending through the first opening.
    Type: Grant
    Filed: January 31, 2020
    Date of Patent: January 18, 2022
    Assignee: Tobii AB
    Inventors: Daniel Ljunggren, Anders Höglund, Axel Tollin, Jan Skagerlund
  • Publication number: 20220011584
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Application
    Filed: April 30, 2021
    Publication date: January 13, 2022
    Applicant: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Patent number: 11209901
    Abstract: The present disclosure relates to an eye tracking method as well as a corresponding system and computer-readable storage medium. Calibration is performed. The calibration comprises estimating values for a plurality of parameters defining respective optical properties of an eye. The plurality of parameters includes a radius of a cornea of the eye. Eye tracking for the eye is performed using the values estimated at the calibration. An updated value of the cornea radius is estimated. Eye tracking for the eye is performed using the updated value of the cornea radius and a value estimated at the calibration for a parameter other than the cornea radius of the eye. The cornea radius of an eye may change over time. This may cause degradation of eye tracking performance. This problem may be reduced or prevented by estimating an updated value of the cornea radius.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 28, 2021
    Assignee: Tobii AB
    Inventor: Andreas Klingström
  • Publication number: 20210349607
    Abstract: Visualizable data are obtained that represent a scene with at least one object. The visualizable data describe the scene as seen from a position. First and second measures are determined, which represent extensions of one of the objects in a smallest and a largest dimension respectively. An object aspect ratio is calculated that represents a relationship between the first and second measures. Based on the object aspect ratio, a selection margin is assigned to the object. The selection margin designates a zone outside of the object within which zone the object is validly selectable for manipulation in addition to an area of the object shown towards a view thereof as seen from the position. Thus, it is made easier to manipulatable the visualizable data in response to user input, for instance in the form of gaze-based selection commands.
    Type: Application
    Filed: March 31, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Robin Thunström, Staffan Widegarn Åhlvik
  • Publication number: 20210347364
    Abstract: The invention is related to a method for driver alertness detection, The method comprises the steps of determining a vanishing point of a vehicle in motion; determining over time, by an eye tracking device, a set of gaze points of the driver of the vehicle; determining a gaze movement from the set of gaze points; and identifying an alertness of the driver, based on a direction of the gaze movement relative to the vanishing point being outward. Further, the invention is related to an eye tracking device for driver alertness detection, an alertness detection system, a computer program, and a computer-readable medium.
    Type: Application
    Filed: April 9, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventor: Andrew Ratcliff
  • Publication number: 20210345923
    Abstract: There is provided mechanisms for eye position determination of a subject depicted in an image set. A method comprises obtaining first information indicating a first set of eye positions of the subject by applying a first eye tracking procedure on an image set depicting the subject. The first eye tracking procedure uses a first set of features extracted from the image set for obtaining the first set of eye positions. The method comprises obtaining second information indicating a second set of eye positions of the subject by applying a second eye tracking procedure on the image set depicting the subject. The second eye tracking procedure uses a second set of features extracted from the image set for obtaining the second set of eye positions.
    Type: Application
    Filed: April 21, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
  • Publication number: 20210350565
    Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.
    Type: Application
    Filed: April 28, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Fogelström, Per Fogelström, Per, Redz, Anna Redz, Anna, Dahl, Anders Dahl, Anders, Ollesson, Niklas Ollesson, Niklas
  • Publication number: 20210350554
    Abstract: An eye-tracking system configured to: receive a reference-image of an eye of a user, the reference-image being associated with reference-eye-data; receive one or more sample-images of the eye of the user; and, for each of the one or more sample-images: determine a difference between the reference-image and the sample-image to define a corresponding differential-image; and determine eye-data for the sample-image based on the differential-image and the reference-eye-data associated with the reference-image.
    Type: Application
    Filed: March 31, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: David Masko, Mark Ryan, Mattias Kuldkepp
  • Patent number: 11169604
    Abstract: A method for determining gaze calibration parameters for gaze estimation of a viewer using an eye-tracking system. The method comprises obtaining a set of data points including gaze tracking data of the viewer and position information of at least one target visual; selecting a first subset of the data points and determining gaze calibration parameters using said first subset. A score for the gaze calibration parameters is determined by using the gaze calibration parameters with a second subset of data points, wherein at least one data point of the subset is not included in the first subset. The score is indicative of the capability of the gaze calibration parameters to reflect position information of the at least one target visual based on the gaze tracking data. The score is compared to a candidate score and if it is higher, the calibration parameters are set to the candidate calibration parameters and the score to the candidate score.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: November 9, 2021
    Assignee: Tobii AB
    Inventors: Patrik Barkman, David Molin
  • Publication number: 20210342000
    Abstract: Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device displays a representation of a second user on a display of the first computing device. Further, the first computing device receives from the first user, communication data generated by an input device. The first computing device determines if the gaze direction of the first user is directed to the representation of the second user. If the gaze direction of the first user is directed to the representation of the second user, the first computing device transmits the communication data to a second computing device of the second user.
    Type: Application
    Filed: June 1, 2021
    Publication date: November 4, 2021
    Applicant: Tobii AB
    Inventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Andrew Ratcliff, Regimantas Vegele, Geoffrey Cooper, Niklas Blomqvist