Patents Assigned to TOBII AB
-
Patent number: 11270499Abstract: A method for determining a focus target of a user's gaze in a three-dimensional (“3D”) scene is disclosed. The method may include determining a first gaze direction of a user into a 3D scene, where the 3D scene includes a plurality of components. The method may also include executing a first plurality of line traces in the 3D scene, where each of the first plurality of line traces is in proximity to the first gaze direction. The method may further include determining a confidence value for each component intersected by at least one of the first plurality of line traces. The method may additionally include identifying as a focus target of the user the component having the highest confidence value of all components intersected by at least one of the first plurality of line traces.Type: GrantFiled: February 20, 2020Date of Patent: March 8, 2022Assignee: Tobii ABInventor: Fredrik Lindh
-
Patent number: 11269405Abstract: A method for determining correspondence between a gaze direction and an environment around a wearable device is disclosed. The wearable device may include an eye tracking device and an outward facing image sensor. The method may include receiving an input parameter and at least one scene image from the outward facing image sensor. The method may further include determining, with at least the eye tracking device, at least one gaze direction of a wearer of the wearable device at a point in time corresponding to when the scene image was captured by the outward facing image sensor. The method may additionally include determining, based at least in part on the input parameter, that a particular scene image includes at least a portion of a predefined image. The method may moreover include determining, based on the at least one gaze direction, at least one gaze point on the particular scene image.Type: GrantFiled: August 31, 2017Date of Patent: March 8, 2022Assignee: Tobii ABInventors: André Lovtjärn, Jesper Högström, Jonas Högström, Rasmus Petersson, Mårten Skogö, Wilkey Wong
-
Patent number: 11269190Abstract: The present invention relates to a lens for eye-tracking applications. The lens comprises a first protective layer, arranged to face towards the eye to be tracked when the lens is used for eye-tracking. It also comprises at least one light source, at least partly arranged in the first protective layer, arranged to emit a first light from the first protective layer in a direction towards the eye. Moreover, it comprises at least one image capturing device, at least partly arranged in the first protective layer, arranged to receive the first light within the first protective layer. The lens further comprises an absorptive layer, arranged on the far side of the first protective layer seen from the eye to be tracked when the lens is used for eye-tracking, adapted to be absorptive for wavelengths of the majority of the first light.Type: GrantFiled: January 31, 2020Date of Patent: March 8, 2022Assignee: Tobii ABInventors: Axel Tollin, Daniel Ljunggren
-
Patent number: 11256087Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light.Type: GrantFiled: June 28, 2019Date of Patent: February 22, 2022Assignee: Tobii AbInventors: Daniel Tornèus, Peter Schef, Magnus Arvidsson, Peter Blixt, Fredrik Mattinson
-
Patent number: 11259010Abstract: Images of an eye are captured at respective time instances by a camera of a head-mounted device. For each time instance, a position of a center of corneal curvature is estimated using an image captured at that time instance, a position of a pupil center is estimated using an image captured at that time instance, and a line is determined through the estimated corneal curvature center position and the estimated pupil center position. A first estimated position of a center of the eye is computed based on the lines determined for time instances in a first time period. A second estimated position of the center of the eye is computed based on the lines determined for time instances in a second time period. Relocation of the head-mounted device relative to a user's head is detected based on the first and second estimated positions of the eye center.Type: GrantFiled: October 31, 2019Date of Patent: February 22, 2022Assignee: Tobii ABInventors: Tiesheng Wang, Pravin Kumar Rana, Yimu Wang, Mark Ryan
-
Patent number: 11256327Abstract: The invention relates to an eye tracking device comprising one or more illuminators, each illuminator comprising a light emitting side, and each illuminator being connected to a first circuitry carrier, an imaging module connected to a second circuitry carrier wherein the image module comprises optical arrangements. The plurality of illuminators, the imaging module and the circuitry carriers are embedded without gaps in a first material. The invention further relates to methods for manufacturing an eye tracking device with over-molded components.Type: GrantFiled: June 13, 2019Date of Patent: February 22, 2022Assignee: Tobii ABInventors: Eli Lundberg, Richard Hainzl, Daniel Tornéus
-
Patent number: 11249547Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.Type: GrantFiled: October 31, 2019Date of Patent: February 15, 2022Assignee: Tobii ABInventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
-
Publication number: 20220043509Abstract: A system configured to enable operation of an apparatus based on the gaze of a user, the system comprising a processor, and a memory comprising instructions executable by the processor, wherein the system is configured to determine a gaze region of a user among a plurality of regions associated with the apparatus, wherein the plurality of regions comprises at least one primary gaze region and at least one secondary gaze region and perform at least one action based on the determination of the gaze region, wherein the system is configured to determine the gaze region using a first gaze estimation algorithm and/or a second gaze estimation algorithm.Type: ApplicationFiled: June 29, 2020Publication date: February 10, 2022Applicant: Tobii ABInventors: Anders Dahl, Tommaso Martini, Oscar Danielsson, Mårten Nilsson, Patrik Barkman
-
Patent number: 11243607Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.Type: GrantFiled: May 23, 2019Date of Patent: February 8, 2022Assignee: Tobii ABInventors: Pravin Kumar Rana, Yimu Wang
-
Patent number: 11232594Abstract: The invention is related to a method for calibrating an eye tracking device within a head-mounted display (HMD) comprising the steps of acquiring with the HMD via an image sensor, at least one optical target image from an optical target, wherein the optical target contains image points in a pattern, indexing image points within the optical target image wherein the image points are indexed by, selecting a rigid region of the optical target image, assigning indices to image points within the rigid region, fitting a polynomial approximation function to at least one column and one row of the image points of the region, predicting the location of at least one image point using the fitted polynomial approximation function, assigning the predicted image point an index, inputting indexed image points into an optimization algorithm that calculates a hardware calibration of the HMD, and writing hardware calibration values calculated from the optimization algorithm to the HMD unit.Type: GrantFiled: October 23, 2020Date of Patent: January 25, 2022Assignee: Tobii ABInventors: Pravin Kumar Rana, Macarena Garcia Romero, Yimu Wang, Rickard Lundahl
-
Patent number: 11226682Abstract: A lens for eye tracking applications is described. The lens comprises a first protective layer with a first surface, arranged to face towards the eye to be tracked when the lens is used for eye tracking. The lens is characterized in that the lens further comprises a supporting layer and a second protective layer with a second surface, arranged to face away from the eye to be tracked when the lens is used for eye tracking. The supporting layer is arranged between the first protective layer and the second protective layer, and the supporting layer comprises at least a first opening between the first protective layer and the second protective layer. At least one electrical component arranged extending through the first opening.Type: GrantFiled: January 31, 2020Date of Patent: January 18, 2022Assignee: Tobii ABInventors: Daniel Ljunggren, Anders Höglund, Axel Tollin, Jan Skagerlund
-
Publication number: 20220011584Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.Type: ApplicationFiled: April 30, 2021Publication date: January 13, 2022Applicant: Tobii ABInventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
-
Patent number: 11209901Abstract: The present disclosure relates to an eye tracking method as well as a corresponding system and computer-readable storage medium. Calibration is performed. The calibration comprises estimating values for a plurality of parameters defining respective optical properties of an eye. The plurality of parameters includes a radius of a cornea of the eye. Eye tracking for the eye is performed using the values estimated at the calibration. An updated value of the cornea radius is estimated. Eye tracking for the eye is performed using the updated value of the cornea radius and a value estimated at the calibration for a parameter other than the cornea radius of the eye. The cornea radius of an eye may change over time. This may cause degradation of eye tracking performance. This problem may be reduced or prevented by estimating an updated value of the cornea radius.Type: GrantFiled: December 23, 2019Date of Patent: December 28, 2021Assignee: Tobii ABInventor: Andreas Klingström
-
Publication number: 20210349607Abstract: Visualizable data are obtained that represent a scene with at least one object. The visualizable data describe the scene as seen from a position. First and second measures are determined, which represent extensions of one of the objects in a smallest and a largest dimension respectively. An object aspect ratio is calculated that represents a relationship between the first and second measures. Based on the object aspect ratio, a selection margin is assigned to the object. The selection margin designates a zone outside of the object within which zone the object is validly selectable for manipulation in addition to an area of the object shown towards a view thereof as seen from the position. Thus, it is made easier to manipulatable the visualizable data in response to user input, for instance in the form of gaze-based selection commands.Type: ApplicationFiled: March 31, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: Robin Thunström, Staffan Widegarn Åhlvik
-
Publication number: 20210347364Abstract: The invention is related to a method for driver alertness detection, The method comprises the steps of determining a vanishing point of a vehicle in motion; determining over time, by an eye tracking device, a set of gaze points of the driver of the vehicle; determining a gaze movement from the set of gaze points; and identifying an alertness of the driver, based on a direction of the gaze movement relative to the vanishing point being outward. Further, the invention is related to an eye tracking device for driver alertness detection, an alertness detection system, a computer program, and a computer-readable medium.Type: ApplicationFiled: April 9, 2021Publication date: November 11, 2021Applicant: Tobii ABInventor: Andrew Ratcliff
-
Publication number: 20210345923Abstract: There is provided mechanisms for eye position determination of a subject depicted in an image set. A method comprises obtaining first information indicating a first set of eye positions of the subject by applying a first eye tracking procedure on an image set depicting the subject. The first eye tracking procedure uses a first set of features extracted from the image set for obtaining the first set of eye positions. The method comprises obtaining second information indicating a second set of eye positions of the subject by applying a second eye tracking procedure on the image set depicting the subject. The second eye tracking procedure uses a second set of features extracted from the image set for obtaining the second set of eye positions.Type: ApplicationFiled: April 21, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
-
Publication number: 20210350565Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.Type: ApplicationFiled: April 28, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: Fogelström, Per Fogelström, Per, Redz, Anna Redz, Anna, Dahl, Anders Dahl, Anders, Ollesson, Niklas Ollesson, Niklas
-
Publication number: 20210350554Abstract: An eye-tracking system configured to: receive a reference-image of an eye of a user, the reference-image being associated with reference-eye-data; receive one or more sample-images of the eye of the user; and, for each of the one or more sample-images: determine a difference between the reference-image and the sample-image to define a corresponding differential-image; and determine eye-data for the sample-image based on the differential-image and the reference-eye-data associated with the reference-image.Type: ApplicationFiled: March 31, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: David Masko, Mark Ryan, Mattias Kuldkepp
-
Patent number: 11169604Abstract: A method for determining gaze calibration parameters for gaze estimation of a viewer using an eye-tracking system. The method comprises obtaining a set of data points including gaze tracking data of the viewer and position information of at least one target visual; selecting a first subset of the data points and determining gaze calibration parameters using said first subset. A score for the gaze calibration parameters is determined by using the gaze calibration parameters with a second subset of data points, wherein at least one data point of the subset is not included in the first subset. The score is indicative of the capability of the gaze calibration parameters to reflect position information of the at least one target visual based on the gaze tracking data. The score is compared to a candidate score and if it is higher, the calibration parameters are set to the candidate calibration parameters and the score to the candidate score.Type: GrantFiled: November 16, 2020Date of Patent: November 9, 2021Assignee: Tobii ABInventors: Patrik Barkman, David Molin
-
Publication number: 20210342000Abstract: Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device displays a representation of a second user on a display of the first computing device. Further, the first computing device receives from the first user, communication data generated by an input device. The first computing device determines if the gaze direction of the first user is directed to the representation of the second user. If the gaze direction of the first user is directed to the representation of the second user, the first computing device transmits the communication data to a second computing device of the second user.Type: ApplicationFiled: June 1, 2021Publication date: November 4, 2021Applicant: Tobii ABInventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Andrew Ratcliff, Regimantas Vegele, Geoffrey Cooper, Niklas Blomqvist