Patents Assigned to TOBII AB
-
Patent number: 11687156Abstract: The invention relates to an eye tracking device comprising one or more illuminators, each illuminator comprising a light emitting side, and each illuminator being connected to a first circuitry carder, an imaging module connected to a second circuitry carrier wherein the image module comprises optical arrangements. The plurality of illuminators, the imaging module and the circuitry carriers are embedded without gaps in a first material. The invention further relates to methods for manufacturing an eye tracking device with over-molded components.Type: GrantFiled: February 22, 2022Date of Patent: June 27, 2023Assignee: Tobii ABInventors: Eli Lundberg, Richard Hainzl, Daniel Torneus
-
Patent number: 11688128Abstract: A method for determining a focus target of a user's gaze in a three-dimensional (“3D”) scene is disclosed. The method may include determining a first gaze direction of a user into a 3D scene, where the 3D scene includes a plurality of components. The method may also include executing a first plurality of line traces in the 3D scene, where each of the first plurality of Line traces is in proximity to the first gaze direction. The method may further include determining a confidence value for each component intersected by at least one of the first plurality of line traces. The method may additionally include identifying as a focus target of the user the component having the highest confidence value of all components intersected by at least one of the first plurality of line traces.Type: GrantFiled: January 11, 2022Date of Patent: June 27, 2023Assignee: Tobii ABInventor: Fredrik Lindh
-
Patent number: 11681366Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.Type: GrantFiled: January 13, 2022Date of Patent: June 20, 2023Assignee: Tobii ABInventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
-
Patent number: 11681371Abstract: An eye tracking system comprising a controller configured to receive a reference image of an eye of a user and a current image of the eye of the user. The controller is also configured to determine a difference between the reference image and the current image to define a differential image. The differential image has a two dimensional pixel array of pixel locations that are arranged in a plurality of rows and columns. Each pixel location has a differential intensity value. The controller is further configured to calculate a plurality of row values by combining the differential intensity values in corresponding rows of the differential image and to determine eyelid data based on the plurality of row values.Type: GrantFiled: June 30, 2022Date of Patent: June 20, 2023Assignee: Tobii ABInventors: Joakim Zachrisson, Simon Johansson, Mikael Rosell, Daniel Wrang
-
Patent number: 11681368Abstract: An eye tracking system includes at least two cameras configured to register eye images of at least one eye. The system obtains eye images from at least one camera in a subset of the at least two cameras, determines a first pupil parameter based on a first eye image, and determines a second pupil parameter based on a second eye image. The system compares the first and second pupil parameters to obtain a test parameter and checks the test parameter against at least one operation criterion. Responsive to the checking, the system assigns a respective operation state to at least one camera in the subset. The operation state involves one of (A) operating the camera at a high frame rate, (B) operating the camera at a reduced frame rate being lower than high frame rate, (C) the camera being in a standby mode or (D) the camera being powered off.Type: GrantFiled: June 29, 2022Date of Patent: June 20, 2023Assignee: TOBII ABInventor: Pravin Kumar Rana
-
Publication number: 20230186682Abstract: An eye tracking device for tracking an eye is described. The eye tracking device comprises: a first diffractive optical element, DOE, arranged in front of the eye, an image module, wherein the image module is configured to capture an image of the eye via the first DOE. The first DOE is adapted to direct a first portion of incident light reflected from the eye, towards the image module. The eye tracking device is characterized in that the first DOE is configured to provide a lens effect.Type: ApplicationFiled: February 10, 2023Publication date: June 15, 2023Applicant: TOBII ABInventor: Daniel Tornéus
-
Patent number: 11675428Abstract: A system and a method for determining a gaze direction of a user viewing a scene is provided. The system comprises a camera for obtaining an image of at least one of the user's eyes, a depth information detection device for obtaining depth data related to the image, and a processing unit. The processing unit is configured to define a surface at a predetermined position relative to the user's eye based on the depth data, obtain a normalized image by projecting the image onto the surface and determine a normalized gaze direction based on the normalized image. The processing unit is further configured to determine a gaze direction based on the normalized gaze direction and the depth data.Type: GrantFiled: March 29, 2018Date of Patent: June 13, 2023Assignee: Tobii ABInventors: Oscar Danielsson, Daniel Johansson Torneus
-
Patent number: 11669162Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.Type: GrantFiled: April 5, 2022Date of Patent: June 6, 2023Assignee: Tobii ABInventor: Andreas Klingström
-
Patent number: 11665333Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.Type: GrantFiled: June 30, 2020Date of Patent: May 30, 2023Assignee: Tobii ABInventors: Daniel Tornéus, Torbjörn Sundberg, Magnus Arvidsson
-
Patent number: 11662595Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.Type: GrantFiled: May 23, 2022Date of Patent: May 30, 2023Assignee: Tobii ABInventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
-
Publication number: 20230154030Abstract: The invention is related to a method of estimating an orientation of an object in an image, comprising the steps of: calculating, for the object in the image, a probability distribution of rotation; and estimating the orientation of the object from the calculated probability distribution; wherein the step of calculating the probability distribution and/or the step of estimating the orientation of the object are executed by a neural network; wherein the probability distribution is a matrix Fisher probability density function; and wherein the step of calculating the probability distribution includes approximating a normalizing function for the matrix Fisher probability density function.Type: ApplicationFiled: April 29, 2021Publication date: May 18, 2023Applicant: Tobii ABInventors: David Molin, Gerald Bianchi
-
Patent number: 11622103Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.Type: GrantFiled: February 15, 2019Date of Patent: April 4, 2023Assignee: TOBII ABInventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
-
Patent number: 11619990Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for classifying glints using an eye tracking system of a head-mounted device, by obtaining the position of any glint present in a current image of the first eye; obtaining a dataset indicative of the respective position of at least one glint detected in one or more previously captured images of the first eye; and, for each glint present in current image, determining if the position of the glint corresponds to the position of a glint in the dataset and, if the positions correspond, classify the glint as a static glint. The static glints may be excluded from further processing in the eye tracking system. If there has been a movement of an eye of the user of the head-mounted device, embodiments may further comprise updating the dataset based on the current image.Type: GrantFiled: December 23, 2019Date of Patent: April 4, 2023Assignee: TOBII ABInventors: Mikael Rosell, Simon Johansson, Johannes Kron, Macarena Garcia Romero
-
Patent number: 11614798Abstract: A system for determining a gaze point of a user, the system comprising at least one sensor configured to determine at least one signal representative of a variation in a volume of the interior of a user's ear, and a processor configured to determine a direction of eye movement of the user based on the determined signal, and determine a gaze point of the user based on the direction of eye movement. Further, the disclosure relates to a corresponding method.Type: GrantFiled: March 30, 2020Date of Patent: March 28, 2023Assignee: TOBII ABInventor: Andrew Muehlhausen
-
Patent number: 11604510Abstract: A computer system can be controlled with non-contact inputs through zonal control. In an embodiment, a non-contact input that is an eye-tracking device is used to track the gaze of a user. A computer's display, and beyond, can be separated into a number of discrete zones according to a configuration. Each zone is associated with a computer function. The zones and/or their functions can, but need not, be indicated to the user. The user can perform the various functions by moving gaze towards the zone associated with that function and providing an activation signal of intent. The activation signal of intent can be a contact-required or non-contact action, such as a button press or dwelling gaze, respectively.Type: GrantFiled: December 16, 2019Date of Patent: March 14, 2023Assignee: TOBII ABInventors: David Figgins Henderek, Anders Olsson, Magnus Carl Olof Sävmarker, Staffan Wingren
-
Patent number: 11594075Abstract: An eye tracking device for tracking an eye is described. The eye tracking device comprises: a first diffractive optical element, DOE, arranged in front of the eye, an image module, wherein the image module is configured to capture an image of the eye via the first DOE. The first DOE is adapted to direct a first portion of incident light reflected from the eye, towards the image module. The eye tracking device is characterized in that the first DOE is configured to provide a lens effect.Type: GrantFiled: March 30, 2020Date of Patent: February 28, 2023Assignee: TOBII ABInventor: Daniel Tornéus
-
Patent number: 11592898Abstract: Techniques for changing the presentation of information on a user interface based on presence are described. In an example, a computer system determines, based on an image sensor associated with the system, a first presence of a first user relative to a computing device. The computer system also determines an identifier of the first user. The identifier is associated with operating the computing device. The operating comprises a presentation of the user interface by the computing device. The computer system also determines, based on the image sensor, a second presence of a second person relative to the computing device. The computer system causes an update to the user interface based on the second presence.Type: GrantFiled: November 9, 2018Date of Patent: February 28, 2023Assignee: Tobii ABInventors: Daniel Ricknäs, Erland George-Svahn, Rebecka Lannsjö, Regimantas Vegele, Andrew Ratcliff, Guido Hermans, Mattias Hanqvist, Simon Hugosson, Dmitrios Koufos, Morgan Viktorsson, Jonas Alexanderson, Siavash Moghaddam, Jimmy Carlsten, Martin Chrzan
-
Patent number: 11593962Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.Type: GrantFiled: December 29, 2020Date of Patent: February 28, 2023Assignee: TOBII ABInventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
-
Patent number: 11586281Abstract: A head mountable arrangement assists a subject to acquire spatial information about a surrounding environment by receiving gaze data from an eyetracker and spatial data from a distance sensor respectively. The gaze data describe an estimated point of regard of the subject, and the spatial data describe a distance between a reference point and an object in the surrounding environment. A feedback signal is provided, which indicates a distance from the subject to said object in the surrounding environment. The feedback signal is generated based on the estimated point of regard and the spatial data, and may reflect the distance to a surface element of an object that intersects a straight line between an eye-base line of the subject and the estimated point of regard, which surface element is located closer to the eye-base line than any other surface element of the objects in the surrounding environment along said straight line.Type: GrantFiled: February 19, 2020Date of Patent: February 21, 2023Assignee: TOBII ABInventors: Andrew Ratcliff, Daniel Tornéus, Eli Lundberg, Henrik Andersson
-
Patent number: 11580765Abstract: A method including providing a sensor device including one or several sensors. The sensor device is arranged to perform at least one high-power type measurement and at least one low-power type measurement and includes at least one image sensor arranged to depict a person by a measurement of said high-power type. Each of the low-power type measurements over time requires less electric power for operation as compared to each of the high-power type measurements. The method includes detecting a potential presence of the person using at least one of said low-power type measurements. The method includes producing, using one of the high-power type measurements, an image depicting a person and detecting a presence of the person based on im-age analysis of the image. The method includes detecting, using at least one of the low-power type measurements, a maintained presence of the person. The method includes failing to detect a maintained presence of the person.Type: GrantFiled: September 2, 2020Date of Patent: February 14, 2023Assignee: TOBII ABInventors: Dimitrios Koufos, Erland George-Svahn, Magnus Ivarsson