Patents Assigned to TOBII AB
  • Patent number: 10671890
    Abstract: Techniques for generating 3D gaze predictions based on a deep learning system are described. In an example, the deep learning system includes a neural network. The neural network is trained with training images generated by cameras and showing eyes of user while gazing at stimulus points. Some of the stimulus points are in the planes of the camera. Remaining stimulus points are not un the planes of the cameras. The training includes inputting a first training image associated with a stimulus point in a camera plane and inputting a second training image associated with a stimulus point outside the camera plane. The training minimizes a loss function of the neural network based on a distance between at least one of the stimulus points and a gaze line.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: June 2, 2020
    Assignee: Tobii AB
    Inventor: Erik Linden
  • Publication number: 20200166994
    Abstract: Techniques for controlling light sources used in eye tracking are described. In an example, an eye tracking system generates a first image and a second image showing at least a portion of the user eye illuminated by a predetermined set of illuminators of the eye tracking system. The eye tracking system determines a first position of a glint in the first image and a second position of the glint in the second image. Each of the first position and the second position is relative to a pupil edge. The eye tracking system predicts a third position of the glint relative to the pupil edge based on the first position and the second position. Further, the eye tracking system determines, from the predetermined set, an illuminator that corresponds to the glint and determines, based on the third position, whether to power off the illuminator to generate a third image of at least the portion of the user eye.
    Type: Application
    Filed: November 26, 2018
    Publication date: May 28, 2020
    Applicant: Tobii AB
    Inventors: Daniel Johansson Tornéus, Andreas Klingström, Martin Skärbäck
  • Patent number: 10664051
    Abstract: A graphics presentation apparatus including a display unit, an eye-tracking module, and a data output module. The eye-tracking module registers image data representing at least one eye of a user of the apparatus. Furthermore, the eye-tracking module determines, based on the registered image data, an orientation of the at least one eye relative to the display unit. Finally, in response thereto, the eye-tracking module generates a control signal controlling the data output module to produce visual content with such orientation on the display unit that a misalignment between the orientation of said at least one part and the orientation of the at least one eye of the user is minimized.
    Type: Grant
    Filed: October 26, 2018
    Date of Patent: May 26, 2020
    Assignee: Tobii AB
    Inventors: Aron Yu, Marten Skogo, Robert Gavelin, Per Nystedt
  • Publication number: 20200160052
    Abstract: According to the invention, an image sensor is disclosed. The image sensor may include a plurality of pixels. Each pixel of a first portion of the plurality of pixels may include a near-infrared filter configured to block red, green, and blue light; and pass near-infrared light. Each pixel of a second portion of the plurality of pixels may be configured to receive at least one of red, green, or blue light; and receive near-infrared light.
    Type: Application
    Filed: September 23, 2019
    Publication date: May 21, 2020
    Applicant: Tobii AB
    Inventors: Mårten Skogö, Peter Blixt, Henrik Jönsson
  • Publication number: 20200154996
    Abstract: A method includes obtaining an image of an eye in a bright-pupil imaging mode in which a retinal retro-reflection complements the image of the eye in the bright-pupil mode, and obtaining an image of the eye in a dark-pupil imaging mode in which a corneo-scleral retro-reflection complements the image of the eye in the dark-pupil mode. One of the bright-pupil imaging mode and the dark-pupil imaging mode is selected based on quality of obtained images.
    Type: Application
    Filed: June 10, 2019
    Publication date: May 21, 2020
    Applicant: Tobii AB
    Inventors: Peter Blixt, Gunnar Troili, Anders Kingbäck, John Mikael Elvesjö, Mårten Skogö
  • Publication number: 20200159316
    Abstract: The present invention relates to systems and methods for assisting a user when interacting with a graphical user interface by combining eye based input with input for e.g. selection and activation of objects and object parts and execution of contextual actions related to the objects and object parts. The present invention also relates to such systems and methods in which the user can configure and customize specific combinations of eye data input and input that should result in a specific contextual action.
    Type: Application
    Filed: June 19, 2019
    Publication date: May 21, 2020
    Applicant: Tobii AB
    Inventors: Aron YU, John Mikael HOLTZ ELVESJO
  • Publication number: 20200159012
    Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light
    Type: Application
    Filed: June 28, 2019
    Publication date: May 21, 2020
    Applicant: Tobii AB
    Inventors: Daniel Tornèus, Peter Schef, Magnus Arvidsson, Peter Blixt
  • Patent number: 10642028
    Abstract: A system for adjusting a position of a lens in a wearable device is provided. The system may include a wearable device and a processor. The wearable device may include a display, a lens movably disposed in front of the display, and an eye tracking device including an illuminator and an image sensor. The processor may receive data from the eye tracking device, and determine, based on the data, a first position of the eye of a user wearing the wearable device, where the position is relative to a second position which is fixed with respect to the lens. The processor may also be configured to determine a distance between the first position and the second position, and if the distance is greater than a first value, cause information to be presented to the user indicating that the lens should be moved to a more optimal position.
    Type: Grant
    Filed: February 9, 2018
    Date of Patent: May 5, 2020
    Assignee: Tobii AB
    Inventors: Pravin Rana, Daniel Tornéus
  • Publication number: 20200133003
    Abstract: Disclosed is a method for detecting a shadow in an image of an eye region of a user wearing a Head Mounted Device, HMD. The method comprises obtaining, from a camera of the HMD, an image of the eye region of the user wearing a HMD and determining an area of interest in the image, the area of interest comprising a plurality of subareas. The method further comprises determining a first brightness level for a first subarea of the plurality of subareas and determining a second brightness level for a second subarea of the plurality of subareas. The method further comprises comparing the first brightness level with the second brightness level, and, based on the comparing, selectively generating a signal indicating a shadow.
    Type: Application
    Filed: October 28, 2019
    Publication date: April 30, 2020
    Applicant: Tobii AB
    Inventors: Yimu Wang, Ylva Björk, Joakim Zachrisson, Pravin Kumar Rana
  • Publication number: 20200134867
    Abstract: There is provided a method and system for determining if a head-mounted device for extended reality (XR) is correctly positioned on a user, and optionally performing a position correction procedure if the head-mounted device is determined to be incorrectly positioned on the user. Embodiments include: performing eye tracking by estimating, based on a first image of a first eye of the user, a position of a pupil in two dimensions; determining whether the estimated position of the pupil of the first eye is within a predetermined allowable area in the first image; and, if the determined position of the pupil of the first eye is inside the predetermined allowable area, concluding that the head-mounted device is correctly positioned on the user; or, if the determined position of the pupil of the first eye is outside the predetermined allowable area, concluding that the head-mounted device is incorrectly positioned on the user.
    Type: Application
    Filed: October 25, 2019
    Publication date: April 30, 2020
    Applicant: Tobii AB
    Inventors: Joakim Zachrisson, Mikael Rosell, Carlos Pedreira, Mark Ryan, Simon Johansson
  • Patent number: 10635900
    Abstract: A method of presenting gaze-point data of a subject detected by an eye-tracking unit includes presenting a test scene picture acquired by a camera unit, and displaying shapes on the test scene picture. The shapes represent momentary gaze points of the subject.
    Type: Grant
    Filed: October 2, 2017
    Date of Patent: April 28, 2020
    Assignee: Tobii AB
    Inventors: Johan Strombom, Marten Skogo, Per Nystedt, Simon Gustafsson, John Mikael Holtz Elvesjo, Peter Blixt
  • Patent number: 10635169
    Abstract: A system for determining a gaze direction of a user is disclosed. The system may include a first illuminator, a first profile sensor, and at least one processor. The first illuminator may be configured to illuminate an eye of a user. The first profile sensor may be configured to detect light reflected by the eye of the user. The processor(s) may be configured to determine a gaze direction of the user based at least in part on light detected by the first profile sensor.
    Type: Grant
    Filed: May 18, 2018
    Date of Patent: April 28, 2020
    Assignee: Tobii AB
    Inventors: Simon Gustafsson, Daniel Johansson Tornéus, Jonas Andersson, Johannes Kron, Mårten Skogö, Ralf Biedert
  • Patent number: 10635386
    Abstract: According to the invention, a method for providing audio to a user is disclosed. The method may include determining, with an eye tracking device, a gaze point of a user on a display. The method may also include causing, with a computer system, an audio device to produce audio to the user, where content of the audio may be based at least in part on the gaze point of the user on the display.
    Type: Grant
    Filed: August 21, 2017
    Date of Patent: April 28, 2020
    Assignee: TOBII AB
    Inventors: Anders Vennström, Fredrik Lindh
  • Publication number: 20200125167
    Abstract: An eye/gaze tracking system (100) receives first and second image streams (DIMG1, DIMG2) in first and second processing lines (110; 120) respectively. The first processing line (110) has at least one first processor (P1, P11, P12) generating a first set of components of eye-specific data (p1LG, p1LP, p1RG, p1RP) for producing eye/gaze data (DE/G). The second processing line (120) has at least one second processor (P2, P21, P22) generating a second set of components of eye-specific data (p2LG, p2LP, p2RG, p2RP) for producing the eye/gaze data (DE/G). The eye/gaze data (DE/G) describe an eye position and/or a gaze point of the subject (U).
    Type: Application
    Filed: December 30, 2016
    Publication date: April 23, 2020
    Applicant: Tobii AB
    Inventors: Anders Dahl, Oscar Mattias Danielsson
  • Publication number: 20200110440
    Abstract: A wearable device is disclosed. The wearable device may include a display, a lens, an illuminator, an image sensor, and at least one processor. The display may be configured to present images. The lens may be configured to provide a view of the display to an eye of a user. The illuminator may be configured to illuminate the eye. The image sensor may be configured to detect illumination reflected by the eye. The at least one processor may be configured to cause the display to present an image, receive data from the image sensor, determine a gaze direction of the eye based at least in part on the data from the image sensor, and cause at least one of the display or the lens to be moved until the gaze direction is directed toward the image.
    Type: Application
    Filed: September 12, 2019
    Publication date: April 9, 2020
    Applicant: Tobii AB
    Inventors: Henrik Eskilsson, Mårten Skogö
  • Patent number: 10614303
    Abstract: Circuitry of a gaze/eye tracking system obtains one or more images of a left eye and one or more images a right eye, determines a gaze direction of the left eye based on at least one obtained image of the left eye, determines a gaze direction of the right eye based on at least one obtained image of the right eye, determines a first confidence value based on the one or more obtained images of the left eye, determines a second confidence value based on the one or more obtained images of the right eye, and determines a final gaze direction based at least in part on the first confidence value and the second confidence value. The first and second confidence values represent indications of the reliability of the determined gaze directions of the left eye and the right eye, respectively. Corresponding methods and computer-readable media are also provided.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: April 7, 2020
    Assignee: Tobii AB
    Inventors: Andreas Klingström, Mattias Kuldkepp, Mårten Skogö
  • Publication number: 20200106961
    Abstract: An imaging device adapted to provide eye-tracking data by imaging at least one eye of a viewer, wherein: the imaging device is switchable between at least an active mode and a ready mode; the imaging device is configured, in the active mode, to use active eye illumination, which enables tracking of a corneal reflection, and to provide eye tracking data which include eye position and eye orientation; and the imaging device is configured, in the ready mode, to reduce an illumination intensity from a value the illumination intensity has in the active mode.
    Type: Application
    Filed: April 8, 2019
    Publication date: April 2, 2020
    Applicant: Tobii AB
    Inventors: Henrik Eskilsson, Mårten Skogö, John Elvesjö, Peter Blixt
  • Patent number: 10607401
    Abstract: A method for determining a focus target of a user's gaze in a three-dimensional (“3D”) scene is disclosed. The method may include determining a first gaze direction of a user into a 3D scene, where the 3D scene includes a plurality of components. The method may also include executing a first plurality of line traces in the 3D scene, where each of the first plurality of line traces is in proximity to the first gaze direction. The method may further include determining a confidence value for each component intersected by at least one of the first plurality of line traces. The method may additionally include identifying as a focus target of the user the component having the highest confidence value of all components intersected by at least one of the first plurality of line traces.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: March 31, 2020
    Assignee: Tobii AB
    Inventor: Fredrik Lindh
  • Patent number: 10607075
    Abstract: A method for mapping an input device to a virtual object in virtual space displayed on a display device is disclosed. The method may include determining, via an eye tracking device, a gaze direction of a user. The method may also include, based at least in part on the gaze direction being directed to a virtual object in virtual space displayed on a display device, modifying an action to be taken by one or more processors in response to receiving a first input from an input device. The method may further include, thereafter, in response to receiving the input from the input device, causing the action to occur, wherein the action correlates the first input to an interaction with the virtual object.
    Type: Grant
    Filed: March 20, 2018
    Date of Patent: March 31, 2020
    Assignee: Tobii AB
    Inventors: Simon Gustafsson, Alexey Bezugly, Anders Kingbäck, Anders Clausen
  • Patent number: 10599214
    Abstract: According to the invention, a method for dismissing information from a display device based on a gaze input is disclosed. The method may include determining that an object has been displayed on a display device. The method may also include determining an area on the display device associated with the object. The method may further include determining a gaze location of a user on the display device. The method may additionally include causing the object to not be displayed on the display device, based at least in part on the gaze location being located within the area for at least a first predetermined length of time.
    Type: Grant
    Filed: October 21, 2015
    Date of Patent: March 24, 2020
    Assignee: Tobii AB
    Inventor: Erland George-Svahn