Patents Assigned to Tobii Technology AB
  • Patent number: 9244170
    Abstract: A visual display includes hidden reference illuminators adapted to emit invisible light for generating corneo-scleral reflections on an eye watching a screen surface of the display. The tracking of such reflections and the pupil center provides input to gaze tracking. A method for equipping and an LCD with a reference illuminator are also provided. Also provides are a system and method for determining a gaze point of an eye watching a visual display that includes reference illuminators. The determination of the gaze point may be based on an ellipsoidal cornea model.
    Type: Grant
    Filed: September 18, 2013
    Date of Patent: January 26, 2016
    Assignee: Tobii Technology AB
    Inventors: Peter Blixt, Anders Hoglund, Bengt Rehnstrom, John Elvesjö, Mattias Kuldkepp
  • Patent number: 9179838
    Abstract: An eye/gaze tracker with first and second light sources each configured to illuminate an eye of a subject and controlled to selectively emit light towards the eye in such a manner that within an operation sequence the eye is illuminated by the first light source during at least one first interval and by the second light source during at least one second interval. An image sensor has a plurality of photodiodes each of which is associated with first and second charge storages configured to store electric charges based on an amount of light reaching the photodiode. At least one switch of the image sensor is controlled such that the electric charges are stored in the first charge storage as a result of the illumination during the at least one first interval and in the second charge storage as a result of the illumination during the at least one second interval.
    Type: Grant
    Filed: March 7, 2014
    Date of Patent: November 10, 2015
    Assignee: Tobii Technology AB
    Inventors: Marten Skogo, Henrik Jonsson, John Elvesjo
  • Patent number: 8976110
    Abstract: A personal computer system includes a visual display, an imaging device adapted to provide eye-tracking data by imaging the face of a viewer of the visual display, and an input device for accepting eye-tracking control data and other input data. The imaging device is switchable between at least an active mode, a ready mode and an idle mode, and the switching time from the idle mode to the active mode is longer than the switching time from the ready mode to the active mode. The eye-tracking data provided in the ready mode may include eye position but not eye orientation. The system may include a dedicated input device for forcing the imaging device into active mode by directly triggering an interrupt; alternatively, the dedicated input device forces it permanently into idle mode.
    Type: Grant
    Filed: October 27, 2011
    Date of Patent: March 10, 2015
    Assignee: Tobii Technology AB
    Inventors: Henrik Eskilsson, Mårten Skogö, John Elvesjö, Peter Blixt
  • Patent number: 8944600
    Abstract: An eye tracker includes at least one illuminator for illuminating an eye, at least two cameras for imaging the eye and a controller. The configuration of the reference illuminator and cameras is such that, at least one camera is coaxial with a reference illuminator and at least one camera is non-coaxial with a reference illuminator. The controller selects one of the cameras to be active to increase an image quality metric and avoid obscuring objects. The eye tracker is operable in a dual-camera mode to improve accuracy.
    Type: Grant
    Filed: December 17, 2012
    Date of Patent: February 3, 2015
    Assignee: Tobii Technology AB
    Inventors: Peter Blixt, Gunnar Troili, Anders Kingback, John Mikael Elvesjö, Mårten Skogö
  • Publication number: 20140354539
    Abstract: A personal computer system provides a gaze-controlled graphical user interface having a bidirectional and a unidirectional interaction mode. In the bidirectional interaction mode, a display shows one or more graphical controls in motion, each being associated with an input operation to an operating system. A gaze tracking system provides gaze point data of a viewer, and a matching module attempts to match a relative gaze movement against a relative movement of one of the graphical controls. The system includes a selector which is preferably controllable by a modality other than gaze. The system initiates a transition from the unidirectional interaction mode to the bidirectional interaction mode in response to an input received at the selector. The display then shows graphical controls in motion in a neighbourhood of the current gaze point, as determined based on current gaze data.
    Type: Application
    Filed: May 29, 2014
    Publication date: December 4, 2014
    Applicant: Tobii Technology AB
    Inventors: Mårten SKOGÖ, John Mikael ELVESJÖ, Anders OLSSON
  • Patent number: 8902070
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Grant
    Filed: November 16, 2012
    Date of Patent: December 2, 2014
    Assignee: Tobii Technology AB
    Inventors: Miroslav Kobetski, Peter Blixt, Johnny Holmberg, John Mikael Elvesjo
  • Publication number: 20140320688
    Abstract: An image sensing apparatus has a light sensitive area and a control unit. The light sensitive area registers image data in response to an incoming amount of light, and is operable in an active mode wherein image data can be read out there from as well as in a standby mode wherein image data cannot be read out. The control unit produces a control signal setting the light sensitive area to operate in the active mode and the standby mode respectively in a cyclic manner during an operation period, which preferably encompasses multiple data frame read-outs of image data from the light sensitive area.
    Type: Application
    Filed: April 10, 2014
    Publication date: October 30, 2014
    Applicant: Tobii Technology AB
    Inventors: Marten Skogo, Henrik Jonsson, Mattias O. Karlsson, Mattias Kuldkepp, John Elvesjo, Ingemar Mattias Karlsson
  • Publication number: 20140268055
    Abstract: An eye/gaze tracker with first and second light sources each configured to illuminate an eye of a subject and controlled to selectively emit light towards the eye in such a manner that within an operation sequence the eye is illuminated by the first light source during at least one first interval and by the second light source during at least one second interval. An image sensor has a plurality of photodiodes each of which is associated with first and second charge storages configured to store electric charges based on an amount of light reaching the photodiode. At least one switch of the image sensor is controlled such that the electric charges are stored in the first charge storage as a result of the illumination during the at least one first interval and in the second charge storage as a result of the illumination during the at least one second interval.
    Type: Application
    Filed: March 7, 2014
    Publication date: September 18, 2014
    Applicant: Tobii Technology AB
    Inventors: Marten Skogo, Henrik Jonsson, John Elvesjo
  • Publication number: 20140247215
    Abstract: A computer system can be controlled with non-contact inputs, such as eye-tracking devices. A visual indicator can be presented on a display to indicate the location where a computer function will take place (e.g., a common cursor). The visual indicator can be moved to a gaze target in response to continued detection of an action (e.g., touchpad touch) by a user for a predetermined period of time. The delay between the action and the movement of the visual indicator can allow a user time to “abort” movement of the visual indicator. Additionally, once the visual indicator has moved, the visual indicator can be controlled with additional precision as the user moves gaze while continuing the action (e.g., continued holding of the touchpad).
    Type: Application
    Filed: March 3, 2014
    Publication date: September 4, 2014
    Applicant: Tobii Technology AB
    Inventors: Erland George-Svahn, David Figgins Henderek, Rebecka Lannsjö, Mårten Skogö, John Elvesjö
  • Publication number: 20140247210
    Abstract: A computer system can be controlled with non-contact inputs through zonal control. In an embodiment, a non-contact input that is an eye-tracking device is used to track the gaze of a user. A computer's display, and beyond, can be separated into a number of discrete zones according to a configuration. Each zone is associated with a computer function. The zones and/or their functions can, but need not, be indicated to the user. The user can perform the various functions by moving gaze towards the zone associated with that function and providing an activation signal of intent. The activation signal of intent can be a contact-required or non-contact action, such as a button press or dwelling gaze, respectively.
    Type: Application
    Filed: March 3, 2014
    Publication date: September 4, 2014
    Applicant: Tobii Technology AB
    Inventors: David Figgins Henderek, Anders Olsson, Magnus Carl Olof Sävmarker, Staffan Wingren
  • Publication number: 20140247208
    Abstract: Waking a computing device from a stand-by mode may include determining a wake zone relative to a display device and, when the computing device is in stand-by mode, detecting a gaze point relative to the display device. In response to determining that the gaze point is within the wake zone, a wake command is generated and passed to a program module, such as the operating system, to cause the program module to wake the computing device from the stand-by mode. When the computing device is not in stand-by mode, another gaze point may be detected and, in response to determining that the other gaze point is within the vicinity of a selectable stand-by icon, the stand-by command is generated and passed to the program module to cause the program module to place the computing device into the stand-by mode.
    Type: Application
    Filed: May 14, 2013
    Publication date: September 4, 2014
    Applicant: Tobii Technology AB
    Inventors: David Henderek, Mårten Skogö, John Elvesjö
  • Publication number: 20140168271
    Abstract: A graphics presentation apparatus including a display unit, an eye-tracking module, and a data output module. The eye-tracking module registers image data representing at least one eye of a user of the apparatus. Furthermore, the eye-tracking module determines, based on the registered image data, an orientation of the at least one eye relative to the display unit. Finally, in response thereto, the eye-tracking module generates a control signal controlling the data output module to produce visual content with such orientation on the display unit that a misalignment between the orientation of said at least one part and the orientation of the at least one eye of the user is minimized.
    Type: Application
    Filed: December 11, 2013
    Publication date: June 19, 2014
    Applicant: Tobii Technology AB
    Inventors: Aron Yu, Marten Skogo, Robert Gavelin, Per Nystedt
  • Publication number: 20140062868
    Abstract: A visual display includes hidden reference illuminators adapted to emit invisible light for generating corneo-scleral reflections on an eye watching a screen surface of the display. The tracking of such reflections and the pupil center provides input to gaze tracking. A method for equipping and an LCD with a reference illuminator are also provided. Also provides are a system and method for determining a gaze point of an eye watching a visual display that includes reference illuminators. The determination of the gaze point may be based on an ellipsoidal cornea model.
    Type: Application
    Filed: September 18, 2013
    Publication date: March 6, 2014
    Applicant: Tobii Technology AB
    Inventors: PETER BLIXT, Anders Hoglund, Bengt Rehnstrom, John Elvesjö, Mattias Kuldkepp
  • Publication number: 20140043227
    Abstract: A gaze tracking system, leaving a low power mode in response to an activation signal, captures an initial burst of eye pictures in short time by restricting the image area of a sensor, with the purpose of enabling an increased frame rate. Subsequent eye pictures are captured at normal frame rate. The first gaze point value is computed memorylessly based on the initial burst of eye pictures and no additional imagery, while subsequent values may be computed recursively by taking into account previous gaze point values or information from previous eye pictures. The restriction of the image area may be guided by a preliminary overview picture captured using the same or a different sensor. From the gaze point values, the system may derive a control signal to be supplied to a computer device with a visual display.
    Type: Application
    Filed: August 8, 2013
    Publication date: February 13, 2014
    Applicant: Tobii Technology AB
    Inventors: Mårten SKOGÖ, Anders OLSSON, John Mikael ELVESJÖ, Aron YU
  • Publication number: 20140009390
    Abstract: A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands An event engine is adapted to receive an eye-tracking data signal that describes a user's point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user's ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.
    Type: Application
    Filed: August 6, 2013
    Publication date: January 9, 2014
    Applicant: Tobii Technology AB
    Inventors: Christoffer BJÖRKLUND, Henrik ESKILSSON, Magnus JACOBSON, Mårten SKOGÖ
  • Patent number: 8610768
    Abstract: The invention generally relates to systems and methods for eye detection for use in, for example, installations and systems for tracking eyes and gaze angle/directions. The system includes a plurality of eye detection units connected to an image sensor. The eye detection units are adapted to receive regions of picture elements of a digital image frame substantially in parallel and wherein the eye detection units are adapted to operate substantially in parallel, each eye detection unit being adapted to receive a specified region of the picture elements of at least one digital image frame and including an eye feature extraction module adapted to perform a eye feature extraction process on the received picture elements to identify predetermined eye features.
    Type: Grant
    Filed: July 9, 2010
    Date of Patent: December 17, 2013
    Assignee: Tobii Technology AB
    Inventors: Johnny Holmberg, Peter Blixt, John Elvesjö
  • Patent number: 8562136
    Abstract: A visual display characterized by hidden reference illuminators is adapted to emit invisible light for generating corneo-scleral reflections on an eye watching a screen surface of the display. The tracking of such reflections and the pupil center provides input for gaze tracking. A method for equipping and an LCD with a reference illuminator are also provided. A system and method for determining a gaze point of an eye watching a visual display comprising reference illuminators are further provided. The determination of the gaze point may be based on an ellipsoidal cornea model.
    Type: Grant
    Filed: May 7, 2012
    Date of Patent: October 22, 2013
    Assignee: Tobii Technology AB
    Inventors: Peter Blixt, Anders Hoglund, Bengt Rehnstrom, John Elvesjö
  • Publication number: 20130107214
    Abstract: An eye tracker includes at least one illuminator for illuminating an eye, at least two cameras for imaging the eye and a controller. The configuration of the reference illuminator and cameras is such that, at least one camera is coaxial with a reference illuminator and at least one camera is non-coaxial with a reference illuminator. The controller selects one of the cameras to be active to increase an image quality metric and avoid obscuring objects. The eye tracker is operable in a dual-camera mode to improve accuracy.
    Type: Application
    Filed: December 17, 2012
    Publication date: May 2, 2013
    Applicant: Tobii Technology AB
    Inventor: Tobii Technology AB
  • Publication number: 20130076885
    Abstract: A monitoring system and method for monitoring and/or predicting drowsiness of a driver of a vehicle or a machinery operator are provided. A set of infrared, IR, or near infrared, NIR, light sources, is arranged such that an amount of the light emitted from the light source incidents on an eye of the driver or operator. The light that impinges on the eye of the driver or operator forms a virtual image of the signal sources on the eye including the sclera and/or cornea. An image sensor obtains consecutive images capturing the reflected light, wherein each image will contain glints from at least a subset or all of the light sources. A drowsiness index can be determined based on the extracted information of the glints of the sequence of images, wherein the drowsiness index indicates a degree of drowsiness of the driver or operator.
    Type: Application
    Filed: November 16, 2012
    Publication date: March 28, 2013
    Applicant: Tobii Technology AB
    Inventor: Tobii Technology AB
  • Patent number: 8342687
    Abstract: Provided is a method of determining a gaze point of an eye watching a visual display controllable by a display signal. The method comprises generating a display signal using a graphics card in order for the visual display to produce a screen pattern; receiving a signal encoding an image of the eye including a corneo-scleral reflection of the screen pattern; and determining, based on in part the geometry of said reflection, a gaze point of the eye, wherein said determining a gaze point includes utilizing the graphics card as a parallel processor. The image of the eye may be received directly at the graphics card. The graphics card may extract image features in the eye images. Reference illuminators may be used, and the screen pattern may be interlaced with a distinctive reference pattern. Further provided are a gaze-tracking system and a personal computer system adapted to determine a gaze point of a viewer.
    Type: Grant
    Filed: September 29, 2010
    Date of Patent: January 1, 2013
    Assignee: Tobii Technology AB
    Inventors: Peter Blixt, Miroslav Kobetski, Anders Hoglund