Patents by Inventor Niklas Ollesson

Niklas Ollesson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240416923
    Abstract: Method and apparatus, including computer programs, for providing a driver distraction signal and/or a system degradation signal indicating a reliability of the driver distraction signal, based on a gaze of a driver of a vehicle. Images of the driver of the vehicle are received, which contain information indicating a gaze of the driver. For each image, a gaze region for the driver is determined, including a gaze point and a gaze uncertainty value. For each image, the gaze region is associated with a region among several regions around the vehicle, wherein the regions include at least one pre-defined attentive region and at least one pre-defined inattentive region. Based on the determined gaze region, the gaze uncertainty value, and the region for a plurality of images, a driver distraction level and/or system degradation level indicating a reliability of the driver distraction level are determined.
    Type: Application
    Filed: June 5, 2024
    Publication date: December 19, 2024
    Inventors: PÉTER ALMÁSI, NIKLAS OLLESSON, ANJIN GABRIEL ALEXANDER SANTIAGO, OSKAR NORDMARK
  • Patent number: 12100176
    Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.
    Type: Grant
    Filed: December 6, 2022
    Date of Patent: September 24, 2024
    Assignee: Tobii AB
    Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
  • Patent number: 11632501
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: April 18, 2023
    Assignee: Tobil AB
    Inventors: Viktor Åberg, Niklas Ollesson, Anna Redz, Magnus Ivarsson
  • Publication number: 20230101049
    Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.
    Type: Application
    Filed: December 6, 2022
    Publication date: March 30, 2023
    Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
  • Patent number: 11570370
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second ex
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: January 31, 2023
    Assignee: Tobii AB
    Inventors: Magnus Ivarsson, Niklas Ollesson, Viktor Åberg, Anna Redz
  • Patent number: 11568560
    Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.
    Type: Grant
    Filed: April 28, 2021
    Date of Patent: January 31, 2023
    Assignee: Tobii AB
    Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
  • Patent number: 11438542
    Abstract: A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.
    Type: Grant
    Filed: June 19, 2020
    Date of Patent: September 6, 2022
    Assignee: Tobii AB
    Inventors: Niklas Ollesson, Magnus Ivarsson, Viktor Åberg, Anna Redz
  • Patent number: 11308321
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for performing three-dimensional, 3D, position estimation for the cornea center of an eye of a user, using a remote eye tracking system, wherein the position estimation is reliable and robust also when the cornea center moves over time in relation to an imaging device associated with the eye tracking system. This is accomplished by generating, using, and optionally also updating, a cornea movement filter, CMF, in the cornea center position estimation.
    Type: Grant
    Filed: June 29, 2020
    Date of Patent: April 19, 2022
    Assignee: Tobii AB
    Inventors: David Masko, Magnus Ivarsson, Niklas Ollesson, Anna Redz
  • Publication number: 20210350565
    Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.
    Type: Application
    Filed: April 28, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Fogelström, Per Fogelström, Per, Redz, Anna Redz, Anna, Dahl, Anders Dahl, Anders, Ollesson, Niklas Ollesson, Niklas
  • Publication number: 20210345923
    Abstract: There is provided mechanisms for eye position determination of a subject depicted in an image set. A method comprises obtaining first information indicating a first set of eye positions of the subject by applying a first eye tracking procedure on an image set depicting the subject. The first eye tracking procedure uses a first set of features extracted from the image set for obtaining the first set of eye positions. The method comprises obtaining second information indicating a second set of eye positions of the subject by applying a second eye tracking procedure on the image set depicting the subject. The second eye tracking procedure uses a second set of features extracted from the image set for obtaining the second set of eye positions.
    Type: Application
    Filed: April 21, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
  • Publication number: 20210258464
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.
    Type: Application
    Filed: December 21, 2020
    Publication date: August 19, 2021
    Applicant: Tobii AB
    Inventors: Viktor Åberg, Niklas Ollesson, Anna Redz, Magnus Ivarsson
  • Patent number: 11089254
    Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.
    Type: Grant
    Filed: February 20, 2020
    Date of Patent: August 10, 2021
    Assignee: Tobii AB
    Inventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
  • Patent number: 11003936
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.
    Type: Grant
    Filed: June 15, 2020
    Date of Patent: May 11, 2021
    Assignee: Tobii AB
    Inventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
  • Publication number: 20210099631
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second ex
    Type: Application
    Filed: September 30, 2020
    Publication date: April 1, 2021
    Applicant: Tobii AB
    Inventors: Magnus Ivarsson, Niklas Ollesson, Viktor Åberg, Anna Redz
  • Publication number: 20210014442
    Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.
    Type: Application
    Filed: February 20, 2020
    Publication date: January 14, 2021
    Applicant: Tobii AB
    Inventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
  • Publication number: 20210014443
    Abstract: A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.
    Type: Application
    Filed: June 19, 2020
    Publication date: January 14, 2021
    Applicant: Tobii AB
    Inventors: Niklas Ollesson, Magnus Ivarsson, Viktor Åberg, Anna Redz
  • Publication number: 20210012105
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for performing three-dimensional, 3D, position estimation for the cornea center of an eye of a user, using a remote eye tracking system, wherein the position estimation is reliable and robust also when the cornea center moves over time in relation to an imaging device associated with the eye tracking system. This is accomplished by generating, using, and optionally also updating, a cornea movement filter, CMF, in the cornea center position estimation.
    Type: Application
    Filed: June 29, 2020
    Publication date: January 14, 2021
    Applicant: Tobii AB
    Inventors: David Masko, Magnus Ivarsson, Niklas Ollesson, Anna Redz
  • Publication number: 20210004623
    Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.
    Type: Application
    Filed: June 15, 2020
    Publication date: January 7, 2021
    Applicant: Tobii AB
    Inventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
  • Patent number: 10594974
    Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.
    Type: Grant
    Filed: May 10, 2018
    Date of Patent: March 17, 2020
    Assignee: Tobii AB
    Inventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
  • Publication number: 20180270436
    Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.
    Type: Application
    Filed: May 10, 2018
    Publication date: September 20, 2018
    Applicant: Tobii AB
    Inventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson