Patents by Inventor Niklas Ollesson
Niklas Ollesson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240416923Abstract: Method and apparatus, including computer programs, for providing a driver distraction signal and/or a system degradation signal indicating a reliability of the driver distraction signal, based on a gaze of a driver of a vehicle. Images of the driver of the vehicle are received, which contain information indicating a gaze of the driver. For each image, a gaze region for the driver is determined, including a gaze point and a gaze uncertainty value. For each image, the gaze region is associated with a region among several regions around the vehicle, wherein the regions include at least one pre-defined attentive region and at least one pre-defined inattentive region. Based on the determined gaze region, the gaze uncertainty value, and the region for a plurality of images, a driver distraction level and/or system degradation level indicating a reliability of the driver distraction level are determined.Type: ApplicationFiled: June 5, 2024Publication date: December 19, 2024Inventors: PÉTER ALMÁSI, NIKLAS OLLESSON, ANJIN GABRIEL ALEXANDER SANTIAGO, OSKAR NORDMARK
-
Patent number: 12100176Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.Type: GrantFiled: December 6, 2022Date of Patent: September 24, 2024Assignee: Tobii ABInventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
-
Patent number: 11632501Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.Type: GrantFiled: December 21, 2020Date of Patent: April 18, 2023Assignee: Tobil ABInventors: Viktor Åberg, Niklas Ollesson, Anna Redz, Magnus Ivarsson
-
Publication number: 20230101049Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.Type: ApplicationFiled: December 6, 2022Publication date: March 30, 2023Inventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
-
Patent number: 11570370Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second exType: GrantFiled: September 30, 2020Date of Patent: January 31, 2023Assignee: Tobii ABInventors: Magnus Ivarsson, Niklas Ollesson, Viktor Åberg, Anna Redz
-
Patent number: 11568560Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.Type: GrantFiled: April 28, 2021Date of Patent: January 31, 2023Assignee: Tobii ABInventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
-
Patent number: 11438542Abstract: A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.Type: GrantFiled: June 19, 2020Date of Patent: September 6, 2022Assignee: Tobii ABInventors: Niklas Ollesson, Magnus Ivarsson, Viktor Åberg, Anna Redz
-
Patent number: 11308321Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for performing three-dimensional, 3D, position estimation for the cornea center of an eye of a user, using a remote eye tracking system, wherein the position estimation is reliable and robust also when the cornea center moves over time in relation to an imaging device associated with the eye tracking system. This is accomplished by generating, using, and optionally also updating, a cornea movement filter, CMF, in the cornea center position estimation.Type: GrantFiled: June 29, 2020Date of Patent: April 19, 2022Assignee: Tobii ABInventors: David Masko, Magnus Ivarsson, Niklas Ollesson, Anna Redz
-
Publication number: 20210350565Abstract: There is provided mechanisms for calibration of an eye tracking system. An eye tracking system comprises a pupil centre corneal reflection (PCCR) based eye tracker and a non-PCCR based eye tracker. A method comprises obtaining at least one first eye position of a subject by applying the PCCR based eye tracker on an image set depicting the subject. The method comprises calibrating a head model of the non-PCCR based eye tracker, as applied on the image set, for the subject using the obtained at least one first eye position from the PCCR based eye tracker as ground truth. The head model comprises facial features that include at least one second eye position. The calibrating involves positioning the head model in order for its at least one second eye position to be consistent with the at least one first eye position given by the PCCR based eye tracker.Type: ApplicationFiled: April 28, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: Fogelström, Per Fogelström, Per, Redz, Anna Redz, Anna, Dahl, Anders Dahl, Anders, Ollesson, Niklas Ollesson, Niklas
-
Publication number: 20210345923Abstract: There is provided mechanisms for eye position determination of a subject depicted in an image set. A method comprises obtaining first information indicating a first set of eye positions of the subject by applying a first eye tracking procedure on an image set depicting the subject. The first eye tracking procedure uses a first set of features extracted from the image set for obtaining the first set of eye positions. The method comprises obtaining second information indicating a second set of eye positions of the subject by applying a second eye tracking procedure on the image set depicting the subject. The second eye tracking procedure uses a second set of features extracted from the image set for obtaining the second set of eye positions.Type: ApplicationFiled: April 21, 2021Publication date: November 11, 2021Applicant: Tobii ABInventors: Per Fogelström, Anna Redz, Anders Dahl, Niklas Ollesson
-
Publication number: 20210258464Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling the exposure settings of an rolling shutter image sensor device with global reset. This is achieved by obtaining a first image captured by the image sensor device at a current exposure setting that comprises a partial readout parameter representing a number image parts for partial readout by the image sensor device; determining an intensity value of the first image, comparing the intensity value of the first image to a desired intensity value. If the intensity values differ more than an allowed deviation, an updated number of image parts for partial readout is determined based on the current number of image parts and the intensity value of the first image. Thereafter, the current exposure setting is updated by setting the value of the partial readout parameter to the updated number of image parts.Type: ApplicationFiled: December 21, 2020Publication date: August 19, 2021Applicant: Tobii ABInventors: Viktor Åberg, Niklas Ollesson, Anna Redz, Magnus Ivarsson
-
Patent number: 11089254Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.Type: GrantFiled: February 20, 2020Date of Patent: August 10, 2021Assignee: Tobii ABInventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
-
Patent number: 11003936Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.Type: GrantFiled: June 15, 2020Date of Patent: May 11, 2021Assignee: Tobii ABInventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
-
Publication number: 20210099631Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system (200) to obtain a first image (500) captured under active illumination by at least one infrared, IR, illuminator (112, 113) associated with the eye tracking system (200) and at a current exposure setting, using the image sensor device (110); and, if at least one eye (100, 120) is depicted in the first image (500): define at least one region of interest, ROI, (501, 502, 503, 504) from the first image (500) comprising a group of pixels in the first image (500) representing at least a part of the depicted at least one eye (100, 120); determine a respective intensity value for each of the at least one ROI (501, 502, 503, 504); determine a second exposure setting by adjusting at least one exposure parameter of the image sensor device (110) based on the determined intensity value, or values, for the at least one ROI (501, 502, 503, 504); and set the current exposure setting to the second exType: ApplicationFiled: September 30, 2020Publication date: April 1, 2021Applicant: Tobii ABInventors: Magnus Ivarsson, Niklas Ollesson, Viktor Åberg, Anna Redz
-
Publication number: 20210014442Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.Type: ApplicationFiled: February 20, 2020Publication date: January 14, 2021Applicant: Tobii ABInventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
-
Publication number: 20210014443Abstract: A computer implemented method for controlling read-out from a digital image sensor device, comprising a plurality of pixels, the method comprising the steps of setting a first read-out scheme, based on a first level of pixel binning and/or pixel skipping, reading, based on the first read-out scheme, from the digital image sensor device, a first image, determining an exposure value for the first image, based on the intensity value of each one of the first plurality of regions of the first image and comparing the exposure value with a predetermined maximum value. A second read-out scheme based on a second level of pixel binning and/or pixel skipping is set. The level of pixel binning and/or pixel skipping in the second read-out scheme is increased compared to the first read-out scheme, if the exposure value is higher than the predetermined maximum value. Based on the second read-out scheme, a subsequent second image is read. A system configured to perform the method is also described.Type: ApplicationFiled: June 19, 2020Publication date: January 14, 2021Applicant: Tobii ABInventors: Niklas Ollesson, Magnus Ivarsson, Viktor Åberg, Anna Redz
-
Publication number: 20210012105Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for performing three-dimensional, 3D, position estimation for the cornea center of an eye of a user, using a remote eye tracking system, wherein the position estimation is reliable and robust also when the cornea center moves over time in relation to an imaging device associated with the eye tracking system. This is accomplished by generating, using, and optionally also updating, a cornea movement filter, CMF, in the cornea center position estimation.Type: ApplicationFiled: June 29, 2020Publication date: January 14, 2021Applicant: Tobii ABInventors: David Masko, Magnus Ivarsson, Niklas Ollesson, Anna Redz
-
Publication number: 20210004623Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.Type: ApplicationFiled: June 15, 2020Publication date: January 7, 2021Applicant: Tobii ABInventors: Viktor Åberg, Anna Redz, Niklas Ollesson, Dineshkumar Muthusamy, Magnus Ivarsson
-
Patent number: 10594974Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.Type: GrantFiled: May 10, 2018Date of Patent: March 17, 2020Assignee: Tobii ABInventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson
-
Publication number: 20180270436Abstract: Techniques for reducing a read out time and power consumption of an image sensor used for eye tracking are described. In an example, a position of an eye element in an active area of a sensor is determined. The eye element can be any of an eye, a pupil of the eye, an iris of the eye, or a glint at the eye. A region of interest (ROI) around the position of the eye is defined. The image sensor reads out pixels confined to the ROI, thereby generating an ROI image that shows the eye element.Type: ApplicationFiled: May 10, 2018Publication date: September 20, 2018Applicant: Tobii ABInventors: Magnus Ivarsson, Per-Edvin Stoltz, David Masko, Niklas Ollesson, Mårten Skogö, Peter Blixt, Henrik Jönsson