Patents by Inventor Robin Thunström

Robin Thunström has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11917126
    Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
    Type: Grant
    Filed: February 24, 2023
    Date of Patent: February 27, 2024
    Assignee: Tobii AB
    Inventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
  • Patent number: 11853539
    Abstract: Visualizable data (Din) are obtained that represent a scene (S) with at least one object (110, 120, 130). The visualizable data (Din) describe the scene (S) as seen from a position (P). First and second measures (L1; L2) are determined, which represent extensions of one of the objects (110) in a smallest and a largest dimension respectively. An object aspect ratio (R) is calculated that represents a relationship between the first and second measures (L1; L2). Based on the object aspect ratio (R), a selection margin (M) is assigned to the object (110). The selection margin designates a zone outside of the object (110) within which zone the object (110) is validly selectable for manipulation in addition to an area (A11) of the object (110) shown towards a view (V) thereof as seen from the position (P). Thus, it is made easier to manipulatable the visualizable data (Din) in response to user input, for instance in the form of gaze-based selection commands.
    Type: Grant
    Filed: April 5, 2022
    Date of Patent: December 26, 2023
    Assignee: Tobii AB
    Inventors: Robin Thunström, Staffan Widegarn Åhlvik
  • Patent number: 11714487
    Abstract: An eye tracking device determines a user's gaze point on a display device and a setting for a foveated region associated with a fixation position, based on a first location of the fixation position. The eye tracking device defines at least one of a size, shape, or positioning of the foveated region relative to the fixation position. The eye tracking device determines a second location of the fixation position associated with a change of user gaze and changes the foveated region setting. At least one of the shape or size of the foveated region changes based on the eye tracking device determining that a distance difference between the first and second locations is larger than a threshold. At least one of the size or the shape of the foveated region is continuously adjusted based on the fixation position being in smooth pursuit between the first location and the second location.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: August 1, 2023
    Assignee: Tobii AB
    Inventor: Robin Thunström
  • Publication number: 20230217008
    Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
    Type: Application
    Filed: February 24, 2023
    Publication date: July 6, 2023
    Applicant: Tobii AB
    Inventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
  • Patent number: 11662595
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Grant
    Filed: May 23, 2022
    Date of Patent: May 30, 2023
    Assignee: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Patent number: 11619989
    Abstract: According to the invention, a system for presenting graphics on a display device is disclosed. The system may include an eye tracking device and a graphics processing device. The eye tracking device may be for determining a gaze point of a user on a display device. The graphics processing device may be for causing graphics to be displayed on the display device. The graphics displayed on the display device may be modified such that the graphics are of higher quality in an area including the gaze point of the user, than outside the area.
    Type: Grant
    Filed: January 8, 2018
    Date of Patent: April 4, 2023
    Assignee: Tobil AB
    Inventors: Robin Thunström, Mårten Skogö
  • Patent number: 11622103
    Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
    Type: Grant
    Filed: February 15, 2019
    Date of Patent: April 4, 2023
    Assignee: TOBII AB
    Inventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
  • Publication number: 20220326536
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Application
    Filed: May 23, 2022
    Publication date: October 13, 2022
    Applicant: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Patent number: 11366329
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Grant
    Filed: April 30, 2021
    Date of Patent: June 21, 2022
    Assignee: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Patent number: 11320974
    Abstract: Visualizable data are obtained that represent a scene with at least one object. The visualizable data describe the scene as seen from a position. First and second measures are determined, which represent extensions of one of the objects in a smallest and a largest dimension respectively. An object aspect ratio is calculated that represents a relationship between the first and second measures. Based on the object aspect ratio, a selection margin is assigned to the object. The selection margin designates a zone outside of the object within which zone the object is validly selectable for manipulation in addition to an area of the object shown towards a view thereof as seen from the position. Thus, it is made easier to manipulatable the visualizable data in response to user input, for instance in the form of gaze-based selection commands.
    Type: Grant
    Filed: March 31, 2021
    Date of Patent: May 3, 2022
    Assignee: Tobii AB
    Inventors: Robin Thunström, Staffan Widegarn Åhlvik
  • Publication number: 20220011584
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Application
    Filed: April 30, 2021
    Publication date: January 13, 2022
    Applicant: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Publication number: 20210349607
    Abstract: Visualizable data are obtained that represent a scene with at least one object. The visualizable data describe the scene as seen from a position. First and second measures are determined, which represent extensions of one of the objects in a smallest and a largest dimension respectively. An object aspect ratio is calculated that represents a relationship between the first and second measures. Based on the object aspect ratio, a selection margin is assigned to the object. The selection margin designates a zone outside of the object within which zone the object is validly selectable for manipulation in addition to an area of the object shown towards a view thereof as seen from the position. Thus, it is made easier to manipulatable the visualizable data in response to user input, for instance in the form of gaze-based selection commands.
    Type: Application
    Filed: March 31, 2021
    Publication date: November 11, 2021
    Applicant: Tobii AB
    Inventors: Robin Thunström, Staffan Widegarn Åhlvik
  • Patent number: 10983359
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Grant
    Filed: December 11, 2019
    Date of Patent: April 20, 2021
    Assignee: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Publication number: 20210109591
    Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.
    Type: Application
    Filed: February 15, 2019
    Publication date: April 15, 2021
    Applicant: Tobii AB
    Inventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
  • Patent number: 10936063
    Abstract: Disclosed is a method for calibrating an eye-tracking device to suit a user of the eye-tracking device, wherein a calibration setting of the eye-tracking device—associated with a user is calculated based on acquired eye data of the user when looking at a set of reference points. The method comprises displaying a reference point of the set to the user; acquiring, by means of at least one camera of the eye-tracking device, eye data for at least one of the eyes of the user when looking at the reference point; comparing the acquired eye data to stored eye data sets related to the reference point, wherein each of the stored eye data sets is associated with a calibration setting of the eye-tracking device; and if the acquired eye data matches one of the stored eye data sets, abandoning the calibration process and loading the calibration setting associated with the matching stored eye data.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: March 2, 2021
    Assignee: Tobii AB
    Inventors: Robin Thunström, Tobias Höglund
  • Patent number: 10895909
    Abstract: According to the invention, a system for presenting graphics on a display device is disclosed. The system may include an eye tracking device configured to determine a gaze point of a user on a display device. The system may also include a processing device configured to combine a quality map generated based on the gaze point of the user and another quality map generated based on factors independent of the gaze point of the user to generate a combined quality map. The processing device is further configured to cause a rendered image to be displayed on the display device and the quality of each area of the rendered image displayed on the display device is determined based, at least in part, upon the combined quality map.
    Type: Grant
    Filed: December 3, 2018
    Date of Patent: January 19, 2021
    Assignee: Tobii AB
    Inventors: Daan Nijs, Robin Thunström
  • Publication number: 20200225494
    Abstract: Disclosed is a method for switching user input modality of a displaying device displaying an interactable region. The displaying device is in communication with a first input modality and a second input modality. The first input modality is an eye tracker configured to determine gaze data of a user and the second input modality is an input modality other than an eye tracker configured to determine a pointing ray. The first input modality is selected as the input modality of the displaying device. The method comprises determining whether the pointing ray of the second input modality is intersecting with the interactable region. The method further comprises, based on the determining switching the input modality of the displaying device to the second input modality when the pointing ray of the second input modality is intersecting with the interactable region.
    Type: Application
    Filed: December 11, 2019
    Publication date: July 16, 2020
    Applicant: Tobii AB
    Inventors: Niklas Blomqvist, Robin Thunström, Dennis Rådell, Ralf Biedert
  • Publication number: 20200192474
    Abstract: Disclosed is a method for calibrating an eye-tracking device to suit a user of the eye-tracking device, wherein a calibration setting of the eye-tracking device—associated with a user is calculated based on acquired eye data of the user when looking at a set of reference points. The method comprises displaying a reference point of the set to the user; acquiring, by means of at least one camera of the eye-tracking device, eye data for at least one of the eyes of the user when looking at the reference point; comparing the acquired eye data to stored eye data sets related to the reference point, wherein each of the stored eye data sets is associated with a calibration setting of the eye-tracking device; and if the acquired eye data matches one of the stored eye data sets, abandoning the calibration process and loading the calibration setting associated with the matching stored eye data.
    Type: Application
    Filed: November 12, 2019
    Publication date: June 18, 2020
    Applicant: Tobii AB
    Inventors: Robin Thunström, Tobias Höglund
  • Patent number: 10310597
    Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, a movement sensor, and a control unit. The frame may be a frame adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The movement sensor may be configured to detect movement of the frame. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the image sensors, and receive information from the movement sensor.
    Type: Grant
    Filed: September 27, 2016
    Date of Patent: June 4, 2019
    Assignee: Tobii AB
    Inventors: Ralf Biedert, Robin Thunström, Jonas Andersson
  • Publication number: 20190138091
    Abstract: According to the invention, a system for presenting graphics on a display device is disclosed. The system may include an eye tracking device for determining a gaze point of a user on a display device. The system may also include a graphics processing device for causing graphics to be displayed on the display device. The graphics displayed on the display device may be modified such that the graphics in an area including the gaze point of the user have at least one modified parameter relative to graphics outside the area. The size of the area may be based at least in part on an amount of noise in the gaze point over time and at least one other secondary factor.
    Type: Application
    Filed: September 17, 2018
    Publication date: May 9, 2019
    Applicant: Tobii AB
    Inventors: Robin Thunström, Denny Rönngren, Anders Clausen