Patents by Inventor Torbjörn Sundberg
Torbjörn Sundberg has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11917126Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.Type: GrantFiled: February 24, 2023Date of Patent: February 27, 2024Assignee: Tobii ABInventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
-
Publication number: 20230217008Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.Type: ApplicationFiled: February 24, 2023Publication date: July 6, 2023Applicant: Tobii ABInventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
-
Patent number: 11681366Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.Type: GrantFiled: January 13, 2022Date of Patent: June 20, 2023Assignee: Tobii ABInventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
-
Patent number: 11665333Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.Type: GrantFiled: June 30, 2020Date of Patent: May 30, 2023Assignee: Tobii ABInventors: Daniel Tornéus, Torbjörn Sundberg, Magnus Arvidsson
-
Patent number: 11622103Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.Type: GrantFiled: February 15, 2019Date of Patent: April 4, 2023Assignee: TOBII ABInventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
-
Patent number: 11249547Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.Type: GrantFiled: October 31, 2019Date of Patent: February 15, 2022Assignee: Tobii ABInventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
-
Publication number: 20210109591Abstract: An augmented reality, virtual reality, or other wearable apparatus comprises an eye tracking device comprising an image sensor, a lens, and one or more processors. In some embodiments, the lens comprises a marker, and the one or more processors are configured to receive an image from the image sensor, wherein the image shows the marker, determine a distance from the image sensor to the marker based on the image, and change a calibration parameter of an eye tracking algorithm based on the distance. In some embodiments, the one or more processors are configured to receive image data from the image sensor, wherein the image data corresponds to an image as observed through the lens, determine a level or pattern of pincushion distortion in the image based on the image data, and change a calibration parameter of an eye tracking algorithm based on the level or the pattern of pincushion distortion.Type: ApplicationFiled: February 15, 2019Publication date: April 15, 2021Applicant: Tobii ABInventors: Jonas Andersson, Anders Clausen, Richard Hainzl, Anders Kingbäck, Simon Olin, Mark Ryan, Daniel Tornéus, Björn Nutti, Torbjörn Sundberg, Catarina Tidbeck, Ralf Biedert, Niklas Blomqvist, Dennis Rådell, Robin Thunström
-
Publication number: 20210076026Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.Type: ApplicationFiled: June 30, 2020Publication date: March 11, 2021Applicant: Tobii ABInventors: Daniel Tornéus, Torbjörn Sundberg, Magnus Arvidsson
-
Patent number: 10852531Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.Type: GrantFiled: June 24, 2019Date of Patent: December 1, 2020Assignee: Tobii ABInventors: Mark Ryan, Torbjörn Sundberg, Pravin Rana, Yimu Wang
-
Publication number: 20200192473Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.Type: ApplicationFiled: October 31, 2019Publication date: June 18, 2020Applicant: Tobii ABInventors: Tiesheng Wang, Gilfredo Remon Salazar Salazar Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
-
Publication number: 20200026068Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.Type: ApplicationFiled: June 24, 2019Publication date: January 23, 2020Applicant: Tobii ABInventors: Mark Ryan, Torbjörn Sundberg, Pravin Rana, Yimu Wang
-
Patent number: 10394019Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.Type: GrantFiled: February 9, 2018Date of Patent: August 27, 2019Assignee: Tobii ABInventors: Mark Ryan, Torbjörn Sundberg, Pravin Rana, Yimu Wang
-
Publication number: 20190253700Abstract: In one embodiment, a wearable apparatus is provided which may include a holographic film disposed on the wearable apparatus, an eye tracking device including an image sensor and an illuminator, and one or more processors. The processors may be configured to activate the illuminator to illuminate the holographic film and capture, with the image sensor, an image of at least a portion of the holographic film while the holographic film is illuminated. The processors may also be configured to determine a characteristic of the holographic film based on the image and determine, based on the characteristic, a location or an orientation of the image sensor relative to the holographic film. The processors may further be configured to change, based on the location or the orientation of the image sensor relative to the holographic film, at least one calibration parameter of the image sensor.Type: ApplicationFiled: December 26, 2018Publication date: August 15, 2019Applicant: Tobii ABInventors: Daniel Tornéus, Torbjörn Sundberg, Magnus Arvidsson
-
Publication number: 20180247119Abstract: A method for determining eye openness with an eye tracking device is disclosed. The method may include determining, for pixels of an image sensor of an eye tracking device, during a first time period when an eye of a user is open, a first sum of intensity of the pixels. The method may also include determining, during a second time period when the eye of the user is closed, a second sum of intensity of the pixels. The method may further include determining, during a third time period, a third sum of intensity of the pixels. The method may additionally include determining that upon the third sum exceeding a fourth sum of the first sum plus a threshold amount, that the eye of the user is closed, the threshold amount is equal to a product of a threshold fraction and a difference between the first sum and the second sum.Type: ApplicationFiled: February 9, 2018Publication date: August 30, 2018Applicant: Tobii ABInventors: Mark Ryan, Torbjörn Sundberg, Pravin Rana, Yimu Wang