Patents by Inventor Pravin Kumar Rana

Pravin Kumar Rana has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11934571
    Abstract: A system, a head-mounted device, a computer program, a carrier, and a method for a head-mounted device comprising an eye tracking sensor, for updating an eye tracking model in relation to an eye are disclosed. First sensor data in relation to the eye are obtained by means of the eye tracking sensor. After obtaining the first sensor data, the eye tracking sensor is moved in relation to the eye. After moving the eye tracking sensor, second sensor data in relation to the eye are obtained by means of the eye tracking sensor. The eye tracking model in relation to the eye is then updated based on the first sensor data and the second sensor data.
    Type: Grant
    Filed: September 30, 2020
    Date of Patent: March 19, 2024
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Gerald Bianchi
  • Publication number: 20230421908
    Abstract: An eye tracking system comprising: a plurality of light sources that are arranged to illuminate a user's eye when the eye tracking system is in use; and a controller configured to: receive a first-image of a surface, acquired while the surface is illuminated by a first set of the plurality of light sources; receive a second-image of the surface, acquired while the surface is illuminated by a second set of the plurality of light sources, wherein the second set of light sources is different to the first set of light sources; process the first-image and the second-image to determine an illumination contribution of one or more of the light sources; and determine light-source-control-signaling for one or more of the light sources based on the determined illumination contribution of the one or more of the light sources.
    Type: Application
    Filed: June 21, 2023
    Publication date: December 28, 2023
    Inventors: PRAVIN KUMAR RANA, YIMU WANG, DANIEL TORNÉUS, GILFREDO REMON SALAZAR, PONTUS CHRISTIAN WALCK
  • Patent number: 11823413
    Abstract: An eye tracking system configured to: receive a plurality of right eye images of a right eye of a user; receive a plurality of left eye images of a left eye of a user, each left eye image corresponding to a right eye image in the plurality of right eye images; detect a pupil and determine an associated pupil signal, for each of the plurality of right eye images and each of the plurality of left eye images; calculate a right eye pupil variation of the pupil signals for the plurality of right eye images and a left eye pupil variation of the pupil signals for the plurality of left eye images; and determine a right eye weighting and a left eye weighting based on the right eye pupil variation and the left eye pupil variation.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: November 21, 2023
    Assignee: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Patent number: 11681368
    Abstract: An eye tracking system includes at least two cameras configured to register eye images of at least one eye. The system obtains eye images from at least one camera in a subset of the at least two cameras, determines a first pupil parameter based on a first eye image, and determines a second pupil parameter based on a second eye image. The system compares the first and second pupil parameters to obtain a test parameter and checks the test parameter against at least one operation criterion. Responsive to the checking, the system assigns a respective operation state to at least one camera in the subset. The operation state involves one of (A) operating the camera at a high frame rate, (B) operating the camera at a reduced frame rate being lower than high frame rate, (C) the camera being in a standby mode or (D) the camera being powered off.
    Type: Grant
    Filed: June 29, 2022
    Date of Patent: June 20, 2023
    Assignee: TOBII AB
    Inventor: Pravin Kumar Rana
  • Patent number: 11681366
    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
    Type: Grant
    Filed: January 13, 2022
    Date of Patent: June 20, 2023
    Assignee: Tobii AB
    Inventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
  • Patent number: 11593962
    Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.
    Type: Grant
    Filed: December 29, 2020
    Date of Patent: February 28, 2023
    Assignee: TOBII AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Patent number: 11556006
    Abstract: Disclosed is a method for detecting a shadow in an image of an eye region of a user wearing a Head Mounted Device, HMD. The method comprises obtaining, from a camera of the HMD, an image of the eye region of the user wearing a HMD and determining an area of interest in the image, the area of interest comprising a plurality of subareas. The method further comprises determining a first brightness level for a first subarea of the plurality of subareas and determining a second brightness level for a second subarea of the plurality of subareas. The method further comprises comparing the first brightness level with the second brightness level, and, based on the comparing, selectively generating a signal indicating a shadow.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: January 17, 2023
    Assignee: Tobii AB
    Inventors: Yimu Wang, Ylva Björk, Joakim Zachrisson, Pravin Kumar Rana
  • Publication number: 20230004219
    Abstract: An eye tracking system includes at least two cameras configured to register eye images of at least one eye. The system obtains eye images from at least one camera in a subset of the at least two cameras, determines a first pupil parameter based on a first eye image, and determines a second pupil parameter based on a second eye image. The system compares the first and second pupil parameters to obtain a test parameter and checks the test parameter against at least one operation criterion. Responsive to the checking, the system assigns a respective operation state to at least one camera in the subset. The operation state involves one of (A) operating the camera at a high frame rate, (B) operating the camera at a reduced frame rate being lower than high frame rate, (C) the camera being in a standby mode or (D) the camera being powered off.
    Type: Application
    Filed: June 29, 2022
    Publication date: January 5, 2023
    Inventor: Pravin Kumar RANA
  • Publication number: 20220207768
    Abstract: An eye tracking system configured to: receive a plurality of right-eye-images of a right eye of a user; receive a plurality of left-eye-images of a left eye of a user, each left-eye-image corresponding to a right-eye-image in the plurality of right-eye-images; detect a pupil and determine an associated pupil-signal, for each of the plurality of right-eye-images and each of the plurality of left-eye-images; calculate a right-eye-pupil-variation of the pupil-signals for the plurality of right-eye-images and a left-eye-pupil-variation of the pupil-signals for the plurality of left-eye-images; and determine a right-eye-weighting and a left-eye-weighting based on the right-eye-pupil-variation and the left-eye-pupil-variation.
    Type: Application
    Filed: December 29, 2020
    Publication date: June 30, 2022
    Applicant: Tobii AB
    Inventors: Mikael Rosell, Simon Johansson, Pravin Kumar Rana, Yimu Wang, Gilfredo Remon Salazar
  • Publication number: 20220137704
    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
    Type: Application
    Filed: January 13, 2022
    Publication date: May 5, 2022
    Applicant: Tobii AB
    Inventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjorn Sundberg
  • Publication number: 20220083799
    Abstract: An eye tracking system is provided that detects the presence of problematic blobs in an image captured by the system and removes these problematic blobs by switching off illuminators. Problematic blobs may be those obscuring the pupil of the eye of the user. Each blob is detected in a first image by the use of at least one first criterion, and then an illuminator is switched off. After the illuminator is switched off, at least one second criterion is used to identify blobs in a subsequent image. This process may be repeated until the illuminator causing the problematic blob is identified.
    Type: Application
    Filed: August 27, 2021
    Publication date: March 17, 2022
    Applicant: Tobii AB
    Inventors: Viktor Wase, Erik Ljungzell, Mark Ryan, Chiara Giordano, Rickard Lundahl, Pravin Kumar Rana
  • Patent number: 11259010
    Abstract: Images of an eye are captured at respective time instances by a camera of a head-mounted device. For each time instance, a position of a center of corneal curvature is estimated using an image captured at that time instance, a position of a pupil center is estimated using an image captured at that time instance, and a line is determined through the estimated corneal curvature center position and the estimated pupil center position. A first estimated position of a center of the eye is computed based on the lines determined for time instances in a first time period. A second estimated position of the center of the eye is computed based on the lines determined for time instances in a second time period. Relocation of the head-mounted device relative to a user's head is detected based on the first and second estimated positions of the eye center.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: February 22, 2022
    Assignee: Tobii AB
    Inventors: Tiesheng Wang, Pravin Kumar Rana, Yimu Wang, Mark Ryan
  • Patent number: 11249547
    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
    Type: Grant
    Filed: October 31, 2019
    Date of Patent: February 15, 2022
    Assignee: Tobii AB
    Inventors: Tiesheng Wang, Gilfredo Remon Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
  • Patent number: 11243607
    Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.
    Type: Grant
    Filed: May 23, 2019
    Date of Patent: February 8, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Yimu Wang
  • Patent number: 11232594
    Abstract: The invention is related to a method for calibrating an eye tracking device within a head-mounted display (HMD) comprising the steps of acquiring with the HMD via an image sensor, at least one optical target image from an optical target, wherein the optical target contains image points in a pattern, indexing image points within the optical target image wherein the image points are indexed by, selecting a rigid region of the optical target image, assigning indices to image points within the rigid region, fitting a polynomial approximation function to at least one column and one row of the image points of the region, predicting the location of at least one image point using the fitted polynomial approximation function, assigning the predicted image point an index, inputting indexed image points into an optimization algorithm that calculates a hardware calibration of the HMD, and writing hardware calibration values calculated from the optimization algorithm to the HMD unit.
    Type: Grant
    Filed: October 23, 2020
    Date of Patent: January 25, 2022
    Assignee: Tobii AB
    Inventors: Pravin Kumar Rana, Macarena Garcia Romero, Yimu Wang, Rickard Lundahl
  • Publication number: 20210255698
    Abstract: A system, a head-mounted device, a computer program, a carrier, and a method for a head-mounted device comprising an eye tracking sensor, for updating an eye tracking model in relation to an eye are disclosed. First sensor data in relation to the eye are obtained by means of the eye tracking sensor. After obtaining the first sensor data, the eye tracking sensor is moved in relation to the eye. After moving the eye tracking sensor, second sensor data in relation to the eye are obtained by means of the eye tracking sensor. The eye tracking model in relation to the eye is then updated based on the first sensor data and the second sensor data.
    Type: Application
    Filed: September 30, 2020
    Publication date: August 19, 2021
    Applicant: Tobii AB
    Inventors: Pravin Kumar Rana, Gerald Bianchi
  • Publication number: 20200192473
    Abstract: Images of an eye are captured by a camera. For each of the images, gaze data is obtained and a position of a pupil center is estimated in the image. The gaze data indicates a gaze point and/or gaze direction of the eye when the image was captured. A mapping is calibrated using the obtained gaze data and the estimated positions of the pupil center. The mapping maps positions of the pupil center in images captured by the camera to gaze points at a surface, or to gaze directions. A further image of the eye is captured by the camera. A position of the pupil center is estimated in the further image. Gaze tracking is performed using the calibrated mapping and the estimated position of the pupil center in the further image. These steps may for example be performed at a HMD.
    Type: Application
    Filed: October 31, 2019
    Publication date: June 18, 2020
    Applicant: Tobii AB
    Inventors: Tiesheng Wang, Gilfredo Remon Salazar Salazar Salazar, Yimu Wang, Pravin Kumar Rana, Johannes Kron, Mark Ryan, Torbjörn Sundberg
  • Publication number: 20200195915
    Abstract: Images of an eye are captured at respective time instances by a camera of a head-mounted device. For each time instance, a position of a center of corneal curvature is estimated using an image captured at that time instance, a position of a pupil center is estimated using an image captured at that time instance, and a line is determined through the estimated corneal curvature center position and the estimated pupil center position. A first estimated position of a center of the eye is computed based on the lines determined for time instances in a first time period. A second estimated position of the center of the eye is computed based on the lines determined for time instances in a second time period. Relocation of the head-mounted device relative to a user's head is detected based on the first and second estimated positions of the eye center.
    Type: Application
    Filed: October 31, 2019
    Publication date: June 18, 2020
    Applicant: Tobii AB
    Inventors: Tiesheng Wang, Pravin Kumar Rana, Yimu Wang, Mark Ryan
  • Publication number: 20200133003
    Abstract: Disclosed is a method for detecting a shadow in an image of an eye region of a user wearing a Head Mounted Device, HMD. The method comprises obtaining, from a camera of the HMD, an image of the eye region of the user wearing a HMD and determining an area of interest in the image, the area of interest comprising a plurality of subareas. The method further comprises determining a first brightness level for a first subarea of the plurality of subareas and determining a second brightness level for a second subarea of the plurality of subareas. The method further comprises comparing the first brightness level with the second brightness level, and, based on the comparing, selectively generating a signal indicating a shadow.
    Type: Application
    Filed: October 28, 2019
    Publication date: April 30, 2020
    Applicant: Tobii AB
    Inventors: Yimu Wang, Ylva Björk, Joakim Zachrisson, Pravin Kumar Rana
  • Publication number: 20190369720
    Abstract: A method of identifying scleral reflections in an eye tracking system and a corresponding eye tracking system are disclosed. An image of an eye of a user from an image sensor is received, the image resulting from the image sensor detecting light from one or more illuminators reflected from the eye of the user. A glint is identified in the image, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.
    Type: Application
    Filed: May 23, 2019
    Publication date: December 5, 2019
    Applicant: Tobii AB
    Inventors: Pravin Kumar Rana, Yimu Wang