Patents by Inventor Dmitry Lagun

Dmitry Lagun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11989345
    Abstract: A method includes determining a measured eye gaze position of an eye of a user. The method also includes determining a first incremental change in the measured eye gaze position by processing the measured eye gaze position by a long short-term memory (LSTM) model, and determining a first predicted eye gaze position of the eye at a first future time based on the measured eye gaze position and the first incremental change. The method additionally includes determining a second incremental change in the first predicted eye gaze position by processing the first predicted eye gaze position by the LSTM model, and determining a second predicted eye gaze position of the eye at a second future time subsequent to the first future time based on the first predicted eye gaze position and the second incremental change.
    Type: Grant
    Filed: May 28, 2021
    Date of Patent: May 21, 2024
    Assignee: Google LLC
    Inventors: Gautam Prasad, Dmitry Lagun, Florian Schroff
  • Publication number: 20240143077
    Abstract: A method includes determining a measured eye gaze position of an eye of a user. The method also includes determining a first incremental change in the measured eye gaze position by processing the measured eye gaze position by a long short-term memory (LSTM) model, and determining a first predicted eye gaze position of the eye at a first future time based on the measured eye gaze position and the first incremental change. The method additionally includes determining a second incremental change in the first predicted eye gaze position by processing the first predicted eye gaze position by the LSTM model, and determining a second predicted eye gaze position of the eye at a second future time subsequent to the first future time based on the first predicted eye gaze position and the second incremental change.
    Type: Application
    Filed: May 28, 2021
    Publication date: May 2, 2024
    Inventors: Gautam Prasad, Dmitry Lagun, Florian Schroff
  • Publication number: 20240126365
    Abstract: The technology relates to methods and systems for implicit calibration for gaze tracking. This can include receiving, by a neural network module, display content that is associated with presentation on a display screen (1202). The neural network module may also receive uncalibrated gaze information, in which the uncalibrated gaze information includes an uncalibrated gaze trajectory that is associated with a viewer gaze of the display content on the display screen (1204). A selected function is applied by the neural network module to the uncalibrated gaze information and the display content to generate a user-specific gaze function (1206). The user-specific gaze function has one or more personalized parameters. And the neural network module can then apply the user-specific gaze function to the uncalibrated gaze information to generate calibrated gaze information associated with the display content on the display screen (1208).
    Type: Application
    Filed: April 21, 2021
    Publication date: April 18, 2024
    Inventors: Dmitry Lagun, Gautam Prasad, Pezhman Firoozfam, Jimin Pi
  • Publication number: 20230274537
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Application
    Filed: January 9, 2023
    Publication date: August 31, 2023
    Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
  • Patent number: 11633099
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: April 25, 2023
    Assignee: EMORY UNIVERSITY
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
  • Publication number: 20230033956
    Abstract: Example embodiments relate to estimating depth information based on iris size. A computing system may obtain an image depicting a person and determine a facial mesh for a face of the person based on features of the face. In some instances, the facial mesh includes a combination of facial landmarks and eye landmarks. As such, the computing system may estimate an iris pixel dimension of an eye based on the eye landmarks of the facial mesh and estimate a distance of the eye of the face relative to the camera based on the iris pixel dimension, a mean value iris dimension, and an intrinsic matrix of the camera. The computing system may further modify the image based on the estimated distance.
    Type: Application
    Filed: May 21, 2020
    Publication date: February 2, 2023
    Inventors: Ming YONG, Andrey VAKUNOV, Ivan GRISHCHENKO, Dmitry LAGUN, Matthias GRUNDMANN
  • Patent number: 11551377
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: January 10, 2023
    Assignee: Google LLC
    Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
  • Publication number: 20210150759
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Application
    Filed: November 23, 2020
    Publication date: May 20, 2021
    Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
  • Publication number: 20210076936
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Application
    Filed: May 29, 2020
    Publication date: March 18, 2021
    Applicant: EMORY UNIVERSITY
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
  • Patent number: 10846877
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Grant
    Filed: November 12, 2018
    Date of Patent: November 24, 2020
    Assignee: Google LLC
    Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
  • Patent number: 10694942
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Grant
    Filed: March 7, 2017
    Date of Patent: June 30, 2020
    Assignee: EMORY UNIVERSITY
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
  • Publication number: 20190080474
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Application
    Filed: November 12, 2018
    Publication date: March 14, 2019
    Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
  • Patent number: 10127680
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for gaze position prediction using neural networks. One of the systems includes a neural network comprising one or more neural network layers, wherein the neural network is configured to obtain a collection of input facial images of a user, wherein the collection of input facial images of the user comprises (i) a query image of the user, (ii) one or more calibration images of the user, and (iii) a respective calibration label that labels a known gaze position of the user for each of the one or more calibration images of the user; and process the received collection of input facial images of the user using the one or more neural network layers to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: November 13, 2018
    Assignee: Google LLC
    Inventors: Dmitry Lagun, Vidhya Navalpakkam
  • Publication number: 20170372487
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for gaze position prediction using neural networks. One of the systems includes a neural network comprising one or more neural network layers, wherein the neural network is configured to obtain a collection of input facial images of a user, wherein the collection of input facial images of the user comprises (i) a query image of the user, (ii) one or more calibration images of the user, and (iii) a respective calibration label that labels a known gaze position of the user for each of the one or more calibration images of the user; and process the received collection of input facial images of the user using the one or more neural network layers to generate a neural network output that characterizes a gaze position of the user in the query image.
    Type: Application
    Filed: June 28, 2016
    Publication date: December 28, 2017
    Inventors: Dmitry Lagun, Vidhya Navalpakkam
  • Publication number: 20170273555
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Application
    Filed: March 7, 2017
    Publication date: September 28, 2017
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
  • Patent number: 9629543
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Grant
    Filed: February 26, 2010
    Date of Patent: April 25, 2017
    Assignee: Emory University
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
  • Publication number: 20120059282
    Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.
    Type: Application
    Filed: February 26, 2010
    Publication date: March 8, 2012
    Applicant: EMORY UNIVERSITY
    Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola