Patents by Inventor Dmitry Lagun
Dmitry Lagun has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11989345Abstract: A method includes determining a measured eye gaze position of an eye of a user. The method also includes determining a first incremental change in the measured eye gaze position by processing the measured eye gaze position by a long short-term memory (LSTM) model, and determining a first predicted eye gaze position of the eye at a first future time based on the measured eye gaze position and the first incremental change. The method additionally includes determining a second incremental change in the first predicted eye gaze position by processing the first predicted eye gaze position by the LSTM model, and determining a second predicted eye gaze position of the eye at a second future time subsequent to the first future time based on the first predicted eye gaze position and the second incremental change.Type: GrantFiled: May 28, 2021Date of Patent: May 21, 2024Assignee: Google LLCInventors: Gautam Prasad, Dmitry Lagun, Florian Schroff
-
Publication number: 20240143077Abstract: A method includes determining a measured eye gaze position of an eye of a user. The method also includes determining a first incremental change in the measured eye gaze position by processing the measured eye gaze position by a long short-term memory (LSTM) model, and determining a first predicted eye gaze position of the eye at a first future time based on the measured eye gaze position and the first incremental change. The method additionally includes determining a second incremental change in the first predicted eye gaze position by processing the first predicted eye gaze position by the LSTM model, and determining a second predicted eye gaze position of the eye at a second future time subsequent to the first future time based on the first predicted eye gaze position and the second incremental change.Type: ApplicationFiled: May 28, 2021Publication date: May 2, 2024Inventors: Gautam Prasad, Dmitry Lagun, Florian Schroff
-
Publication number: 20240126365Abstract: The technology relates to methods and systems for implicit calibration for gaze tracking. This can include receiving, by a neural network module, display content that is associated with presentation on a display screen (1202). The neural network module may also receive uncalibrated gaze information, in which the uncalibrated gaze information includes an uncalibrated gaze trajectory that is associated with a viewer gaze of the display content on the display screen (1204). A selected function is applied by the neural network module to the uncalibrated gaze information and the display content to generate a user-specific gaze function (1206). The user-specific gaze function has one or more personalized parameters. And the neural network module can then apply the user-specific gaze function to the uncalibrated gaze information to generate calibrated gaze information associated with the display content on the display screen (1208).Type: ApplicationFiled: April 21, 2021Publication date: April 18, 2024Inventors: Dmitry Lagun, Gautam Prasad, Pezhman Firoozfam, Jimin Pi
-
Publication number: 20230274537Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.Type: ApplicationFiled: January 9, 2023Publication date: August 31, 2023Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
-
Patent number: 11633099Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: GrantFiled: May 29, 2020Date of Patent: April 25, 2023Assignee: EMORY UNIVERSITYInventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
-
Publication number: 20230033956Abstract: Example embodiments relate to estimating depth information based on iris size. A computing system may obtain an image depicting a person and determine a facial mesh for a face of the person based on features of the face. In some instances, the facial mesh includes a combination of facial landmarks and eye landmarks. As such, the computing system may estimate an iris pixel dimension of an eye based on the eye landmarks of the facial mesh and estimate a distance of the eye of the face relative to the camera based on the iris pixel dimension, a mean value iris dimension, and an intrinsic matrix of the camera. The computing system may further modify the image based on the estimated distance.Type: ApplicationFiled: May 21, 2020Publication date: February 2, 2023Inventors: Ming YONG, Andrey VAKUNOV, Ivan GRISHCHENKO, Dmitry LAGUN, Matthias GRUNDMANN
-
Patent number: 11551377Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.Type: GrantFiled: November 23, 2020Date of Patent: January 10, 2023Assignee: Google LLCInventors: Dmitry Lagun, Junfeng He, Pingmei Xu
-
Publication number: 20210150759Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.Type: ApplicationFiled: November 23, 2020Publication date: May 20, 2021Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
-
Publication number: 20210076936Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: ApplicationFiled: May 29, 2020Publication date: March 18, 2021Applicant: EMORY UNIVERSITYInventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
-
Patent number: 10846877Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.Type: GrantFiled: November 12, 2018Date of Patent: November 24, 2020Assignee: Google LLCInventors: Dmitry Lagun, Junfeng He, Pingmei Xu
-
Patent number: 10694942Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: GrantFiled: March 7, 2017Date of Patent: June 30, 2020Assignee: EMORY UNIVERSITYInventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
-
Publication number: 20190080474Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for characterizing a gaze position of a user in a query image. One of the methods includes obtaining a query image of a user captured by a camera of a mobile device; obtaining device characteristics data specifying (ii) characteristics of the mobile device, (ii) characteristics of the camera of the mobile device, or (iii) both; and processing a neural network input comprising (i) one or more images derived from the query image and (ii) the device characteristics data using a gaze prediction neural network, wherein the gaze prediction neural network is configured to, at run time and after the gaze prediction neural network has been trained, process the neural network input to generate a neural network output that characterizes a gaze position of the user in the query image.Type: ApplicationFiled: November 12, 2018Publication date: March 14, 2019Inventors: Dmitry Lagun, Junfeng He, Pingmei Xu
-
Patent number: 10127680Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for gaze position prediction using neural networks. One of the systems includes a neural network comprising one or more neural network layers, wherein the neural network is configured to obtain a collection of input facial images of a user, wherein the collection of input facial images of the user comprises (i) a query image of the user, (ii) one or more calibration images of the user, and (iii) a respective calibration label that labels a known gaze position of the user for each of the one or more calibration images of the user; and process the received collection of input facial images of the user using the one or more neural network layers to generate a neural network output that characterizes a gaze position of the user in the query image.Type: GrantFiled: June 28, 2016Date of Patent: November 13, 2018Assignee: Google LLCInventors: Dmitry Lagun, Vidhya Navalpakkam
-
Publication number: 20170372487Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for gaze position prediction using neural networks. One of the systems includes a neural network comprising one or more neural network layers, wherein the neural network is configured to obtain a collection of input facial images of a user, wherein the collection of input facial images of the user comprises (i) a query image of the user, (ii) one or more calibration images of the user, and (iii) a respective calibration label that labels a known gaze position of the user for each of the one or more calibration images of the user; and process the received collection of input facial images of the user using the one or more neural network layers to generate a neural network output that characterizes a gaze position of the user in the query image.Type: ApplicationFiled: June 28, 2016Publication date: December 28, 2017Inventors: Dmitry Lagun, Vidhya Navalpakkam
-
Publication number: 20170273555Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: ApplicationFiled: March 7, 2017Publication date: September 28, 2017Inventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
-
Patent number: 9629543Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: GrantFiled: February 26, 2010Date of Patent: April 25, 2017Assignee: Emory UniversityInventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola
-
Publication number: 20120059282Abstract: Disclosed are methods for diagnosing declarative memory loss using mouse tracking to follow the visual gaze of a subject taking a visual paired comparison test. Also disclosed are methods for diagnosing dementia such as mild cognitive impairment and Alzheimer's disease.Type: ApplicationFiled: February 26, 2010Publication date: March 8, 2012Applicant: EMORY UNIVERSITYInventors: Yevgeny E. Agichtein, Elizabeth A. Buffalo, Dmitry Lagun, Cecelia Manzanares, Stuart Zola