Patents by Inventor Jatin SHARMA
Jatin SHARMA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12008159Abstract: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.Type: GrantFiled: February 23, 2023Date of Patent: June 11, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Jatin Sharma, Jonathan T. Campbell, Jay C. Beavers, Peter John Ansell
-
Patent number: 11998335Abstract: Systems and methods are provided for collecting eye-gaze data for training an eye-gaze prediction model. The collecting includes selecting a scan path that passes through a series of regions of a grid on a screen of a computing device, moving a symbol as an eye-gaze target along the scan path, and receiving facial images at eye-gaze points. The eye-gaze points are uniformly distributed within the respective regions. Areas of the regions that are adjacent to edges and corners of the screen are smaller than other regions. The difference in areas shifts centers of the regions toward the edges, density of data closer to the edges. The scan path passes through locations in proximity to the edges and corners of the screen for capturing more eye-gaze points in the proximity. The methods interactively enhance variations of facial images by displaying instructions to the user to make specific actions associated with the face.Type: GrantFiled: April 19, 2021Date of Patent: June 4, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Jatin Sharma, Jonathan T. Campbell, Jay C. Beavers, Peter John Ansell
-
Publication number: 20230308505Abstract: Aspects of the present disclosure relate to multi-user, multi-device gaze tracking. In examples, a system includes at least one processor, and memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations. The set of operations include identifying a plurality of computing devices, and identifying one or more users. The set of operations may further include receiving gaze input data and load data, from two or more of the plurality of computing devices. The set of operations may further include performing load balancing between the plurality of devices, wherein the load balancing comprises assigning one or more tasks from a first of the plurality of computing devices to a second of the plurality of computing devices based upon the gaze input data.Type: ApplicationFiled: March 22, 2022Publication date: September 28, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Jatin SHARMA, Kenneth P. HINCKLEY, Jay C. BEAVERS, Michel PAHUD
-
Publication number: 20230195224Abstract: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.Type: ApplicationFiled: February 23, 2023Publication date: June 22, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Jatin SHARMA, Jonathan T. CAMPBELL, Jay C. BEAVERS, Peter John ANSELL
-
Patent number: 11619993Abstract: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.Type: GrantFiled: April 19, 2021Date of Patent: April 4, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Jatin Sharma, Jonathan T. Campbell, Jay C. Beavers, Peter John Ansell
-
Publication number: 20220334637Abstract: Systems and methods are provided for predicting an eye gaze location of an operator of a computing device. In particular, the method generates an image grid that includes regions of interest based on a facial image. The facial image is based on a received image frame of a video stream that captures the operator using the computing device. The image grid further includes a region that indicate rotation information of the face. The method further uses a combination of trained neural networks to extract features of the regions of interest in the image grid and predict the eye gaze location on the screen of the computing device. The trained set of neural networks includes a convolutional neural network. The method optionally generate head pose pitch, roll, and yaw information to improve accuracy of predicting the location of an eye gaze.Type: ApplicationFiled: April 19, 2021Publication date: October 20, 2022Applicant: Microsoft Technology Licensing, LLCInventors: Jatin SHARMA, Jonathan T. CAMPBELL, Jay C. BEAVERS, Peter John ANSELL
-
Publication number: 20220330863Abstract: Systems and methods are provided for collecting eye-gaze data for training an eye-gaze prediction model. The collecting includes selecting a scan path that passes through a series of regions of a grid on a screen of a computing device, moving a symbol as an eye-gaze target along the scan path, and receiving facial images at eye-gaze points. The eye-gaze points are uniformly distributed within the respective regions. Areas of the regions that are adjacent to edges and corners of the screen are smaller than other regions. The difference in areas shifts centers of the regions toward the edges, density of data closer to the edges. The scan path passes through locations in proximity to the edges and corners of the screen for capturing more eye-gaze points in the proximity. The methods interactively enhance variations of facial images by displaying instructions to the user to make specific actions associated with the face.Type: ApplicationFiled: April 19, 2021Publication date: October 20, 2022Applicant: Microsoft Technology Licensing, LLCInventors: Jatin SHARMA, Jonathan T. CAMPBELL, Jay C. BEAVERS, Peter John ANSELL