Abstract: One embodiment of the present disclosure sets forth a method that includes receiving one or more two-dimensional images of one or more light patterns incident on an eye proximate to an eye region of a near-eye display device, and computing a gaze direction associated with the eye based on the one or more two-dimensional images.

Abstract: Techniques for eye-tracking in a near-eye display system are disclosed. One example of a near-eye display system includes a waveguide-based display substrate transparent to visible light and configured to be placed in front of a user's eye. The waveguide-based display substrate includes a first light deflector configured to direct a first portion of invisible light reflected by the user's eye to a camera to form a first image of the user's eye in a first area of an image frame, and a second light deflector configured to direct a second portion of the invisible light reflected by the user's eye to the camera to form a second image of the user's eye in a second area of the image frame.

Abstract: Techniques for eye-tracking in a near-eye display system are disclosed. One example of a near-eye display system includes a waveguide-based display substrate that is transparent to visible light and configured to be placed in front of a user's eye. The waveguide-based display substrate includes a first surface area configured to specularly reflect a first portion of invisible light reflected by the user's eye to a camera to form a first image of the user's eye in a first area of an image frame, and a light deflector embedded in the waveguide-based display substrate or formed on a second surface area of the waveguide-based display substrate. The light deflector is configured to direct a second portion of the invisible light reflected by the user's eye to the camera to form a second image of the user's eye in a second area of the image frame.

Abstract: A head mounted display (HMD) includes one or more light field cameras for tracking one or both eyes of a user wearing the HMD. The HMD optionally includes light sources positioned inside the HMD and that illuminate one or both of the eyes of the user. The light field camera captures a plenoptic image of the user's eye. The plenoptic image includes light intensity data and direction data of the captured light rays. An eye tracking system updates a 3D light field model of the user's eye based on depth information from the plenoptic image frame. The eye tracking system identifies an iris plane of the user's eye using the 3D light field model. The eye tracking system determines a gaze direction of the user's eye by identifying the normal to the center of the iris plane.

Abstract: A head mounted display (HMD) includes one or more light field cameras for tracking one or both eyes of a user wearing the HMD. The HMD optionally includes light sources positioned inside the HMD and that illuminate one or both of the eyes of the user. The light field camera captures a plenoptic image of the user's eye. The plenoptic image includes light intensity data and direction data of the captured light rays. An eye tracking system updates a 3D light field model of the user's eye based on depth information from the plenoptic image frame. The eye tracking system identifies an iris plane of the user's eye using the 3D light field model. The eye tracking system determines a gaze direction of the user's eye by identifying the normal to the center of the iris plane.