Abstract: One embodiment of this disclosure can provide a pair of augmented reality (AR) glasses. The AR glasses can include a pair of lenses, with at least a portion of a lens of the AR glasses functioning as a see-through display; a frame comprising rims surrounding the lenses; a rear-facing camera embedded in a rim and configured to capture) images of a corresponding eye of a user while the user is wearing the AR glasses; and a user-authentication system to authenticate the user based on the captured eye images. The result of the user authentication is displayed on the see-through display.

Abstract: One embodiment of this disclosure can provide a system and method for training a machine learning model to detect pupil centers. During operation, the system can obtain a set of labeled pupil images, with a respective labeled pupil image comprising a pupil-segmentation label and a pupil-center-position label; construct a multitask machine learning model that includes a first branch for performing a pupil-region segmentation task and a second branch for performing a pupil-center-position regression task; and train the multitask machine learning model using the set of labeled pupil images. Training the multitask machine learning model comprises simultaneously training the first and second branches.

Abstract: One embodiment of this disclosure can provide a system and method for estimating user gazes. During operation, the system can obtain an event stream captured by an event camera monitoring movement of a user's eye, generate an event image by accumulating, at a pixel level, events that occurred within a predetermined interval based on the event stream and determining a pixel value of each pixel based on the accumulated events associated with the pixel, and input the event image to a gaze-estimation machine learning model, which generates a first prediction output regarding a direction of the user's eye movement and a second prediction output regarding a speed of the user's eye movement.

Abstract: One embodiment of this disclosure can provide a pair of augmented reality (AR) glasses. The AR glasses can include a pair of lenses and a frame. At least a portion of a lens of the AR glasses can function as a see-through display, and the frame can be embedded with at least a processing unit, a storage unit, a network unit, and a user-interaction unit.