Abstract: A computer implemented method and system for fitting eyeglasses captures images of the consumer while naturally trying-on frames in the normal course of selecting new frames. The system and method capture natural images of frame placement and using gaze prediction and eye tracking techniques ascertain eye measurements for accurate placement of the prescription within new eyewear.

Abstract: Methods, systems, and storage media for projecting a viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for a viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of processed image projections for display by the single 3D display. The digital-processing of input image projection enables a separate optical input to the user's eyes, and by the use of visual-acuity pre-processing of the image—via visual-field kernel, enables the treatment of eye abbreviations, including an Amblyopic-eye without the need for any additional eye-ware, or head-up-displays (HMD's).

Abstract: Systems, methods and programs that implicitly determine the individual gaze correction required for each user for determining the point-of-regard and region of interest using a seamless-adaptation-process (SAP) in settings when calibration is not practical/desired (e.g. long-range display eye sensing). The systems, methods, and programs also correct for variables arising from salient features such as user eye attributes (e.g., ocular dominance or chronic eyesight conditions) that are not visible within a digital frame, environmental conditions, and camera-screen settings. The method is not eye-tracking method dependent, and can perform under all environmental conditions while the displayed content is known. The concept of data-driven seamless gaze correction can be extended beyond long-range displays to any gaze-enabled device where fixation accuracy can be improved (e.g., mobile phones, tablets, etc.).

Abstract: A digital display system to administer a myopia protocol, the system utilizing a forward-looking camera, a digital display, and processor to process digital media, face and eye landmark images, and determine the viewer-to-display distance, where the data is used to calculate a cone of vision, infer a fixation region, and receive a visual blurring function, where the system determines an area of interest in each image based on eye-tracking data and applies the visual blurring function to the area of interest using the visual blurring function, thereby providing a personalized, interactive experience complimenting traditional myopia protocols.

Abstract: The disclosure relates to systems, methods and programs implicitly determines the individual gaze correction required for each user when it comes to determining the point-of-regard and region of interest using a seamless-adaptation-process (SAP) in settings when calibration is not practical/desired (e.g. long-range display eye sensing). The present systems, methods, and programs also correct for variables arising from salient features such as user eye attributes (e.g., ocular dominance or chronic eyesight conditions) that are not visible within a digital frame, environmental conditions, and camera-screen settings. The method is not eye-tracking method dependent, can perform under all environmental conditions while the displayed content is known. The concept of a data driven seamless gaze correction can be extended beyond long-range displays to any gaze-enabled device where fixation accuracy can be improved (e.g., mobile phones, tablets etc.).

Abstract: Unsupervised, deep learning of eye-landmarks in a user-specific eyes' image data by capturing an unlabeled image comprising an eye region of a user, using an initial geometrically regularized loss function, training a plurality of convolutional autoencoders on the unlabeled image comprising the eye region of the user to recover a plurality of user-specific eye landmarks, training a convolutional neural network for autoencoded landmarks-based recovery from the unlabeled image, and where the initial geometrically regularized loss function is represented by the formula LAE=?reconLrecon+?concLconc+?sepLsep+?eqvLeqv where LAE is total AutoEncoder Loss, ?reconLrecon is ?-weighted reconstruction loss, ?concLconce is ?-weighted concentration loss, ?sepLsep is ?-weighted separation loss, and ?eqvLeqv is ?-weighted equivalence loss.

Abstract: Methods, systems, and computer-readable media for generating realistic augmented face images are disclosed. Implementations include a) receiving head pose data, segmented eye region image data, eye position data, gaze direction data, and face and eye landmark data from an individual; b) receiving a user selection of a facial object to be added or removed from an image of the individual; and c) using a deep learning model, i) generating one or more images of the individual with the facial object in place on the one or more images, or ii) generating one or more images of the individual with the facial object removed from the one or more images.

Abstract: Methods, systems, and computer-readable media for generating realistic augmented face images are disclosed. Implementations include a) receiving head pose data, segmented eye region image data, eye position data, gaze direction data, and face and eye landmark data from an individual; b) receiving a user selection of a facial object to be added or removed from an image of the individual; and c) using a deep learning model, i) generating one or more images of the individual with the facial object in place on the one or more images, or ii) generating one or more images of the individual with the facial object removed from the one or more images.

Abstract: The disclosure relates to systems, methods and programs for developing real-time user-specific eye model based on iris localization using solely pupil-ellipse analysis.

Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Embodiments described systems and method to estimate user gaze comprising receiving a target image data associated with the user from a camera coupled with the display, wherein the target image data includes a target eye patch image data associated with the user; and determining, using a neural network, the target point of regard associated with the target image data based on: the target eye patch image data, a plurality of aggregated gaze reference vectors, and a plurality of reference image data associated with the user, respectively associated with the plurality of aggregated gaze reference vectors. In embodiments, the target point of regard is determined within a predetermined threshold. In embodiments, the target point of regard is mapped onto the display.

Abstract: Anatomically-constrained gaze estimation providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: Geometrically constrained unsupervised training of convolutional autoencoders on unlabeled images for extracting eye landmarks by capturing an unlabeled image including the eye region of a user and training multiple convolutional autoencoders on the unlabeled image using an initial geometrically regularized loss function to determine multiple eye landmarks.

Abstract: The disclosure relates to systems, methods, and programs for implicitly determining the relation of the eyes associated with gaze inference, including salient features (e.g., ocular dominance) that are not visible within a digital frame, allowing for real-time determination of the user's dominant eye for the purpose of gaze estimation, and point-of-regard mapping onto a 2D plane, achieved through an end-to-end training of an eye selector agent with domain-expertise knowledge embedded in an unsupervised manner via a convolutional deep neural network training process.

Abstract: Methods, systems, and storage media for projecting a viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for a viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of processed image projections for display by the single 3D display. The digital-processing of input image projection enables a separate optical input to the user's eyes, and by the use of visual-acuity pre-processing of the image—via visual-field kernel, enables the treatment of eye abbreviations, including an Amblyopic-eye without the need for any additional eye-ware, or head-up-displays (HMD's).

Abstract: Anatomically-constrained gaze estimation providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: A computer implemented method and system for fitting eyeglasses captures images of the consumer while naturally trying-on frames in the normal course of selecting new frames. The system and method capture natural images of frame placement and using gaze prediction and eye tracking techniques ascertain eye measurements for accurate placement of the prescription within new eyewear.

Abstract: The disclosure relates to systems, methods and programs for geometrically constrained, unsupervised training of convolutional autoencoders on unlabeled images for extracting eye landmarks. Disclosed systems for unsupervised deep learning of gaze estimation in eyes' image data are implementable in a computerized system. Disclosed methods include capturing an unlabeled image comprising the eye region of a user; and training a plurality of convolutional autoencoders on the unlabeled image comprising the eye region of a user using an initial geometrically regularized loss function to determine a plurality of eye landmarks.