Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Methods, systems, and storage media for projecting multi-viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for at least one viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of image projections for display by the single 3D display.

Abstract: Embodiments described systems and method to estimate user gaze comprising receiving a target image data associated with the user from a camera coupled with the display, wherein the target image data includes a target eye patch image data associated with the user; and determining, using a neural network, the target point of regard associated with the target image data based on: the target eye patch image data, a plurality of aggregated gaze reference vectors, and a plurality of reference image data associated with the user, respectively associated with the plurality of aggregated gaze reference vectors. In embodiments, the target point of regard is determined within a predetermined threshold. In embodiments, the target point of regard is mapped onto the display.

Abstract: Anatomically-constrained gaze estimation providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: Geometrically constrained unsupervised training of convolutional autoencoders on unlabeled images for extracting eye landmarks by capturing an unlabeled image including the eye region of a user and training multiple convolutional autoencoders on the unlabeled image using an initial geometrically regularized loss function to determine multiple eye landmarks.

Abstract: The disclosure relates to systems, methods, and programs for implicitly determining the relation of the eyes associated with gaze inference, including salient features (e.g., ocular dominance) that are not visible within a digital frame, allowing for real-time determination of the user's dominant eye for the purpose of gaze estimation, and point-of-regard mapping onto a 2D plane, achieved through an end-to-end training of an eye selector agent with domain-expertise knowledge embedded in an unsupervised manner via a convolutional deep neural network training process.

Abstract: Methods, systems, and storage media for projecting a viewer-specific 3D object perspectives from a single 3D display are disclosed. Implementations may: acquire face and eye region image data of a plurality of viewers within a field of view of at least one camera associated with a 3D-enabled digital display; analyze the eye region image data to determine at least one 3D eye position, at least one eye state, at least one gaze angle, and at least one point-of-regard for a viewer relative to at least one camera associated with the 3D-enabled digital display; and calculate a plurality of processed image projections for display by the single 3D display. The digital-processing of input image projection enables a separate optical input to the user's eyes, and by the use of visual-acuity pre-processing of the image—via visual-field kernel, enables the treatment of eye abbreviations, including an Amblyopic-eye without the need for any additional eye-ware, or head-up-displays (HMD's).

Abstract: Anatomically-constrained gaze estimation providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: The disclosure relates to systems, methods and programs for geometrically constrained, unsupervised training of convolutional autoencoders on unlabeled images for extracting eye landmarks. Disclosed systems for unsupervised deep learning of gaze estimation in eyes' image data are implementable in a computerized system. Disclosed methods include capturing an unlabeled image comprising the eye region of a user; and training a plurality of convolutional autoencoders on the unlabeled image comprising the eye region of a user using an initial geometrically regularized loss function to determine a plurality of eye landmarks.

Abstract: The disclosure relates to systems, methods and programs for anatomically-constrained gaze estimation. More specifically, the disclosure is directed to systems, methods and programs for providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: A system for social interaction using a photo-realistic novel view of an event includes a multi-view reconstruction system for developing transmission data of the event a plurality of client-side rendering devices, each rendering device receiving the transmission data from the multi-view reconstruction system and rendering the transmission data as the photo-realistic novel view. A method of social interaction using a photo-realistic novel view of an event includes transmitting by a server side transmission data of the event; receiving by a first user on a first rendering device the data transmission; selecting by the first user a path for rendering on the first rendering device at least on novel view; rendering by the first rendering device the at least one novel view; and saving by the user on the first rendering device novel view date for the at least one novel view.

Abstract: Embodiments described systems and method to estimate user gaze comprising receiving a target image data associated with the user from a camera coupled with the display, wherein the target image data includes a target eye patch image data associated with the user; and determining, using a neural network, the target point of regard associated with the target image data based on: the target eye patch image data, a plurality of aggregated gaze reference vectors, and a plurality of reference image data associated with the user, respectively associated with the plurality of aggregated gaze reference vectors. In embodiments, the target point of regard is determined within a predetermined threshold. In embodiments, the target point of regard is mapped onto the display.

Abstract: The disclosure relates to systems, methods and programs for anatomically-constrained gaze estimation. More specifically, the disclosure is directed to systems, methods and programs for providing a point of reference (PoR) in a 3D field and/or 2D plane, based on 6 DOF head pose constrained by the eyeball center being fixed in a common 3D coordinate system.

Abstract: The disclosure relates to systems, methods and programs for developing real-time user-specific eye model based on iris localization using solely pupil-ellipse analysis.

Abstract: The disclosure relates to systems, methods and programs for geometrically constrained, unsupervised training of convolutional autoencoders on unlabeled images for extracting eye landmarks.

Abstract: A system for social interaction using a photo-realistic novel view of an event includes a multi-view reconstruction system for developing transmission data of the event a plurality of client-side rendering devices, each rendering device receiving the transmission data from the multi-view reconstruction system and rendering the transmission data as the photo-realistic novel view. A method of social interaction using a photo-realistic novel view of an event includes transmitting by a server side transmission data of the event; receiving by a first user on a first rendering device the data transmission; selecting by the first user a path for rendering on the first rendering device at least on novel view; rendering by the first rendering device the at least one novel view; and saving by the user on the first rendering device novel view date for the at least one novel view.

Abstract: A system for social interaction using a photo-realistic novel view of an event includes a multi-view reconstruction system for developing transmission data of the event a plurality of client-side rendering devices, each rendering device receiving the transmission data from the multi-view reconstruction system and rendering the transmission data as the photo-realistic novel view. A method of social interaction using a photo-realistic novel view of an event includes transmitting by a server side transmission data of the event; receiving by a first user on a first rendering device the data transmission; selecting by the first user a path for rendering on the first rendering device at least on novel view; rendering by the first rendering device the at least one novel view; and saving by the user on the first rendering device novel view date for the at least one novel view.

Abstract: A method of limiting processing by a 3D reconstruction system of an environment in a 3D reconstruction of an event includes dividing by the subdivision module the volume into sub-volumes; projecting from each camera each of the sub-volumes to create a set of sub-volumes masks relative to each camera; creating an imaging mask for each camera; comparing for each camera by the subdivision module the respective imaging mask to the respective subvolume mask and extracting at least one feature from at least one imaging mask; saving by the subdivision module the at least one feature to a subspace division mask; cropping the at least one feature from the imaging frames using the subspace division mask; and processing only the at least one feature for a 3D reconstruction. The system includes cameras for recording the event in imaging frames; and a subdivision module for dividing the volume into sub-volumes.

Abstract: A method of generating user-selectable novel views of an event on a viewing device includes reconstructing by a server system for each camera image data into at least one foreground model for the respective camera and an environment model for the respective camera; joining by the server system the foreground model for each camera to create a visual atlas of all foreground models; creating by the server system foreground mapping data for foreground image data in the visual atlas; creating by the server system environment mapping data for environment image data in each respective environment model; transmitting by the server system each compressed data in a sequence it was compressed; receiving by the viewing device all compressed data; uncompressing by the viewing device all compressed data; selecting by a user the novel view; and rendering by the viewing device each novel view.