Abstract: Effective patient-centered care in a hospital relies heavily on the ability of patients to communicate their physical needs to care givers. If a patient is unable to speak, he has limited means of communicating at a time when he needs it the most. The embodiments presented here, generally referred to as EyeVoice, include unobtrusive eye-operated communication systems for locked-in hospital patients who cannot speak or gesture. EyeVoice provides an alternate means of communication, allowing hospital patients to communicate with their care givers using their eyes in place of their voices. Simply by looking at images and cells displayed on a computer screen placed in front of them, patients are able to: answer questions posed by caregivers; specify locations, types and degrees of pain and discomfort; request specific forms of assistance; ask or answer care related questions, and help direct his own care.

Abstract: A device for performing eyetracking on a handheld device includes and eyetracking camera and an eyetracking camera boom mount. The eyetracking camera boom mount physically and electrically connects a handheld device and the eyetracking camera. The eyetracking camera boom mount includes an extension boom that positions the eyetracking camera behind the user's hands. The extension boom provides the eyetracking camera with a view of the user's eyes that is unobstructed by the user's hands. The device can further include an operating scene camera for monitoring a person's hand operations on the handheld device. The operating scene camera can be mounted on the same extension boom as the eyetracking camera or on a separate extension boom.

Abstract: A system and method are disclosed for using a camera image of a user's eye as a visual stimulus for the calibration point in an eyetracking calibration system. A camera image of a user's eye is generated on a user display using an eyetracker. The camera image of the user's eye is used as a visual stimulus of a calibration point. In an embodiment, the center of the pupil of the camera image of the user's eye represents the coordinates of the calibration point on the user display. In another embodiment, the center of the corneal reflection of the camera image of the user's eye represents the coordinates of the calibration point on the user display.

Abstract: An asymmetric aperture device for a camera is provided that improves light gathering properties by increasing both the light gathering opening of the aperture and the number of light producing light sources placed on the aperture. An asymmetric aperture design is provided that utilizes a significantly larger portion of the camera lens. The tradeoff between the competing objectives of maximizing camera depth of field and maximizing the production of useful focus-condition information within the camera image is optimized. More illumination is provided without significantly increasing the lateral size of the illuminator pattern.

Abstract: A miniature eyetracking system is disclosed that includes a camera, a microelectromechanical (MEMS) device, and a processor. The camera images an eye. The MEMS device controls the view-direction of the camera. The processor receives an image of the eye from the camera, determines the location of the eye within the camera image, and controls the MEMS to keep the camera pointed at the eye. In another embodiment, the MEMS device controls an adjustable focus of the camera. The processor determines the focus condition of the eye image, and controls the MEMS device to maintain a desired focus condition of the camera on the eye. In another embodiment, the MEMS device controls an adjustable camera zoom. The processor determines the size of the eye image within the overall camera image, and controls the MEMS to maintain a desired size of the eye image within the overall camera image.

Abstract: Gaze based systems and methods are used to aid traffic controllers and/or pilots. A gaze line of an eye of the user viewing the display is tracked using an eyetracker. An intersection of the gaze line of the eye with the display is calculated to provide continuous feedback as to where on the display the user is looking. A trace of the gaze line of the eye is correlated with elements of a situation. The user's awareness of the situation is inferred by verifying that the user has looked at the elements of the situation. In an embodiment, the user is notified of the situation when it is determined that the user has not looked at the elements of the situation for a predetermined period of time. The notification is automatically removed once it is determined that the user has looked at the elements of the situation.

Abstract: A setting of a video camera is remotely controlled. Video from a video camera is displayed to a user using a video display. At least one eye of the user is imaged as the user is observing the video display, a change in an image of at least one eye of the user is measured over time, and an eye/head activity variable is calculated from the measured change in the image using an eyetracker. The eye/head activity variable is translated into a camera control setting, and an actuator connected to the video camera is instructed to apply the camera control setting to the video camera using a processor.

Abstract: Effective patient-centered care in a hospital relies heavily on the ability of patients to communicate their physical needs to care givers. If a patient is unable to speak, he has limited means of communicating at a time when he needs it the most. The embodiments presented here, generally referred to as EyeVoice, include unobtrusive eye-operated communication systems for locked-in hospital patients who cannot speak or gesture. EyeVoice provides an alternate means of communication, allowing hospital patients to communicate with their care givers using their eyes in place of their voices. Simply by looking at images and cells displayed on a computer screen placed in front of them, patients are able to: answer questions posed by caregivers; specify locations, types and degrees of pain and discomfort; request specific forms of assistance; ask or answer care related questions, and help direct his own care.

Abstract: A target is imaged in a three-dimensional real space using two or more video cameras. A three-dimensional image space combined from two video cameras of the two or more video cameras is displayed to a user using a stereoscopic display. A right eye and a left eye of the user are imaged as the user is observing the target in the stereoscopic video display, a right gaze line of the right eye and a left gaze line of the left eye are calculated in the three-dimensional image space, and a gazepoint in the three-dimensional image space is calculated as the intersection of the right gaze line and the left gaze line using a binocular eyetracker. A real target location is determined by translating the gazepoint in the three-dimensional image space to the real target location in the three-dimensional real space from the locations and the positions of the two video cameras using a processor.

Abstract: An embodiment of the present invention is a system for identifying a user by observing irregularities on the surface of an eyeball of the user includes a topography system and a gaze tracking system. The topography system obtains one or more discernable features of the eyeball and stores the one or more discernable features. The gaze tracking system observes the irregularities, compares the irregularities to the one or more discernable features, and identifies the user if the irregularities and the one or more discernable features match.

Abstract: Gaze based systems and methods are used to aid traffic controllers and/or pilots. A gaze line of an eye of the user viewing the display is tracked using an eyetracker. An intersection of the gaze line of the eye with the display is calculated to provide continuous feedback as to where on the display the user is looking A trace of the gaze line of the eye is correlated with elements of a situation. The user's awareness of the situation is inferred by verifying that the user has looked at the elements of the situation. In an embodiment, the user is notified of the situation when it is determined that the user has not looked at the elements of the situation for a predetermined period of time. The notification is automatically removed once it is determined that the user has looked at the elements of the situation.

Abstract: Gaze based systems and methods are used to monitor the attention of a user. One or more images are displayed to a user on a display. It is determined that an image of the one or more images is being viewed by an eye of the user from one or more measurements received from an eyetracker. One or more modifications to the image are displayed on the display over time so as to maintain the attention of the user. Whether or not the attention of the user is maintained is determined from one or more additional measurements received from the eyetracker after the one or more modifications to the image. In various embodiments, the one or more modifications to the image include moving the image on the display. In various embodiments, the one or more modifications to the image include animating the image on the display.

Abstract: A system for determining a three-dimensional location and orientation of an eye within a camera frame of reference includes a camera, an illuminator, and a processor. The camera captures an image of the eye. The illuminator generates a reflection off of a corneal surface of the eye. The processor computes a first two-dimensional location of a pupil reflection image and a corneal reflection image from the image of the eye. The processor predicts a second two-dimensional location of a pupil reflection image and the corneal reflection image as a function of a set of three-dimensional position and orientation parameters of the eye within the camera frame of reference. The processor iteratively adjusts the set until the first two-dimensional location is substantially the same as the second two-dimensional location. The set is the three-dimensional location and orientation of an eye.

Abstract: A target is imaged in a three-dimensional real space using two or more video cameras. A three-dimensional image space combined from two video cameras of the two or more video cameras is displayed to a user using a stereoscopic display. A right eye and a left eye of the user are imaged as the user is observing the target in the stereoscopic video display, a right gaze line of the right eye and a left gaze line of the left eye are calculated in the three-dimensional image space, and a gazepoint in the three-dimensional image space is calculated as the intersection of the right gaze line and the left gaze line using a binocular eyetracker. A real target location is determined by translating the gazepoint in the three-dimensional image space to the real target location in the three-dimensional real space from the locations and the positions of the two video cameras using a processor.

Abstract: A setting of a video camera is remotely controlled. Video from a video camera is displayed to a user using a video display. At least one eye of the user is imaged as the user is observing the video display, a change in an image of at least one eye of the user is measured over time, and an eye/head activity variable is calculated from the measured change in the image using an eyetracker. The eye/head activity variable is translated into a camera control setting, and an actuator connected to the video camera is instructed to apply the camera control setting to the video camera using a processor.

Abstract: A system for determining a three-dimensional location and orientation of an eye within a camera frame of reference includes a camera, an illuminator, and a processor. The camera captures an image of the eye. The illuminator generates a reflection off of a corneal surface of the eye. The processor computes a first two-dimensional location of a pupil reflection image and a corneal reflection image from the image of the eye. The processor predicts a second two-dimensional location of a pupil reflection image and the corneal reflection image as a function of a set of three-dimensional position and orientation parameters of the eye within the camera frame of reference. The processor iteratively adjusts the set until the first two-dimensional location is substantially the same as the second two-dimensional location. The set is the three-dimensional location and orientation of an eye.

Abstract: An embodiment of the present invention provide a system for measuring and modifying at least one model parameter of an object of an image in order to distinguish the object from noise in the image includes a perceived image generator, an image-match function, and a parameter adjustment function. The perceived image generator produces a first perceived image of the object based on the at least one model parameter. The image-match function compares the first perceived image with a real image of the object. The parameter adjustment function adjusts the at least one model parameter so that the perceived image generator produces a second perceived image of the object that more closely matches the real image than the first perceived image.

Abstract: One embodiment of the present invention is a method for computing a first gaze axis of an eye in a first coordinate system. A camera is focused on the eye and moved to maintain the focus on the eye as the eye moves in the first coordinate system. A first location of the camera in the first coordinate system is measured. A second location of the eye and a gaze direction of the eye within a second coordinate system are measured. A second gaze axis within the second coordinate system is computed from the second location and the gaze direction. The first gaze axis is computed from the second gaze axis and the first location using a first coordinate transformation.

Abstract: Embodiments of the present invention relate to systems and methods for minimizing motion clutter in image-generation devices. Temporally-interleaved image-subtraction reduces the magnitude of motion clutter and has no adverse effect on the desired ambient-light cancellation of static images. Embodiments of image-generation devices employing temporally-interleaved image-subtraction include single, double, triple, and series accumulator configurations. All four embodiments allow synchronization with scene illuminators and may be implemented on a single electronic chip. Temporally-interleaved image-subtraction is particularly well suited for use in video eyetracking applications where ambient light and scene motion can cause significant problems.

Abstract: An embodiment of the present invention provide a system for measuring and modifying at least one model parameter of an object of an image in order to distinguish the object from noise in the image includes a perceived image generator, an image-match function, and a parameter adjustment function. The perceived image generator produces a first perceived image of the object based on the at least one model parameter. The image-match function compares the first perceived image with a real image of the object. The parameter adjustment function adjusts the at least one model parameter so that the perceived image generator produces a second perceived image of the object that more closely matches the real image than the first perceived image.