Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit.

Abstract: Disclosed are an optical detection method and an optical detection apparatus for a fatigue state of a user, and an optical detection device, this application relates to the field of detection technology, and is for improving accuracy of detection of the fatigue state. An optical detection method includes: irradiating eyes of the user with an infrared light; obtaining an intensity of an infrared light reflected by the eyes of the user; and determining whether the user is in a fatigue state based on the intensity of the reflected infrared light.

Abstract: Embodiments of the present disclosure provide a method and a device for determining a gaze placement and a computer readable storage medium. The method comprises acquiring an ocular image of a subject; determining at least one gaze characteristic vector based on an ocular image; determining a gaze placement of the subject, according to a gaze estimation model and the at least one characteristic vector. The characteristic vector comprises at least one of: a first characteristic vector from a first reference speckle center to a pupil center, wherein the first reference speckle is formed by a first reference source in the ocular image; a second characteristic vector from the pupil center to a second reference speckle center, wherein the second reference speckle is formed by a second reference source in the ocular image; a third characteristic vector from the second reference speckle center to the first reference speckle center.

Abstract: The invention relates to a method for performing a movement correction when measuring a human eye, in which the eye is scanned by a measurement beam in order to obtain a set of position values of an eye structure. Scanning extends over a measurement time interval, wherein the position values are each provided with a timestamp within the measurement time interval. A surface shape and a displacement function are determined, with the displacement function representing a movement pattern during the measurement time interval, and the surface shape and the displacement function being determined in such a way that the position values are approximated by the surface shape when the surface shape is moved according to the displacement function. Moreover, the invention relates to an associated measurement system.

Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light.

Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.

Abstract: A head mounted display comprises an eye tracking system configured to enable eye tracking using polarization. The eye tracking system includes one or more illumination sources and an optical detector comprising polarization sensitive pixels. The one or more illumination sources are configured to illuminate a user's eye and generate reflections directed towards the optical detector. The eye tracking system determines, for each polarization sensitive pixel in a subset of the polarization sensitive pixels, one or more estimation parameters. The eye tracking system determines, for the subset of the polarization sensitive pixels, depth information for one or more glints associated with one or more surfaces of the eye, based in part on the polarization of the reflections and the one or more estimation parameters. The determined depth information is used to update a model of the eye. The eye tracking system determines eye tracking information based on the updated model.

Abstract: A concise representation illustrating essential elements of a subjective refraction eye test that includes choices of optics offered to a test subject, responses by the test subject indicating respective choices among the optics, and time durations of, between, or both of and between, responses by the test subject indicating the respective choices of optics. The concise representation includes a presentation that illustrates the essential elements of the eye test.

Abstract: A system includes a camera positioned in an environment to capture image data of a subject; a computing device communicatively coupled to the camera, the computing device comprising a processor and a non-transitory computer-readable memory; and a machine-readable instruction set stored in the non-transitory computer-readable memory. The machine-readable instruction set causes the computing device to perform at least the following when executed by the processor: receive the image data from the camera; analyze the image data captured by the camera using a neural network trained on training data generated from a 360-degree panoramic camera configured to collect image data of a subject and a visual target that is moved about an environment; and predict a gaze direction vector of the subject with the neural network.

Abstract: The disclosure relates to a method of determining a gaze distance, the method including obtaining a plurality of images by capturing each of both eyes of a user, determining, from each of the plurality of images, a corner point located at an edge of the eye, a location of a pupil, and an eye contour, determining each of gaze directions of both of the eyes based on a difference between a reference point and the location of the pupil, wherein the reference point is determined based on the eye contour and a location of the corner point, and determining a gaze distance based on a difference between the gaze directions of both of the eyes.

Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.

Abstract: An information processing device according to an aspect of the present technology includes a user information acquiring unit, an object information acquiring unit, and an output control unit. The user information acquiring unit acquires information related to a gaze position of a user while a substance of content is being automatically reproduced, in accordance with a first control amount, from an audio source located in a space in which the user is located. The object information acquiring unit acquires position information related to the audio source and position information related to a first object gazed at by the user. The output control unit performs first output control of providing the user with the substance of the content in accordance with a second control amount different from the first control amount in a case where the gaze position within the first object moves toward the audio source.

Abstract: A system of eye tracking includes an infrared (IR) source to project IR light to an eye of a user, an IR holographic optical element (HOE) to change an angle of the IR light reflected from the eye of the user, and a sensor to receive the IR light. The system further includes a processor to use the IR light to determine a gaze vector of the user, in one embodiment.

Abstract: Eyewear having an optical waveguide communicating infrared light from a remote infrared emitter in the eyewear to an optical output coupler that uniformly illuminates an eye for tracking eye movement of a user. An optical input coupler couples a light beam emitted by the remote infrared emitter into the waveguide. The remote infrared emitter simplifies industrial design and is a single light source. The remote infrared emitter is not in a peripheral vision of a user's eye and improves a cosmetic impact.

Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.

Abstract: A building access system for a building including a front facing camera system configured to capture one or more images of a face of a user, wherein one or more front facing camera processing circuits configured to detect and authenticate the user based on the one or more images captured by the front facing camera system and operate building equipment. The system further including a down facing camera system configured to capture one or more overhead images of the user from an overhead perspective, wherein one or more down facing camera processing circuits configured to detect whether a second user is tailgating the user based on the one or more overhead images captured by the down facing camera system and generate an alarm in response to a detection that the second user is tailgating the user.

Abstract: A method and system for monitoring the motion of one or both eyes, includes capturing a sequence of overlapping images of a subject's face including an eye and the corresponding non-eye region; identifying a plurality of keypoints in each image; mapping corresponding keypoints in two or more images of the sequence; assigning the keypoints to the eye and to the corresponding non-eye region; calculating individual velocities of the corresponding keypoints in the eye and the corresponding non-eye region to obtain a distribution of velocities; extracting at least one velocity measured for the eye and at least one velocity measured for the corresponding non-eye region; calculating the eye-in-head velocity for the eye based upon the measured velocity for the eye and the measured velocity for the corresponding non-eye region; and calculating the eye-in-head position based upon the eye-in-head velocity.

Abstract: Embodiments of the present disclosure disclose a control method and apparatus of an intelligent device, and a storage medium. The control method includes: determining a state of a target function to acquire target function state information; detecting an operation of a user gazing at a local screen to acquire gazing operation information; and controlling the state of the target function to switch according to the gazing operation information and the target function state information.

Abstract: Apparatus, systems and methods configured for eye tracking with slippage detection and correction are disclosed. In one example, a method comprises: obtaining a first image and a second image of a person's eye, with an imaging sensor; determining a position relationship between an eyeball center of the eye and the imaging sensor based on the first image and the second image.

Abstract: A method for predicting abnormal eye convergence in a human or animal subject may involve tracking eye movement of at least one eye of the subject to generate eye tracking data for the subject and using the eye tracking data to predict whether the subject has abnormal eye convergence. A method for diagnosing a brain injury in a human or animal subject may involve tracking eye movement of at least one eye of the subject to generate eye tracking data for the subject, using the eye tracking data to predict whether the subject has abnormal eye convergence, and predicting whether a brain injury has occurred in the subject, based on the prediction of whether the subject has abnormal eye convergence.

Abstract: A head-mounted display apparatus according to an aspect of the present disclosure includes an imaging light generating device, a first deflection element including a first deflection section configured to deflect imaging light in a first direction and a second deflection section configured to deflect the imaging light in a second direction, a first diffraction element, and a second diffraction element. When a plane surrounded by the principal ray passing plane, the first principal ray, the second principal ray, and the first deflection section is taken as a first plane, and a plane surrounded by the second deflection section, the first principal ray, the second principal ray, and the first diffraction element is taken as a second plane, the first plane overlaps with at least a part of the second plane when viewed from the third direction and does not overlap with the second plane when viewed from the fourth direction.

Abstract: A virtual reality device and the operation method of virtual reality device, and the method includes: the virtual reality device displays an image content according to a corresponding viewing angle of a user; and when the time of virtual reality device detects that the viewing elevation angle is greater than a predetermined angle for a time period which exceeds a predetermined time period, the virtual reality device enters a locking mode; in the locking mode, the virtual reality device displays the image content with a fixed main field, and the virtual reality device constrains the viewing angle of the image content from the movement or rotation of the user. The present invention can determine whether to enter the locking mode according to a preset condition, and provide the main image content of the fixed field of view in the locking mode in order to achieve user convenience and save power.

Abstract: An apparatus for imaging an interior of an eye includes a light sensitive sensor, a plurality of light emitters (LEs) capable of outputting light, a plurality of nonvisible light emitters (NV-LEs) capable of outputting nonvisible light, and a controller. The controller is coupled to the plurality of LEs, the plurality of NV-LEs, and the light sensitive sensor, and the controller implements logic that when executed by the controller causes the apparatus to perform operations. The operations include illuminating the eye with the nonvisible light from the plurality of NV-LEs, and determining an amount of reflection of the nonvisible light from the eye for each of the NV-LEs in the plurality of NV-LEs. The operations also include illuminating the eye with selected one or more of the LEs in the plurality of LEs, and capturing, with the light sensitive sensor, a sequence of images of the interior of the eye while the eye is illuminated with the light from the LEs.

Abstract: A system for determining the gaze direction of a subject includes a camera, a computing device and a machine-readable instruction set. The camera is positioned in an environment to capture image data of head of a subject. The computing device is communicatively coupled to the camera and the computing device includes a processor and a non-transitory computer-readable memory. The machine-readable instruction set is stored in the non-transitory computer-readable memory and causes the computing device to: receive image data from the camera, analyze the image data using a convolutional neural network trained on an image dataset comprising images of a head of a subject captured from viewpoints distributed around up to 360-degrees of head yaw, and predict a gaze direction vector of the subject based upon a combination of head appearance and eye appearance image data from the image dataset.

Abstract: A method of at-home monitoring of eye conditions using a head mounted display that is capable of establishing a visual model associated with a patient. The visual model may include data related to a quality of the patient's vision. The patient may use the system to establish a visual model periodically, such as daily, and the system may compare the visual model to previous visual models and send an alert to the patient's physician if changes meeting a given criteria are detected. This may allow the physician to immediately take steps to save the patient's eyesight where a delay in treatment may result in vision loss.

Abstract: An eye tracker comprises a light source; a detector; and first and second waveguides. The first waveguide comprises an input coupler for coupling source light into a waveguide path and a first grating for coupling light out of the waveguide path onto an eye. The second waveguide comprises a second grating for coupling light reflected from the eye into a waveguide path and an output coupler for coupling light out of the waveguide path onto the detector. The second grating is optically configured for imaging the eye onto the detector.

Abstract: There is provided a method, system, and non-transitory computer-readable storage medium for controlling an eye tracking system to optimize eye tracking performance under different lighting conditions, by obtaining a first image captured using a camera associated with the eye tracking system, the first image comprising at least part of an iris and at least part of a pupil of an eye illuminated by an illuminator associated with the eye tracking system at a current power of illumination selected from a set of predetermined power levels; determining a contrast value between an the iris and the pupil in the image; and, if the contrast value deviates less than a preset deviation threshold value from a preset minimum contrast value, setting the current power of illumination of the illuminator to the other predetermined power level in the set of predetermined power levels.

Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.

Abstract: A method, computer program product, and visual display apparatus include a processor(s) obtaining data indicating that a user wearing the apparatus (which included an image capture device, and a projection device, communicatively coupled to the processor(s)), perceives displayed text with consistent character differences. The processor(s) obtains, from the image capture device, an image of a visual display within a visual range of the image capture device; the image includes textual elements. Based on the data, the processor(s) transforms the image into the new image that includes the textual elements with pre-defined character substitutions, based on the consistent character differences. The processor(s) displays, via the projection device, the new image, to the user, wherein based on viewing the new image, the user views the textual elements without the consistent character differences.

Abstract: A method, computer program product, and visual display apparatus include a processor(s) obtaining data indicating that a user wearing the apparatus (which included an image capture device, and a projection device, communicatively coupled to the processor(s)), perceives displayed text with consistent character differences. The processor(s) obtains, from the image capture device, an image of a visual display within a visual range of the image capture device; the image includes textual elements. Based on the data, the processor(s) transforms the image into the new image that includes the textual elements with pre-defined character substitutions, based on the consistent character differences. The processor(s) displays, via the projection device, the new image, to the user, wherein based on viewing the new image, the user views the textual elements without the consistent character differences.

Abstract: An objective testing of vergence dysfunction comprising the steps of: providing a head mounted goggle based stimulus generating eye tracking unit to the subject; presenting visual stimulus to the subject, wherein the visual stimulus is in the head mounted goggle based system and forms the optical target stimulus for at least one vergence test; obtaining objective physiologic response of the subject from the head mounted goggle unit based upon each of the visual stimulus presented to the subject in each test; and using the objective physiologic responses to diagnose the presence of vergence dysfunction. On objective portable head mounted goggle based stimulus generating eye tracking unit for vergence testing is discloses as is a method of method of vergence recovery convalescence.

Abstract: Methods and systems for assessing a health state of a person via eye movement-driven biometric systems are provided. Examples of the health states that it would be possible to detect with such a system are but not limited to brain injuries (e.g., concussions), dementia, Parkinson's disease, post-traumatic stress syndrome, schizophrenia, fatigue, cybersickness, autism, Bipolar Disorder and other health conditions that manifest themselves in abnormal behavior of the human visual system. Described methods and systems can also detect influence of alcohol and/or drugs. The system extracts biometric template of a person by deriving features from the captured eye movement signal. The system may compare the difference between previous healthy state of a tested person and newly captured template or an averaged biometric template created from the records of multiple healthy people state of multiple people and a newly captured template from a person who needs to be tested.

Abstract: A method for calibrating an eye tracker includes drawing the attention of a user to a calibration target. At least one positioning camera and at least one computer is employed to determine the position of the calibration target and the eye tracker coordinate system relative to each other. The calibration parameters of a gaze line are determined, to the calibration target, in a first coordinate system. The above steps are repeated, thereby providing a desired part of a gaze range and calibration targets distribution. The calibration data is then stored. A method of calibrating and using an eye tracker and a method of calibrating an eye tracker for use with a display are also provided.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: This disclosure relates to systems and/or methods for detection of eye blinking using an active contact lens with multiple sensors and detecting orientation of the active contact lens.

Abstract: A method of tracking an eye of a user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. Shifts in a position of a wearable heads-up display (WHUD) worn on the head of the user are detected during at least a portion of the eye tracking period. Glints are identified from the detected reflections of the infrared light. A drift in a glint center position of an identified glint relative to a glint space is determined based on a detected shift in position of the WHUD corresponding in space to the identified glint. The glint center position is adjusted to compensate for the drift. The adjusted glint center position is transformed from the glint space to a gaze position in a display space in a field of view of the eye.

Abstract: In one aspect, a device includes a body, an arm, a camera, a support arm, an indicator support, and a plurality of indicators. The body is configured to mount to an eyeglass arm. The arm extends from the body. The camera is coupled to the arm and configured to capture images of at least one eye of a user. The support arm extends from the body. The indicator support is coupled to the support arm such that, when the body is mounted to the eyeglasses and the user is wearing the eyeglasses, the indicator support is positioned in the user's field of view. The plurality of indicators are coupled to the indicator support.

Abstract: A method is provided for estimating the orientation of a user's eyes in a scene in a system-agnostic manner. The method approximates pose-invariant, user-independent feature vectors by transforming the input coordinate to a pose-invariant coordinate and then normalizing the data considering the statistical distributions of previously collected data used to create a learned mapping method. It then uses the learned mapping method to estimate the orientation of the user's eyes in the pose invariant coordinate system, and finalizes by transforming these to a world coordinate system.

Abstract: A method for non-invasive video oculographic measurement of eye movements as diagnostic support for (early) detection of neuropsychiatric diseases, using an indicator for a visual stimulus and a camera for video recording. A position of the camera is kept constant in relation to the display and a face of a test person is continuously recorded, at least in parts. A recognition algorithm is started which creates an eye template in which an absolute position of the eye and a pupil of the eye are continuously recorded in the image. Furthermore, a reference range, especially around the eye, is defined and, after selecting a predefined measurement paradigm of the pupil are continuously recorded and analyzed at the end of the stimulus.

Abstract: A method and apparatus for monitoring learning and an electronic device are provided. The method for monitoring learning includes: acquiring a class image of a class student; recognizing the class image to acquire characteristic data of the class student, where the characteristic data includes at least one of the following: facial characteristic data of the class student, visual characteristic data of the class student, and body characteristic data of the class student; and determining, based on the characteristic data of the class student, a class status of the class student. The listening status of a student learning via a computer and the Internet in a class can be effectively and accurately monitored, and an effective reference is provided for subsequent learning and teaching to further improve the learning or teaching process.

Abstract: A drowsy driving management device includes: a processor configured to determine whether slow eye movement of a user occurs and whether there is no change in steering torque and to determine that the user drives while drowsy when the slow eye movement of the user occurs and when there is no change in the steering torque for a predetermined period of time; and a storage that stores information indicating whether the slow eye movement occurs and a result of determining whether there is no change in the steering torque.

Abstract: Methods and systems are provided for tracking viewer engagement with a non-interactive display. Sensor data is obtained from one or more sensors, such as cameras, associated with a display device, and once a face is detected within the sensor data, a display sequence is initiated. The display sequence includes at least a first frame with a first visual feature and a second frame with a second visual feature. Using the sensor data obtained during presentation of the display sequence, viewer engagement with the sequence is tracked by determining eye movements and/or head movements. The detected eye movement and/or head movement is used to determine whether the person was actively engaged with the display sequence.

Abstract: A method for optically inspecting a mold (10) for manufacturing ophthalmic lenses such as contact lenses for possible mold defects, including: generating a set of images of the mold (10) for different azimuthal illumination angles (?1, ?9) using an illumination system (20) and an imaging system (30), the latter being aligned such that its focal plane cuts through the mold (10) at a specific axial position along a center axis of the mold (10); generating a focal plane image by averaging pixelwise over the set of images after having masked out in each image those regions that include direct specular reflections from the mold (10); repeating the previous steps for one or a plurality of different axial positions of the focal plane such as to generate a plurality of different focal plane images; identifying one or more image features in the plurality of focal plane images indicative for a possible mold defect; determining for each identified image feature in which focal plane image the identified image feature app

Abstract: A system and method for using gaze information to extract visual attention information combined with computer derived local saliency information from medical images to (1) infer object and background cues from a region of interest indicated by the eye-tracking and (2) perform a medical image segmentation process. Moreover, an embodiment is configured to notify a medical professional of overlooked regions on medical images and/or train the medical professional to review regions that he/she often overlooks.

Abstract: A gaze tracking system, method, and computer product for tracking an eye gaze on a screen of a device including a single monocular camera, the system including measuring a rotation of a hinged plane of a display screen with respect to the eye gaze, combining the rotation with a three-dimensional movement of the camera, a position of the camera being constant with respect to the display screen, and estimating a point of gaze localization on the display screen using the single monocular camera as the input, in absence of a sensor, and without performing a display screen calibration.

Abstract: A method for active eye-tracking comprises pulsing on and off a plurality of infrared optical sources configured to emit infrared light with a narrow spectral linewidth toward an eye of a user, such that a pulse-on duration is less than a duration needed to fully thermalize each optical source. One or more shuttered optical sensors are configured to receive infrared light reflected off the eye of the user. The shuttered optical sensors are opened for a detection duration based on the pulse-on duration, the shuttered optical sensors. A conformation of the user's eye is indicated based on infrared light received at the shuttered optical sensor during the detection duration.

Abstract: At least one image registering unit records at least one series of images representing a subject. A control unit controls an operation sequence for the at least one image registering unit in such a manner that a subsequent data processing unit receives a repeating sequence of image frames there from, wherein each period contains at least one image frame of a first resolution and at least one image frame of a second resolution being different from the first resolution. Based on the registered image frames, the data processing unit produces eye/gaze tracking data with respect to the subject.

Abstract: The invention provides the supporting system for neurological state assessment and neurological rehabilitation, especially within cognitive and/or speech dysfunction, characterized in that, the processing unit (PU) is integrated with the screen (S), which is equipped with the touch input sensors (TIS), said camera and light sources work within infrared radiation, wherein the infrared camera (IFC) is integrated with at least two infrared light sources (ILS). The infrared light sources (ILS) and the infrared camera (IFC) are formed into a movable component (MC) in the way that the infrared light sources (ILS) are located symmetrically and uniaxially on both sides of the infrared camera (IFC) in the movable component (MC). The movable component (MC) is connected with the processing unit (PU) through the screen (S). In another aspect the invention provides the method for supporting of neurological state assessment and neurological rehabilitation, especially within cognitive and/or speech dysfunctions.

Abstract: A method of creating an optimized lens for an eye including positioning a fitting lens onto the eye. The fitting lens may have one or a plurality of indicia. The eye and fitting lens using a computing device. A data set may then be produced, the data set defined by a three-dimensional relationship between the fitting lens and the eye. The computing device or a remotely connected computing device may then analyze the data set to generate one or more modifications to the fitting lens. The computing device or remotely connected computing device may then transmit the data set and the one or more modifications to a printing device to create the optimized lens for the eye.