Abstract: A visual function detection apparatus includes: a display controller that causes an image for determination to be displayed on a display screen of a display unit; a gazing point detector that detects a position of a gazing point of the test subject observing the display screen; a positional relation detector that detects a positional relation between a position of the image for determination on the display screen and the position of the gazing point; and a visual function detector that detects a visual function of the test subject based on the positional relation.

Abstract: Disclosed is a method of identifying dementia by at least one processor of a device. The method includes performing a first task that causes a first object to be displayed on a first region of a screen displayed on a user terminal; and when a preset condition is satisfied, performing a second task that causes at least one object, which induces the user's gaze, to be displayed instead of the first object on the screen of the user terminal.

Abstract: A head-mounted device may have a head-mounted housing. The head-mounted housing may have displays that overlap a user's eyes and/or speakers that provide sound to the user's ears. The head-mounted housing may have transparent lenses that overlap the eyes of the user or may have opaque structures that prevent ambient light from reaching the user's eyes. The head-mounted device may have a geographic location sensor such as a satellite navigation system sensor and may include an orientation sensor such as an inertial measurement unit. The direction of a user's gaze relative to the head mounted device may be measured using an electrooculographic sensor. Electrodes in the electrooculographic sensor may measure signals resulting from the standing potential between the retina and cornea in the eye. Facial expressions and eye blinks may affect the signals detected with the electrodes and can be monitored during operation.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: The present disclosure is directed to the first methods and systems for diagnosing a patient being affected by a brain injury from a blast with greater accuracy that previous methods. The methods and system include an automated, non-invasive method for assessing the variance of a patient's ocular motility relative to a matched cohort of unaffected subjects, and using the variance in one or more ocular motility metrics to calculate a score that indicates a likelihood that the patient suffers from a blast brain injury. The score, referred to as a BIS, discriminates between affected an unaffected subjects with a sensitivity of greater than about 85%, a specificity of greater than 75%. The ROCAUC of the BIS is greater than 0.85.

Abstract: Systems and methods are provided for a compact eye-tracking camera assembly. The camera incorporates a lens and image sensor whose principal axis is parallel to the plane of the display surface, and a compound angle mirror configured to redirect incident IR light along the principal axis. The compound angle mirror has a first angle of approximately 45 degrees relative to a first axis, and a second angle of approximately 15-22 degrees (e.g., 18 degrees) relative to a second axis that is orthogonal to the first axis. The first and second axes are substantially parallel to the plane of the display surface.

Abstract: A method for processing a gaze signal in an eye tracking system is provided. The method comprises receiving a first image of a user's eye captured at a first point in time and a second image of the users eye captured at a second point in time subsequent to the first point in time, and determining, based on the first image and the second image, whether eye movement of the user's eye is in fixation or not. The method may further comprise to, on condition that the eye movement of the users eye is in fixation, applying a filter on the gaze signal, wherein the filter is adapted to decrease variance in the gaze signal.

Abstract: Impairment analysis systems and related methods are disclosed. According to an aspect, an impairment analysis system includes a light source configured for directing light towards a subject. Further, the system includes a distance sensor configured for determining a location of the subject. The system also includes an image capture device configured for capturing one or more images of the subject. Further, the system includes a computing device configured to control the light source to emit light in a predetermined pattern to apply light stimulus to the subject. The computing device is also configured to receive, from the distance sensor, information regarding the determined location of the subject. Further, the computing device is configured to receive, from the image capture device, the captured one or more images of the subject including one of a facial movement and position of the subject while the light stimulus is applied to the subject.

Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

Abstract: System and method for enabling user communication with eye-based feedback. A selection interface selectively presents a series of communication options to the user. A sensor detects light reflected from the eye of the user and provides a correlative signal, which is processed to determine a relative eye orientation that includes the relative orientation of the pupil with respect to the head orientation of the user. The eye may be illuminated by a light source or ambient lighting. The sensor may detect infrared light reflected from the eye illuminated by an infrared light source. The relative eye orientation may be determined by processing images captured by an image sensor. The relative eye orientation may be determined by detecting an instantaneous relative orientation of the pupil or by detecting a transient change of the pupil. Based on the determined relative eye orientation, a selected communication option is determined and implemented.

Abstract: An objective testing of vergence dysfunction comprising the steps of: providing a head mounted goggle based stimulus generating eye tracking unit to the subject; presenting visual stimulus to the subject, wherein the visual stimulus is in the head mounted goggle based system and forms the optical target stimulus for at least one vergence test; obtaining objective physiologic response of the subject from the head mounted goggle unit based upon each of the visual stimulus presented to the subject in each test; and using the objective physiologic responses to diagnose the presence of vergence dysfunction. On objective portable head mounted goggle based stimulus generating eye tracking unit for vergence testing is discloses as is a method of method of vergence recovery convalescence.

Abstract: An electronic system including a display device, an image sensor, a face detection engine, an eye detection engine and an eye protection engine is provided. The image sensor captures an image. The face detection engine recognizes a user face in the image. The eye detection engine recognizes user eyes in the image. The eye protection engine turns off the display device when the user eyes are recognized in the image but the user face is not recognized in the image.

Abstract: According to the techniques of this disclosure, a method includes capturing, using a camera system of a vehicle, at least one image of an occupant of the vehicle, determining, based on the at least one image of the occupant, a location of one or more eyes of the occupant within the vehicle, and determining, based on the at least one image of the occupant, an eye gaze vector. The method may also include determining, based on the eye gaze vector, the location of the one or more eyes of the occupant, and a vehicle data file of the vehicle, a region of interest from a plurality of regions of interests of the vehicle at which the occupant is looking, wherein the vehicle data file specifies respective locations of each of the plurality of regions of interest, and selectively performing, based on the region of interest, an action.

Abstract: The disclosure relates to a method and a respective computer program with a program code to execute the method. In particular, disclosed is a method for training a preferred retinal locus of fixation (efficient PRL) for a person having an eye with a field of vision comprising an area of partially diminished or entirely degenerated visual acuity. The method includes: a) determining an inefficient retinal region outside the area in the field of vision of the eye of the person and a more efficient retinal region for the specific vision task outside the area in the field of vision of the eye of the person and b) inducing a preferred retinal locus of fixation (efficient PRL) for a vision task outside the inefficient retinal region but in the more efficient retinal region. In addition, the disclosure relates to a device for performing the method.

Abstract: Aspects of the present disclosure describe systems, methods, and structures that provide eye-tracking by 1) steering a beam of light through the effect of a microelectromechanical system (MEMS) onto a surface of the eye and 2) detecting light reflected from features of the eye including corneal surface, pupil, iris—among others. Positional/geometric/feature/structural information pertaining to the eye is determined from timing information associated with the reflected light.

Abstract: There is provided an information processing apparatus to measure a distance in a real space with a simpler operation, the information processing apparatus including: an acquisition section that acquires an image captured by a predetermined imaging section, and position information based on at least any of a position and a direction of the imaging section; an estimation section that estimates a first position and a second position in a real space, on a basis of a first image and a second image which are the image captured at each of a first viewpoint and a second viewpoint, and first position information and second position information which are the position information about each of the first viewpoint and the second viewpoint; and a measurement section that measures a distance between the first position and the second position on a basis of the estimation result.

Abstract: This application discloses a method for training a gaze tracking model, including: obtaining a training sample set; processing the eye sample images in the training sample set by using an initial gaze tracking model to obtain a predicted gaze vector of each eye sample image; determining a model loss according to a cosine distance between the predicted gaze vector and the labeled gaze vector for each eye sample image; and iteratively adjusting one or more reference parameters of the initial gaze tracking model until the model loss meets a convergence condition, to obtain a target gaze tracking model. According to the solution provided in this application, a gaze tracking procedure is simplified, a difference between a predicted value and a labeled value can be better represented by using the cosine distance as a model loss to train a model, to improve prediction accuracy of the gaze tracking model.

Abstract: An optical system for detecting and tracking the eye movements of an individual. The system includes a frame, intended to be worn on the face of the individual, that includes a plurality of illumination sources. The system includes at least one contact lens, intended to be worn by an eye of the individual facing the frame, in which are encapsulated: an autonomous integrated circuit, a plurality of photoreceptors and a wireless communication transmitter. Variation in a signal (e.g., voltage or current) delivered by the photoreceptors allows not only the closure of the eyelid but also eye movements to be detected.

Abstract: An apparatus (100) for deriving a gaze direction of a human eye (150) includes a light-guide optical element (LOE) (120) having pair of parallel faces (104a), (104b) deployed in facing relation to the eye (150). A coupling-in configuration, such as a set of partially-reflective surfaces (145), is associated with LOE (120) and configured for coupling-in a proportion of light incident on face (104a) so as to propagate within the LOE. Focusing optics (106) associated with LOE (120) converts sets of parallel light rays propagating within the LOE into converging beams of captured light which are sensed by an optical sensor (125). A processing system (108) processes signals from the optical sensor (125) to derive a current gaze direction of the eye. Despite the aperture-combining effect of the LOE, retinal images can be effectively recovered as the only image information brought to focus on the optical sensor.

Abstract: A head-mounted viewable device which includes a display configured to display and project a virtual scene image to a user's eye, a VR optical lens configured to construct an optical path between the display and the user's eye for allowing a virtual scene image being observed by the user's eye, and, an eye-tracking system configured to detect a sight direction of the user's eye and adjust a display position of the virtual scene image based on the detected sight direction. The eye-tracking system includes at least one light source configured to project the detection light and a receiving module configured to receive the reflected detection light reflected to determine the sight direction of the user's eye. The receiving module is positioned at a side of the VR optical lens and arranged to face towards the user's eye such that the detection light reflected by the user's eye is directly received by the receiving module.

Abstract: A wearable electronic device is provided. The wearable electronic device includes a housing including a first housing portion, a second housing portion, and a third housing portion, glasses surrounded by the second housing portion, a display for displaying screens in an inner direction and an outer direction on display areas of the glasses, a sensor module including a first sensor for identifying whether a user is wearing the wearable electronic device, a second sensor for determining a direction where the wearable electronic device is placed, and a third sensor for determining whether the first housing portion or the third housing portion is folded, a camera module including first cameras for tracking a hand gesture of the user and recognizing a space, second cameras for tracking pupils of the user, and a third camera for capturing the outside, and a processor connected with the display, the sensor module, and the camera module.

Abstract: A portable terminal includes a display control unit, an extraction unit, and a compositing unit. The display control unit displays a specifying frame for specifying a specified region which is a partial region in a display image displayed on a touch panel display, and a color designation mark for designating a reference color from colors included in an image of the specified region in the specifying frame, in superposition with the display image. The extraction unit extracts an image corresponding to the reference color designated by the color designation mark from the image of the specified region in the specifying frame, as a compositing target image. The compositing unit generates a composite image in which the compositing target image is composited in a selection image selected by a user.

Abstract: Aspects of the present invention relate to providing see-through computer display optics with improved content presentation. The see-through computer display includes an ambient light sensor adapted to measure environmental scene light in an area that forms the background for digital content presented in the see-through computer display, and a processor adapted to invert a color channel parameter of the digital content based on data from the ambient light sensor.

Abstract: An eye-tracking device includes an optical device that includes a light source with an optical cavity and a light sensor. The light source is positioned to output coherent light toward an eye of a user and receive at least a portion of the coherent light back from the eye of the user as feedback light. The feedback light enters the optical cavity and causes modulation of an intensity of the coherent light. The light sensor is optically coupled with the light source for detecting the modulated intensity of the coherent light and generating one or more signals based on the detected intensity of the coherent light. The eye-tracking device also includes one or more processors that are coupled to the optical device for determining, from the one or more signals, movement information of the eye. A method of detecting movement of an eye using the eye-tracking device is also disclosed.

Abstract: Methods and systems for processing user input to a computing system are disclosed. The computing system has access to an audio input and a visual input such as a camera. Face detection is performed on an image from the visual input, and if a face is detected this triggers the recording of audio and making the audio available to a speech processing function. Further verification steps can be combined with the face detection step for a multi-factor verification of user intent to interact with the system.

Abstract: The present invention relates to a measurement method in which, by predetermined illumination by means of a display device, in particular a holographic or autostereoscopic display device, with an intensity distribution of the illumination light in a plane of a light source image, a first location of an object, in particular an observer of the display device, is marked, and wherein the relative position of the first location in relation to a second location of the object is determined in a coordinate system of a camera.

Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Abstract: At a first time point, a first light capturing device at a first spatial location in a three-dimensional (3D) space captures first light rays from light sources located at designated spatial locations on a viewer device in the 3D space. At the first time point, a second light capturing device at a second spatial location in the 3D space captures second light rays from the light sources located at the designated spatial locations on the viewer device in the 3D space. Based on the first light rays captured by the first light capturing device and the second light rays captured by the second light capturing device, at least one of a spatial position and a spatial direction, at the first time point, of the viewer device is determined.

Abstract: A visual tracking system, comprises an eye-tracking device and a cognitive load detection device disposed in electrical communication with the eye-tracking device, the cognitive load detection device comprising a controller having a memory and a processor. The controller is configured to receive eye-movement data from the eye-tracking device, the eye-movement data comprising pupil dilation event data and at least one of saccade event data and fixation event data, apply a classification function to the eye-movement data to detect a cognitive load associated with the eye-movement data and corresponding to a visual location of a field of view of the user, and output a notification regarding the cognitive load associated with the eye-movement data.

Abstract: A method to self-test vision of a user for use with a handheld vision tester includes receiving image data of the user's face, determining dimensions of the user's face based on the received image data, computing a user viewing distance based on the determined dimensions, displaying a vision test based on the computed user viewing distance, receiving user input responses to the vision test, and outputting results of the vision test from the user input responses.

Abstract: In some aspects, a user device may receive, from a vision sensor of a user device, first image data associated with a first set of images. The user device may determine, using an image processing model, that a set of images depict a particular type of eye activity of an eye of a user. The user device may cause, based at least in part on determining that the first set of images depict the particular type of eye activity, a power level of a camera of the user device to be reduced.

Abstract: A device is provided that may include an illuminator operable to interrogate at least a lens of an eye. The illuminator may include at least one light source and a lens positioned with respect to the light source to produce interrogating radiation. The device also may include a detector operable to image the total autofluorescence response of the lens of the eye as viewable through a pupil of the eye, the detector comprising an image sensor. The device can also include a controller operable to control operation of the illuminator and the detector. The controller may interrogate at least the lens of the eye by activating the illuminator for a select time, obtain at least one image of the total autofluorescence response of the lens at the detector during or immediately subsequent to the select time, and transmit the at least one image to a remote device.

Abstract: Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.

Abstract: A method, a structure, and a computer system for cardiorespiratory monitoring via rapid eye movement. The method comprises detecting eye movement of a user while asleep and determining whether the user is subject to a cardiorespiratory condition based on comparing the detected eye movement to a model.

Abstract: An electronic system including a display device, an image sensor, a face detection engine, an eye detection engine and an eye protection engine is provided. The image sensor captures an image. The face detection engine recognizes a user face in the image. The eye detection engine recognizes user eyes in the image. The eye protection engine turns off the display device when the user eyes are recognized in the image but the user face is not recognized in the image.

Abstract: An apparatus having a computing device and a user interface—such as a user interface having a display that can provide a graphical user interface (GUI). The apparatus also includes a camera, and a processor in the computing device. The camera can be connected to the computing device and/or the user interface, and the camera can be configured to capture pupil location and/or eye movement of a user. The processor can be configured to: identify a visual focal point of the user relative to the user interface based on the captured pupil location, and/or identify a type of eye movement of the user (such as a saccade) based on the captured eye movement. The processor can also be configured to control parameters of the user interface based at least partially on the identified visual focal point and/or the identified type of eye movement.

Abstract: A press and hold function for conducting online surveys with a respondent in order to obtain genuine responses to the online surveys is presented herein. A user interface associated with an online survey is presented to the respondent on a screen of a computing device. The online survey can include a set of questions. Each question of the online survey can include a set of response elements. Each of these response elements can be associated with one or more response duration. In order to select a response to a question, the respondent can press a response button that is associated with one or more response elements to that question. The respondent then holds the response button for the response duration associated with the response element. After the response duration is complete, the response associated with the response element is deemed to be the response of the respondent.

Abstract: Provided are a Fourier-beam shaper and a display apparatus including the Fourier-beam shaper. The Fourier-beam shaper includes: a waveguide; an input coupler configured to direct a plurality of light beams toward the waveguide in a time-sequential manner; and a spatial converter configured to output the plurality of light beams traveling in the waveguide through spatially different regions of the spatial converter.

Abstract: According to the techniques of this disclosure, a method includes capturing, using a camera system of a vehicle, at least one image of an occupant of the vehicle, determining, based on the at least one image of the occupant, a location of one or more eyes of the occupant within the vehicle, and determining, based on the at least one image of the occupant, an eye gaze vector. The method may also include determining, based on the eye gaze vector, the location of the one or more eyes of the occupant, and a vehicle data file of the vehicle, a region of interest from a plurality of regions of interests of the vehicle at which the occupant is looking, wherein the vehicle data file specifies respective locations of each of the plurality of regions of interest, and selectively performing, based on the region of interest, an action.

Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.

Abstract: Disclosed are a method and device for adjusting a pupil distance of a virtual reality display device. The method adjusts a second pupil distance on a virtual reality display device by means of a first pupil distance of a user wearing the virtual reality display device, the first pupil distance referring to a pupil distance of the user wearing the virtual reality display device, and the second pupil distance being used as a distance between focal points of two lenses of the virtual reality display device; the method comprises: detecting whether the first pupil distance and the second pupil distance match; if the first pupil distance and the second pupil distance do not match, then executing a preset matching operation on the virtual reality display device. The present application solves the technical problem of a virtual reality display device being bulky and heavy.

Abstract: Examples relate to an optical system and to a corresponding apparatus, method and computer program. The optical system comprises a display module for providing a visual overlay to be overlaid over an object in an augmented reality or mixed reality environment. The optical system comprises at least one sensor for sensing at least one optical property of the object. The optical system comprises a processing module configured to determine the at least one optical property of the object using the at least one sensor. The processing module is configured to determine a visual contrast between the visual overlay to be overlaid over the object and the object, as perceived within a field of view of the augmented reality or mixed reality environment, based on the at least one optical property of the object.

Abstract: System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: The present disclosure provides for medical device administration and interaction by identifying a medical event affecting a first individual, a medical device associated with treating the medical event, and an initial attentiveness level of an administering individual; outputting a tutorial for how to use the medical device to treat the medical event with a first control level, wherein the first control level based on the initial attentiveness level of the administering individual; and in response to receiving a triggering event while outputting the tutorial: determining a current attentiveness level for the administering individual; and in response to the current attentiveness level indicating a change from the initial attentiveness level, adjusting the tutorial based on a second control level, different than the first control level, based on the change from the initial attentiveness level.

Abstract: An apparatus to illuminate a target includes a lens having a lens side to be positioned in opposing relation to the target. The apparatus includes a lightguide that circumscribes at least a portion of the periphery of the lens. The lightguide has an input end to receive light and a length along which the receive light propagates. The apparatus includes outcoupling elements that are spaced out along the length of the lightguide. The outcoupling elements couple light out of the lightguide at respective positions along the length of the lightguide. The outcoupling elements are oriented to direct the outcoupled light towards the target when the lens side is positioned in opposing relation to the target. An eye tracking apparatus including the illumination apparatus and a method of eye tracking are disclosed.

Abstract: Provided is a portable, hand-held, self-powered, self-calibrated, easy-to-use “iCOBRA” system, a neural/neurological assessment tool for both operational decision-making in military, aerospace, sports, and other high-performance settings, and to assist in diagnostics in medical practice. The system harnesses multimodal 3D imaging technologies for robust, calibration free, head and eye tracking to allow for visual, vestibular, and oculomotor assessment of human neural health and performance.

Abstract: The disclosed transparent circuit board may include a transparent substrate, a first conductive trace coupled to the transparent substrate, and an electrical component having a bottom surface facing the transparent substrate and a top surface facing away from the transparent substrate. The bottom surface may include a first electrical contact coupled to the first conductive trace, and the top surface may include a second electrical contact. The transparent circuit board may also include a second conductive trace electrically connected to the second electrical contact and a transparent encapsulation layer coupled to the transparent substrate and encapsulating the electrical component. Various other ophthalmic devices, systems, and methods are also disclosed.

Abstract: A method for training an eye tracking model is disclosed, as well as a corresponding system and storage medium. The eye tracking model is adapted to predict eye tracking data based on sensor data from a first eye tracking sensor. The method comprises receiving sensor data obtained by the first eye tracking sensor at a time instance and receiving reference eye tracking data for the time instance generated by an eye tracking system comprising a second eye tracking sensor. The reference eye tracking data is generated by the eye tracking system based on sensor data obtained by the second eye tracking sensor at the time instance. The method comprises training the eye tracking model based on the sensor data obtained by the first eye tracking sensor at the time instance and the generated reference eye tracking data.

Abstract: An eye is illuminated with infrared illumination light. Illuminating the eye includes illuminating a near-eye ellipsoidal lensing structure. A tracking image of Purkinje reflections of the infrared illumination light is captured by a camera. An eye position of the eye is determined in response to the tracking image.