Abstract: A non-invasive control system for neuromuscular stimulation includes an eye-tracking device, an electrical stimulation device, and software that interprets the eye movements of the user to determine an intended movement and sends electrical signal(s) to the stimulation device to achieve the intended movement. For example, the stimulation device may be a sleeve with electrodes worn on a paralyzed limb, with the intended movement being the movement of the limb.

Abstract: An apparatus for obtaining facial information obtains facial information indicating the state of the face of a driver of a vehicle from each of face images of the driver's face, causes a display mounted on the vehicle to show a screen including an input section for receiving input of information from the driver, and obtains correction information for correcting the facial information from a face image, of the face images, generated while the screen is displayed on the display.

Abstract: Ophthalmic imaging devices and related methods employ self-alignment of a user with an optical axis of the imaging device. An ophthalmic imaging device includes a retinal imaging assembly, a housing assembly, and a viewer assembly. The retinal imaging assembly has an optical axis. The retinal imaging assembly is attached to the housing. The housing assembly is configured to rest on a horizontal surface during operation of the retinal imaging assembly. The optical axis is oriented at an angle from the horizontal surface when the housing assembly rests on the horizontal surface. The viewer assembly is coupled with the housing assembly. The viewer assembly includes an interface surface shaped for engagement with each head of a plurality of different user's and to accommodate repositioning of the head to align a pupil of the user with the optical axis.

Abstract: The vehicle control system/method for adapting a control function based on a user profile may comprise: a gesture recognition module; a user profile module; a function control module; a processor; a non-transitory storage element coupled to the processor; encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the system to: identify a user; retrieve a user profile for the identified user; receive at a gesture recognition module, an input indicating a gesture from the user; identify a control function request corresponding to the gesture input; send a verification of the control function request; and receive at a function control module characteristics parsed from the user profile that effect the control function request by the user profile module to adapt a control function command for an adapted control function output by the function control module.

Abstract: A gaze detection apparatus includes at least one memory and at least one processor which function as: a gaze detection unit configured to detect, based on an eye image in which an eye of a user is imaged, a gaze position which is a position at which the user looks; an orientation detection unit configured to detect a head orientation which is an orientation of a head of the user, based on the eye image; a calibration unit configured to acquire a first correction value for reducing a detection error of the gaze position by a predetermined calibration operation; and a correction unit configured to correct the first correction value, based on gaze information related to a current gaze position, a head orientation during the predetermined calibration operation, and a current head orientation.

Abstract: Disclosed herein is a method of provisioning a virtual experience based on user preference. The method may include receiving an identity data associated with an identity of a user, retrieving a user profile data based on the identity data, analyzing the user profile data using a machine learning model, determining at least one preference data based on the analyzing, generating an interactive 3D model data, transmitting the interactive 3D model data to a user device configured to present the interactive 3D model data, receiving a reaction data from the user device. Further, the user device may include at least one sensor configured to generate the reaction data based on a behavioral reaction of a user consuming the interactive 3D model data.

Abstract: Disclosed herein are systems, methods and devices for predicting whether a user has a target health condition using eye images. Automated guidance is provided to the user to obtain, using a computing device operated by the user, images including the user's sclera, each of the images corresponding to a guided direction of the user's gaze. Images are received from the computing device by way of a network. Images are subject to verification that sufficiently show the user's sclera, including by estimating a direction of the user's gaze and confirming that the estimated direction for a given one of the images conforms with the guided direction. Feature-enhanced image data are generated by applying an autoencoder to enhance features corresponding to the user's sclera in the images. A prediction of whether the user has the target health condition is generated by providing the feature-enhanced image data to a convolutional neural network.

Abstract: A method is provided that includes discriminating an autofluorescence (AF) response of a lens tissue of an eye due to a current level of 2-(2-furoyl)-4(5)-furanyl-1H-imidazole (FFI) in the lens tissue by interrogating a lens tissue of an eye along a visual axis of the eye by activating an illuminator for a select time to produce interrogating irradiation having a peak wavelength of 425 nm to 460 nm, the illuminator comprising at least one light source and a focal lens positioned with respect to the light source. The method also includes obtaining at least one image of the autofluorescence response of the lens tissue from a detector, the detector including a digital camera unit, analyzing the at least one image to determine a total autofluorescence index of the lens tissue, and determining a current level of FFI in the lens tissue based, at least in part, on the total autofluorescence index.

Abstract: Embodiments are directed generally to an ionizing-radiation beamline monitoring system that includes a vacuum chamber structure with vacuum compatible flanges through which an incident ionizing-radiation beam enters the monitoring system. Embodiments further include at least one scintillator within the vacuum chamber structure that can be at least partially translated in the ionizing-radiation beam while oriented at an angle greater than 10 degrees to a normal of the incident ionizing-radiation beam, a machine vision camera coupled to a light-tight structure at atmospheric/ambient pressure that is attached to the vacuum chamber structure by a flange attached to a vacuum-tight viewport window with the camera and lens optical axis oriented at an angle of less than 80 degrees with respect to a normal of the scintillator, and at least one ultraviolet (“UV”) illumination source facing the scintillator in the ionizing-radiation beam for monitoring a scintillator stability comprising scintillator radiation damage.

Abstract: This disclosure relates to analyzing effect of a secondary cognitive load task on a primary executive task. Human random sequence generation is a marker to study cognitive functions and inability to generate random sequences (RS) can reveal underlying impairments. Traditionally, ‘call out’ or ‘write down’ procedures are used to obtain human generated numbers, wherein short term memory and number of previously generated entities visible to a subject plays a major role. Also precise trial-wise or response-wise analysis may not be possible. In the present disclosure, the human generated random numbers are digitized into RS and a cognitive load (CL) inducing task is imposed on the executive task. The CL demanding task disrupts randomization performance. Deviation from randomness, load index based on gaze data and deviation from pupillometry data of healthy subjects are provided as indicators of an interference effect imposed by the CL and thereby indicative of underlying impairments.

Abstract: A method for determining an eye position using a laser device for a set of smart glasses. The method includes emitting light for scanning an eye along at least one scan line; detecting a plurality of reflection beams of the light reflected along the scan line in order to obtain a plurality of light intensity values, the light intensity values representing intensities of the reflection beams; generating a two-dimensional image of the eye along the scan line using the light intensity values, a high light intensity value being assigned or being assignable to a reflection beam reflected at the retina and a light intensity value low in comparison to the high intensity value being assigned or being assignable to a reflection beam reflected outside the retina of the eye; and determining the eye position of the eye within the image using amplitudes of the light intensity values.

Abstract: A visual function detection apparatus includes: a display controller that causes an image for determination to be displayed on a display screen of a display unit; a gazing point detector that detects a position of a gazing point of the test subject observing the display screen; a positional relation detector that detects a positional relation between a position of the image for determination on the display screen and the position of the gazing point; and a visual function detector that detects a visual function of the test subject based on the positional relation.

Abstract: Disclosed is a method of identifying dementia by at least one processor of a device. The method includes performing a first task that causes a first object to be displayed on a first region of a screen displayed on a user terminal; and when a preset condition is satisfied, performing a second task that causes at least one object, which induces the user's gaze, to be displayed instead of the first object on the screen of the user terminal.

Abstract: A head-mounted device may have a head-mounted housing. The head-mounted housing may have displays that overlap a user's eyes and/or speakers that provide sound to the user's ears. The head-mounted housing may have transparent lenses that overlap the eyes of the user or may have opaque structures that prevent ambient light from reaching the user's eyes. The head-mounted device may have a geographic location sensor such as a satellite navigation system sensor and may include an orientation sensor such as an inertial measurement unit. The direction of a user's gaze relative to the head mounted device may be measured using an electrooculographic sensor. Electrodes in the electrooculographic sensor may measure signals resulting from the standing potential between the retina and cornea in the eye. Facial expressions and eye blinks may affect the signals detected with the electrodes and can be monitored during operation.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: The present disclosure is directed to the first methods and systems for diagnosing a patient being affected by a brain injury from a blast with greater accuracy that previous methods. The methods and system include an automated, non-invasive method for assessing the variance of a patient's ocular motility relative to a matched cohort of unaffected subjects, and using the variance in one or more ocular motility metrics to calculate a score that indicates a likelihood that the patient suffers from a blast brain injury. The score, referred to as a BIS, discriminates between affected an unaffected subjects with a sensitivity of greater than about 85%, a specificity of greater than 75%. The ROCAUC of the BIS is greater than 0.85.

Abstract: Systems and methods are provided for a compact eye-tracking camera assembly. The camera incorporates a lens and image sensor whose principal axis is parallel to the plane of the display surface, and a compound angle mirror configured to redirect incident IR light along the principal axis. The compound angle mirror has a first angle of approximately 45 degrees relative to a first axis, and a second angle of approximately 15-22 degrees (e.g., 18 degrees) relative to a second axis that is orthogonal to the first axis. The first and second axes are substantially parallel to the plane of the display surface.

Abstract: A method for processing a gaze signal in an eye tracking system is provided. The method comprises receiving a first image of a user's eye captured at a first point in time and a second image of the users eye captured at a second point in time subsequent to the first point in time, and determining, based on the first image and the second image, whether eye movement of the user's eye is in fixation or not. The method may further comprise to, on condition that the eye movement of the users eye is in fixation, applying a filter on the gaze signal, wherein the filter is adapted to decrease variance in the gaze signal.

Abstract: Impairment analysis systems and related methods are disclosed. According to an aspect, an impairment analysis system includes a light source configured for directing light towards a subject. Further, the system includes a distance sensor configured for determining a location of the subject. The system also includes an image capture device configured for capturing one or more images of the subject. Further, the system includes a computing device configured to control the light source to emit light in a predetermined pattern to apply light stimulus to the subject. The computing device is also configured to receive, from the distance sensor, information regarding the determined location of the subject. Further, the computing device is configured to receive, from the image capture device, the captured one or more images of the subject including one of a facial movement and position of the subject while the light stimulus is applied to the subject.

Abstract: Examples of a light field metrology system for use with a display are disclosed. The light field metrology may capture images of a projected light field, and determine focus depths (or lateral focus positions) for various regions of the light field using the captured images. The determined focus depths (or lateral positions) may then be compared with intended focus depths (or lateral positions), to quantify the imperfections of the display. Based on the measured imperfections, an appropriate error correction may be performed on the light field to correct for the measured imperfections. The display can be an optical display element in a head mounted display, for example, an optical display element capable of generating multiple depth planes or a light field display.

Abstract: System and method for enabling user communication with eye-based feedback. A selection interface selectively presents a series of communication options to the user. A sensor detects light reflected from the eye of the user and provides a correlative signal, which is processed to determine a relative eye orientation that includes the relative orientation of the pupil with respect to the head orientation of the user. The eye may be illuminated by a light source or ambient lighting. The sensor may detect infrared light reflected from the eye illuminated by an infrared light source. The relative eye orientation may be determined by processing images captured by an image sensor. The relative eye orientation may be determined by detecting an instantaneous relative orientation of the pupil or by detecting a transient change of the pupil. Based on the determined relative eye orientation, a selected communication option is determined and implemented.

Abstract: An objective testing of vergence dysfunction comprising the steps of: providing a head mounted goggle based stimulus generating eye tracking unit to the subject; presenting visual stimulus to the subject, wherein the visual stimulus is in the head mounted goggle based system and forms the optical target stimulus for at least one vergence test; obtaining objective physiologic response of the subject from the head mounted goggle unit based upon each of the visual stimulus presented to the subject in each test; and using the objective physiologic responses to diagnose the presence of vergence dysfunction. On objective portable head mounted goggle based stimulus generating eye tracking unit for vergence testing is discloses as is a method of method of vergence recovery convalescence.

Abstract: An electronic system including a display device, an image sensor, a face detection engine, an eye detection engine and an eye protection engine is provided. The image sensor captures an image. The face detection engine recognizes a user face in the image. The eye detection engine recognizes user eyes in the image. The eye protection engine turns off the display device when the user eyes are recognized in the image but the user face is not recognized in the image.

Abstract: According to the techniques of this disclosure, a method includes capturing, using a camera system of a vehicle, at least one image of an occupant of the vehicle, determining, based on the at least one image of the occupant, a location of one or more eyes of the occupant within the vehicle, and determining, based on the at least one image of the occupant, an eye gaze vector. The method may also include determining, based on the eye gaze vector, the location of the one or more eyes of the occupant, and a vehicle data file of the vehicle, a region of interest from a plurality of regions of interests of the vehicle at which the occupant is looking, wherein the vehicle data file specifies respective locations of each of the plurality of regions of interest, and selectively performing, based on the region of interest, an action.

Abstract: The disclosure relates to a method and a respective computer program with a program code to execute the method. In particular, disclosed is a method for training a preferred retinal locus of fixation (efficient PRL) for a person having an eye with a field of vision comprising an area of partially diminished or entirely degenerated visual acuity. The method includes: a) determining an inefficient retinal region outside the area in the field of vision of the eye of the person and a more efficient retinal region for the specific vision task outside the area in the field of vision of the eye of the person and b) inducing a preferred retinal locus of fixation (efficient PRL) for a vision task outside the inefficient retinal region but in the more efficient retinal region. In addition, the disclosure relates to a device for performing the method.

Abstract: Aspects of the present disclosure describe systems, methods, and structures that provide eye-tracking by 1) steering a beam of light through the effect of a microelectromechanical system (MEMS) onto a surface of the eye and 2) detecting light reflected from features of the eye including corneal surface, pupil, iris—among others. Positional/geometric/feature/structural information pertaining to the eye is determined from timing information associated with the reflected light.

Abstract: There is provided an information processing apparatus to measure a distance in a real space with a simpler operation, the information processing apparatus including: an acquisition section that acquires an image captured by a predetermined imaging section, and position information based on at least any of a position and a direction of the imaging section; an estimation section that estimates a first position and a second position in a real space, on a basis of a first image and a second image which are the image captured at each of a first viewpoint and a second viewpoint, and first position information and second position information which are the position information about each of the first viewpoint and the second viewpoint; and a measurement section that measures a distance between the first position and the second position on a basis of the estimation result.

Abstract: This application discloses a method for training a gaze tracking model, including: obtaining a training sample set; processing the eye sample images in the training sample set by using an initial gaze tracking model to obtain a predicted gaze vector of each eye sample image; determining a model loss according to a cosine distance between the predicted gaze vector and the labeled gaze vector for each eye sample image; and iteratively adjusting one or more reference parameters of the initial gaze tracking model until the model loss meets a convergence condition, to obtain a target gaze tracking model. According to the solution provided in this application, a gaze tracking procedure is simplified, a difference between a predicted value and a labeled value can be better represented by using the cosine distance as a model loss to train a model, to improve prediction accuracy of the gaze tracking model.

Abstract: An optical system for detecting and tracking the eye movements of an individual. The system includes a frame, intended to be worn on the face of the individual, that includes a plurality of illumination sources. The system includes at least one contact lens, intended to be worn by an eye of the individual facing the frame, in which are encapsulated: an autonomous integrated circuit, a plurality of photoreceptors and a wireless communication transmitter. Variation in a signal (e.g., voltage or current) delivered by the photoreceptors allows not only the closure of the eyelid but also eye movements to be detected.

Abstract: An apparatus (100) for deriving a gaze direction of a human eye (150) includes a light-guide optical element (LOE) (120) having pair of parallel faces (104a), (104b) deployed in facing relation to the eye (150). A coupling-in configuration, such as a set of partially-reflective surfaces (145), is associated with LOE (120) and configured for coupling-in a proportion of light incident on face (104a) so as to propagate within the LOE. Focusing optics (106) associated with LOE (120) converts sets of parallel light rays propagating within the LOE into converging beams of captured light which are sensed by an optical sensor (125). A processing system (108) processes signals from the optical sensor (125) to derive a current gaze direction of the eye. Despite the aperture-combining effect of the LOE, retinal images can be effectively recovered as the only image information brought to focus on the optical sensor.

Abstract: A head-mounted viewable device which includes a display configured to display and project a virtual scene image to a user's eye, a VR optical lens configured to construct an optical path between the display and the user's eye for allowing a virtual scene image being observed by the user's eye, and, an eye-tracking system configured to detect a sight direction of the user's eye and adjust a display position of the virtual scene image based on the detected sight direction. The eye-tracking system includes at least one light source configured to project the detection light and a receiving module configured to receive the reflected detection light reflected to determine the sight direction of the user's eye. The receiving module is positioned at a side of the VR optical lens and arranged to face towards the user's eye such that the detection light reflected by the user's eye is directly received by the receiving module.

Abstract: A wearable electronic device is provided. The wearable electronic device includes a housing including a first housing portion, a second housing portion, and a third housing portion, glasses surrounded by the second housing portion, a display for displaying screens in an inner direction and an outer direction on display areas of the glasses, a sensor module including a first sensor for identifying whether a user is wearing the wearable electronic device, a second sensor for determining a direction where the wearable electronic device is placed, and a third sensor for determining whether the first housing portion or the third housing portion is folded, a camera module including first cameras for tracking a hand gesture of the user and recognizing a space, second cameras for tracking pupils of the user, and a third camera for capturing the outside, and a processor connected with the display, the sensor module, and the camera module.

Abstract: A portable terminal includes a display control unit, an extraction unit, and a compositing unit. The display control unit displays a specifying frame for specifying a specified region which is a partial region in a display image displayed on a touch panel display, and a color designation mark for designating a reference color from colors included in an image of the specified region in the specifying frame, in superposition with the display image. The extraction unit extracts an image corresponding to the reference color designated by the color designation mark from the image of the specified region in the specifying frame, as a compositing target image. The compositing unit generates a composite image in which the compositing target image is composited in a selection image selected by a user.

Abstract: Aspects of the present invention relate to providing see-through computer display optics with improved content presentation. The see-through computer display includes an ambient light sensor adapted to measure environmental scene light in an area that forms the background for digital content presented in the see-through computer display, and a processor adapted to invert a color channel parameter of the digital content based on data from the ambient light sensor.

Abstract: An eye-tracking device includes an optical device that includes a light source with an optical cavity and a light sensor. The light source is positioned to output coherent light toward an eye of a user and receive at least a portion of the coherent light back from the eye of the user as feedback light. The feedback light enters the optical cavity and causes modulation of an intensity of the coherent light. The light sensor is optically coupled with the light source for detecting the modulated intensity of the coherent light and generating one or more signals based on the detected intensity of the coherent light. The eye-tracking device also includes one or more processors that are coupled to the optical device for determining, from the one or more signals, movement information of the eye. A method of detecting movement of an eye using the eye-tracking device is also disclosed.

Abstract: Methods and systems for processing user input to a computing system are disclosed. The computing system has access to an audio input and a visual input such as a camera. Face detection is performed on an image from the visual input, and if a face is detected this triggers the recording of audio and making the audio available to a speech processing function. Further verification steps can be combined with the face detection step for a multi-factor verification of user intent to interact with the system.

Abstract: The present invention relates to a measurement method in which, by predetermined illumination by means of a display device, in particular a holographic or autostereoscopic display device, with an intensity distribution of the illumination light in a plane of a light source image, a first location of an object, in particular an observer of the display device, is marked, and wherein the relative position of the first location in relation to a second location of the object is determined in a coordinate system of a camera.

Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Abstract: A visual tracking system, comprises an eye-tracking device and a cognitive load detection device disposed in electrical communication with the eye-tracking device, the cognitive load detection device comprising a controller having a memory and a processor. The controller is configured to receive eye-movement data from the eye-tracking device, the eye-movement data comprising pupil dilation event data and at least one of saccade event data and fixation event data, apply a classification function to the eye-movement data to detect a cognitive load associated with the eye-movement data and corresponding to a visual location of a field of view of the user, and output a notification regarding the cognitive load associated with the eye-movement data.

Abstract: At a first time point, a first light capturing device at a first spatial location in a three-dimensional (3D) space captures first light rays from light sources located at designated spatial locations on a viewer device in the 3D space. At the first time point, a second light capturing device at a second spatial location in the 3D space captures second light rays from the light sources located at the designated spatial locations on the viewer device in the 3D space. Based on the first light rays captured by the first light capturing device and the second light rays captured by the second light capturing device, at least one of a spatial position and a spatial direction, at the first time point, of the viewer device is determined.

Abstract: A method to self-test vision of a user for use with a handheld vision tester includes receiving image data of the user's face, determining dimensions of the user's face based on the received image data, computing a user viewing distance based on the determined dimensions, displaying a vision test based on the computed user viewing distance, receiving user input responses to the vision test, and outputting results of the vision test from the user input responses.

Abstract: In some aspects, a user device may receive, from a vision sensor of a user device, first image data associated with a first set of images. The user device may determine, using an image processing model, that a set of images depict a particular type of eye activity of an eye of a user. The user device may cause, based at least in part on determining that the first set of images depict the particular type of eye activity, a power level of a camera of the user device to be reduced.

Abstract: A device is provided that may include an illuminator operable to interrogate at least a lens of an eye. The illuminator may include at least one light source and a lens positioned with respect to the light source to produce interrogating radiation. The device also may include a detector operable to image the total autofluorescence response of the lens of the eye as viewable through a pupil of the eye, the detector comprising an image sensor. The device can also include a controller operable to control operation of the illuminator and the detector. The controller may interrogate at least the lens of the eye by activating the illuminator for a select time, obtain at least one image of the total autofluorescence response of the lens at the detector during or immediately subsequent to the select time, and transmit the at least one image to a remote device.

Abstract: Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.

Abstract: A method, a structure, and a computer system for cardiorespiratory monitoring via rapid eye movement. The method comprises detecting eye movement of a user while asleep and determining whether the user is subject to a cardiorespiratory condition based on comparing the detected eye movement to a model.

Abstract: An electronic system including a display device, an image sensor, a face detection engine, an eye detection engine and an eye protection engine is provided. The image sensor captures an image. The face detection engine recognizes a user face in the image. The eye detection engine recognizes user eyes in the image. The eye protection engine turns off the display device when the user eyes are recognized in the image but the user face is not recognized in the image.

Abstract: An apparatus having a computing device and a user interface—such as a user interface having a display that can provide a graphical user interface (GUI). The apparatus also includes a camera, and a processor in the computing device. The camera can be connected to the computing device and/or the user interface, and the camera can be configured to capture pupil location and/or eye movement of a user. The processor can be configured to: identify a visual focal point of the user relative to the user interface based on the captured pupil location, and/or identify a type of eye movement of the user (such as a saccade) based on the captured eye movement. The processor can also be configured to control parameters of the user interface based at least partially on the identified visual focal point and/or the identified type of eye movement.

Abstract: A press and hold function for conducting online surveys with a respondent in order to obtain genuine responses to the online surveys is presented herein. A user interface associated with an online survey is presented to the respondent on a screen of a computing device. The online survey can include a set of questions. Each question of the online survey can include a set of response elements. Each of these response elements can be associated with one or more response duration. In order to select a response to a question, the respondent can press a response button that is associated with one or more response elements to that question. The respondent then holds the response button for the response duration associated with the response element. After the response duration is complete, the response associated with the response element is deemed to be the response of the respondent.

Abstract: Provided are a Fourier-beam shaper and a display apparatus including the Fourier-beam shaper. The Fourier-beam shaper includes: a waveguide; an input coupler configured to direct a plurality of light beams toward the waveguide in a time-sequential manner; and a spatial converter configured to output the plurality of light beams traveling in the waveguide through spatially different regions of the spatial converter.

Abstract: According to the techniques of this disclosure, a method includes capturing, using a camera system of a vehicle, at least one image of an occupant of the vehicle, determining, based on the at least one image of the occupant, a location of one or more eyes of the occupant within the vehicle, and determining, based on the at least one image of the occupant, an eye gaze vector. The method may also include determining, based on the eye gaze vector, the location of the one or more eyes of the occupant, and a vehicle data file of the vehicle, a region of interest from a plurality of regions of interests of the vehicle at which the occupant is looking, wherein the vehicle data file specifies respective locations of each of the plurality of regions of interest, and selectively performing, based on the region of interest, an action.