Abstract: Various implementations track an eye using both camera images and light sensor data, e.g., from a photosensitive surface or set of photodetectors. The camera need not capture images at a high capture rate since the light sensor data captured from the light sensor provides information about the eye during the time periods between camera frames. An eye tracking device may thus provide eye tracking with high temporal resolution using less power and resources and prior devices. The eye tracking device includes a lens (e.g., a diffractive optical element (DOE)) that splits received light onto the camera and light sensor. The camera and light sensor may be aligned, e.g., co-centered. Using such a lens to provide light to an aligned camera and light sensor facilitates tracking the eye characteristics by reducing the need for matching the data and/or accounting for multiple environmental light sources.

Abstract: Disclosed is a device including a detector producing a signal depending on variations of the pupil diameter of an eye of a subject, a display for presenting, to the subject, a light pattern subdivided into a plurality of regions, and an analyzer receiving the signal of the detector and analyzing the frequential content thereof. The display is controlled such that each region has a light intensity modulated at a respective modulation frequency, the modulation frequencies being different from one region to the next.

Abstract: An apparatus and method: project a plurality of light spots onto a cornea of an eye having a tear film disposed thereon, wherein the light spots are broadband light spots or are narrowband light spots whose bandwidth is tuned in time across a broad bandwidth; image the light spots from the cornea onto at least one two-dimensional detector array; spectrally resolve each of the plurality of imaged light spots; perform interferometry on the spectrally resolved imaged light spots to identify an anterior interface and a posterior interface of the tear film of the eye; and determine a thickness of the tear film as a distance between the anterior interface and the posterior interface.

Abstract: This method for predicting at least one eye gazing parameter of a person wearing visual equipment includes steps of: measuring data of at least two individuals wearing visual equipment, such data including at least head motion parameters and eye gazing parameters of the individuals; measuring head motion parameters of the person in real-life conditions; comparing the head motion parameters of the person with the head motion parameters of the at least two individuals; and predicting the at least one eye gazing parameter of the person at least on the basis of the results of the comparing step and of the eye gazing parameters of the at least two individuals.

Abstract: A method, system, and computer program product for generating augmented reality sessions based on eye behavior of a user is provided. The method detects a set of eye characteristics of a user. In response to detecting the set of eye characteristics, presentation of an augmented reality session is initiated using an augmented reality device. The method detects a change to at least one eye characteristic of the set of eye characteristics of the user. In response to detecting the change, the method determines the change to the at least one eye characteristic indicates a reduced cognitive state of the user. The augmented reality state being presented to the user is modified in response to determining the change indicates the reduced cognitive state.

Abstract: A mixed reality display comprising: at least one lens, where the at least one lens has a reflective element, the at least one lens comprising a plurality of pixels; at least one display capable of projecting one or more images onto at least a portion of the at least one lens; and a dynamic opacity system, where the dynamic opacity system is capable of making at least one pixel opaque in the portion of the at least one lens onto which the one or more images are projected, while any portion of the at least one lens onto which no image is projected remains see-through.

Abstract: Systems and methods for detecting a traumatic brain injury (TBI). The system comprises a sensing arrangement and a control unit. The sensing arrangement collects eye movement data of a user. The control unit is in communication with the sensing arrangement and configured to compare the eye movement data to one or more baseline measurements of eye movement dynamics. The control unit is also configured to generate an alert indicating the presence or severity of the TBI for delivery to control unit administrator if the eye movement data diverges from one or more of the baseline measurements by a threshold amount.

Abstract: An example system for tracking motion of an eye during an eye treatment includes an image capture device configured to capture a plurality of images of an eye. The system includes controller(s) including processor(s) that receive the plurality of images from the image capture device. The processor(s) implement a plurality of trackers. Each tracker is configured to detect a respective feature in the plurality of images and provide, based on the respective feature, a respective set of data relating to motion of the eye. The respective features detected by the plurality of trackers are orthogonal relative to each other and the respective sets of data provided by the plurality of trackers are independent of each other. The processor(s) coalesce the sets of data from the plurality of trackers and determine an indicator of the motion of the eye based on the coalesced sets of data.

Abstract: A Progressive Lens Simulator comprises an Eye Tracker, for tracking an eye axis direction to determine a gaze distance, an Off-Axis Progressive Lens Simulator, for generating an Off-Axis progressive lens simulation; and an Axial Power-Distance Simulator, for simulating a progressive lens power in the eye axis direction. The Progressive Lens Simulator can alternatively include an Integrated Progressive Lens Simulator, for creating a Comprehensive Progressive Lens Simulation. The Progressive Lens Simulator can be Head-mounted. A Guided Lens Design Exploration System for the Progressive Lens Simulator can include a Progressive Lens Simulator, a Feedback-Control Interface, and a Progressive Lens Design processor, to generate a modified progressive lens simulation for the patient after a guided modification of the progressive lens design. A Deep Learning Method for an Artificial Intelligence Engine can be used for a Progressive Lens Design Processor.

Abstract: Systems, devices, media, and methods are presented for gaze-based control of device operations. One method includes receiving a video stream from an imaging device, the video stream depicting one or more eyes, determining a gaze direction for the one or more eyes depicted in the video stream, detecting a change in the gaze direction of the one or more eyes, and triggering an operation in a client device based on the change in the gaze direction.

Abstract: The present disclosure provides a non-contact vital sign detection device, which comprises a processing unit, a preset light source, a beam splitter, a camera and a display unit; the processing unit sends an emission instruction to the preset light source and sends a capturing instruction to the camera when detecting a first preset instruction; the preset light source emits a preset light ray outwards when receiving the emission instruction; the beam splitter filters the light ray reflected by the eyes of the target user to the camera based on the preset light ray.

Abstract: This application discloses distance detection apparatuses. The distance detection apparatus includes a light source, a transmitting and receiving lens, a detector, and an optical path change element. The light source is to emit a beam. The transmitting and receiving lens is to collimate the beam emitted by the light source, and converge at least a part of return light of the beam reflected by a to-be-detected object. The detector is placed with the light source on a same side of the transmitting and receiving lens, to convert at least a part of return light that passes through the transmitting and receiving lens into an electrical signal. The optical path change element is to change an optical path of the beam emitted by the light source or the return light that passes through the transmitting and receiving lens.

Abstract: A method and apparatus is disclosed for testing hearing in infants based on pupil dilation response. It does not require sedation or depend on subjective judgments of human testers. Pupil dilation response to sound is measured by presenting on a display a visually engaging video containing periodic changes; presenting sounds synchronized with the periodic changes of the video; recording images from a camera directed in front of the display, where the camera is sensitive to infrared wavelengths; processing the images to measure pupil sizes; and processing the measured pupil sizes to determine, statistically, the presence of a pupil dilation response to the sounds.

Abstract: A system and method for determining an adapted ophthalmic device for a wearer, the method including acquiring a set of parameters values relating to the wearer, determining at least a task to be performed by the wearer involving visual exploration, using a computing system, determining a value of a criterion assessing an efficiency of the wearer's visual exploration strategy for the task, and determining an optical design of an ophthalmic device to be worn by a wearer according to the determined value of the criterion.

Abstract: A processor of an ophthalmologic image processing device acquires intermediate information from which an influence of a position shift with respect to a first direction at each position in a second direction is excluded, for each of a first ophthalmologic image and a second ophthalmologic image (S4). The processor performs alignment with respect to the second direction between the first ophthalmologic image and the second ophthalmologic image, based on the intermediate information (S5, S6). The processor performs alignment with respect to the first direction between pixels at the same position with respect to the second direction in the first ophthalmologic image and the second ophthalmologic image for which the alignment with respect to the second direction has been performed (S7).

Abstract: A method that includes illuminating an eye with light at a first time and a second time and generating a first image of the eye based on the light that illuminates the eye at the first time. The method includes generating a second image of the eye based on the light that illuminates the eye at the second time. The method further includes positioning a laser source relative to the eye, wherein the laser source generates a therapeutic laser beam to be directed to the eye, wherein the first time is just prior to the therapeutic laser beam being directed to the eye and the second time is prior to the first time. The method further includes correcting orientation of the laser source relative to the eye based on a correlation function that is defined for the first and second images of the eye.

Abstract: An ophthalmic stimulator for temporarily constricting a pupil of an eye comprises an irradiation control system, having a feedback system, to generate an irradiation control signal using a feedback of the feedback system; an irradiation source, coupled to the irradiation control system, to generate an irradiation; and an irradiation delivery system, having a targeting system and coupled to the irradiation control system, to receive the irradiation from the irradiation source, and to direct a patterned irradiation in a pattern to a treatment region of an iris of the eye using the targeting system; wherein the irradiation control system controls at least one of the irradiation source and the irradiation delivery system with the irradiation control signal so that the patterned irradiation causes a temporary constriction of the pupil, without causing a permanent constriction of the pupil.

Abstract: A method of 3D motion reconstruction of outdoor, highly flexible moving subjects with multiple cameras on drones is described herein. A multi-drone capturing system is used to remove the restriction of a dedicated virtual reality shooting place, “the hot seat,” so that the actor/target is able to perform agile or long-distance activities outdoor. The subject's 3D pose parameters are estimated by the captured multi-view images by the drones, and the sequence of poses becomes the motion in time to control the animation of a pre-built 3D model. The method is able to be directly integrated into an existing Virtual Reality/Augmented reality (VR/AR) production chain, and the subject is able to be extended to animals that are difficult to be contained in a VR camera mesh space.

Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display virtual image content at different amounts of divergence and collimation. The display system can include an inward-facing imaging system possibly comprising a plurality of cameras that image the user's eye and glints thereon, and processing electronics that are in communication with the inward-facing imaging system and that are configured to obtain an estimate of a center of cornea of the user's eye using data derived from the glint images. The display system may use spherical and aspheric cornea models to estimate a location of the corneal center of the user's eye.

Abstract: Content feedback based on region of view, including: determining, for a user of a recipient device receiving content from a presenting device, a region of view of the content associated with the user; generating, based on the region of view, a visual overlay; and displaying, by the presenting device, the visual overlay applied to the content.

Abstract: This disclosure relates generally to a method and system for assessment of sustained visual attention of a target. The conventional methods utilize various markers for assessment of attention, however, blink rate variability (BRV) series signal is not explored yet. In an embodiment, the disclosed method utilizes BRV series signal for assessing sustained visual attention of a target. A gaze data of the target is recorded using an eye tracker and a set of uniformly sampled BRV series signal is reconstructed from each of the BRV series. One or more frequency domain features, including pareto frequency, are extracted from the set of uniformly sampled BRV series signal. The values of frequency domain features extracted from the set of BRV series signals are compared with corresponding threshold values to determine visual sustained attention of the target.

Abstract: A processing device includes a memory configured to store executable instructions, and processing circuitry configured to execute the executable instructions stored in the memory to thereby realize: a first acquisition unit configured to acquire timing of blink motion performed by a dialogue device, a second acquisition unit configured to acquire blink timing by user performing a dialogue with the dialogue device, and a processing unit configured to perform processing according to difference between the timing of blink motion performed by the dialogue device and the blink timing by the user.

Abstract: A head-mounted device may have a head-mounted support structure. Gaze tracking systems may be supported by the support structure so that the gaze of a user may be monitored. Lenses may be supported by the support structure. Display systems may provide computer-generated images to the user while the user is viewing real-world objects through the lenses. The gaze tracking systems may include image-sensor-based systems such as glint-based systems. A glint-based gaze tracking system may include light-emitting devices that emit light beams that create eye glints on the surface of a user's eyes and may include an image sensor that measures the eye glints to gather information on the user's gaze. A low-power gaze tracking system may be included in the head-mounted device. The low-power gaze tracking system may use light detectors to measure the magnitudes of respective light reflections of the light beams.

Abstract: The present disclosure is related to a method and apparatus for determining drug usage or a physiological characteristic of a patient. The present disclosure describes acquiring a video sequence, of an eye of a patient, the video sequence being a plurality of video frames, determining a frequency spectrum from a pupillary data of the video sequence, and determining, based on the frequency spectrum, the physiological characteristic or drug of use of the patient. In an embodiment, at least one frequency can be probed based on which physiological characteristic is being explored.

Abstract: An optical system includes an optical waveguide, and a first optical element configured to direct a first ray, having a first circular polarization and impinging on the first optical element at a first incidence angle, in a first direction so that the first ray propagates through the optical waveguide via total internal reflection toward a second optical element. The first optical element is configured to also direct a second ray, having a second circular polarization that is distinct from the first circular polarization and impinging on the first optical element at the first incidence angle, in a second direction that is distinct from the first direction so that the second ray propagates away from the second optical element. The second optical element is configured to direct the first ray propagating through the optical waveguide toward a detector.

Abstract: The disclosed embodiments illustrate methods and systems for training users in sports using mixed reality. The method includes retrieving data from athletes wearing helmets, wearable glasses, and/or motion-capture suits in real time. The helmets and the wearable glasses are integrated with mixed-reality technology. Further, physical performance data of the athletes is captured using a variety of time-synchronized measurement techniques. Thereafter, the athletes are trained using the captured data and audio, visual and haptic feedback.

Abstract: A blood flow measuring unit of a blood flow measurement apparatus of an embodiment includes an optical system for applying an OCT scan to an eye fundus and obtains blood flow information based on data acquired by the OCT scan. A movement mechanism moves the optical system. A controller applies a first movement control to the movement mechanism to move the optical system in a first direction orthogonal to an optical axis of the optical system by a predetermined distance from the optical axis. A judging unit judges occurrence of vignetting based on a detection result of return light of light incident on the eye through the optical system after the first movement control. The controller applies a second movement control to the movement mechanism to further move the optical system based on a judgement result obtained by the judging unit.

Abstract: Systems and methods disclosed herein are related to an intelligent UI element selection system using eye-gaze technology. In some example aspects, a UI element selection zone may be determined. The selection zone may be defined as an area surrounding a boundary of the UI element. Gaze input may be received and the gaze input may be compared with the selection zone to determine an intent of the user. The gaze input may comprise one or more gaze locations. Each gaze location may be assigned a value according to its proximity to the UI element and/or its relation to the UI element's selection zone. Each UI element may be assigned a threshold. If the aggregated value of gaze input is equal to or greater than the threshold for the UI element, then the UI element may be selected.

Abstract: The present invention relates to the field of instruments for visualizing the inner structures of the human body, and in particular of the eye. More specifically, its object is an optical coherence tomography system and method of the “Fourier-domain” type with the removal of unwanted artifacts through digital image processing.

Abstract: A first determination unit determines whether a movement of an eyelid or an eyebrow of a wearer has occurred, based on an electric signal measured by a measurement electrode with a common electrode as a ground potential. A second determination unit determines that a movement of a face of the wearer has occurred when a distortion detection unit detects distortion of the spectacle frame. An output unit outputs a command due to operation of the spectacle frame by the wearer when the first determination unit determines that the movement of the eyelid or the eyebrow of the wearer has occurred and at the same time the second determination unit determines that the movement of the face of the wearer has occurred.

Abstract: A visual field test device includes: first probability density function acquisition unit performs step (1) of obtaining a probability density function f(x1) for a result value x1 obtained in a first visual field test; a stimulation threshold determination unit performs step (2) of setting a stimulation threshold t1 to a value in the range of x1 in the f(x1); a test result acquisition unit performs step (3) of obtaining test results indicating if a result greater than or equal to t1 was obtained in the first visual field test; a second probability density function acquisition unit performs step (4) of obtaining a probability density function f(x2) by removing probability density values that's greater than or equal to t1, or removing values that are less than t1 from f(x1); and a determination unit performs step (5) of determining if a standard deviation ? of the f(x2) is below a predetermined value.

Abstract: Angular sensors that may be used in eye-tracking systems are disclosed. An eye-tracking system may include a plurality of light sources to emit illumination light and a plurality of angular light sensors to receive returning light that is the illumination light reflecting from an eyebox region. The angular light sensors may output angular signals representing an angle of incidence of the returning light.

Abstract: A system for simulating an output in a virtual reality gaming environment including a pod for being entered by a user. A virtual reality device is located in the pod for being worn by the user. A controller unit is electrically connected with the virtual reality device and the pod and defines an electronic three-dimensional grid representative of the pod. At least one motion sensor is electrically connected to the controller unit for detecting movement within the pod and providing the controller unit input data. The input data includes three-dimensional coordinates representative of a location of the detected movement in the pod. At least one output device is disposed in the pod and electrically connected with the controller unit. The controller unit receives the input data and activates the output device at three-dimensional coordinates in the pod that correspond with the three-dimensional coordinates of input data.

Abstract: Eye gaze measurements are used to give input to a surgical robotic system. Eye tracking input is enhanced using a pair of eye trackers positioned to track the gaze of a user observing an endoscopic image on a display. At least one of the eye trackers is moveable relative to the display in a horizontal and/or vertical direction relative to the image display.

Abstract: Computer implemented methods for mobile device, mobile devices and computer programs are utilized for determining the center of rotation of the eye. An image of an eye of a person is captured in at least two positions of the mobile device, and the position of the center of rotation is determined based on the images and the position. In a similar manner, optionally a pupil position may be determined.

Abstract: A head-mounted display device includes a first reflective polarizer having a first optical surface and a second optical surface that is opposite to the first optical surface. The first optical surface of the first reflective polarizer is curved, and the first reflective polarizer is configured to reflect light having a first polarization. The head-mounted display device also includes a first electronic display configured to project toward the first reflective polarizer a light pattern. At least a portion of the light pattern is reflected by the first reflective polarizer. Also disclosed is a method, which includes directing a light pattern from the first electronic display toward the first reflective polarizer and reflecting at least a portion of the light pattern toward an eye of a user.

Abstract: A system and associated method for computerized rotational head impulse test (crHIT) to assess the semicircular canals of the human vestibular system clinically in patients with balance disorders. The system utilizes a rotary chair combined with a head mounted VOG system with head tracking sensors. The crHIT protocol uses the same physiologic principles as the known video head impulse test (vHIT). The crHIT utilizes whole-body rotation via the chair to yield a persistent controlled, repeatable, comfortable, reliable stimulus can be delivered while recording eye movements with video-oculogaphy.

Abstract: A virtual reality or augmented reality vision system including: a first emission module, emitting light in the visible range; a second emission module, emitting light in the infrared range; an infrared-sensitive photodetection module; and a micromirror array. Each micromirror is capable of assuming a first position and a second position. Each micromirror of the micromirror array is configured to, in its first position, receive light from the first emission module and reflect it along an axis of interest. Each micromirror of the micromirror array is configured to, in its second position, receive light from the second emission module and reflect it substantially along the axis of interest, and receive light propagating along the axis of interest and reflect it towards the photodetection module.

Abstract: A state of a user of a mobile terminal having a display for displaying an image may be estimated. A sightline detector detects a sightline of the user of a mobile terminal and processing circuitry is configured to estimate a state of the user. The processing circuitry is configured to determine a top-down index value that is correlated with an attention source amount allocated to top-down attention of the user with respect to an image displayed on a display of the mobile terminal. The processing circuitry is configured to determine a bottom-up index value correlated with the attention source amount allocated to bottom-up attention of the user with respect to the image displayed on the display. The processing circuitry is configured to estimate the user state including an attention function degraded state based on the top-down index value and the bottom-up index value.

Abstract: An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and/or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such as icons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

Abstract: Disclosed herein is utilization of photosensor-oculography along with a video camera to implement a novel form of eye tracking, which can be important for many applications, such as augmented reality (AR) on smartglasses. In one embodiment, an eye tracking system includes a photosensor-oculography device (PSOG) that emits light and takes measurements of reflections of the light from an eye of a user, and a camera that captures images of the eye. A computer calculates values indicative of eye movement velocity (EMV) based on the measurements of the reflections obtained by the PSOG. These values then are used to determine how data is read from the camera, which can save power in some cases: the computer reads data from the camera at a higher bitrate when the values are indicative of the EMV are below a threshold compared to when the values are indicative of the EMV are above the threshold.

Abstract: The technology disclosed relates to user interfaces for controlling augmented reality (AR) or virtual reality (VR) environments. Real and virtual objects can be seamlessly integrated to form an augmented reality by tracking motion of one or more real objects within view of a wearable sensor system. Switching the AR/VR presentation on or off to interact with the real world surrounding them, for example to drink some soda, can be addressed with a convenient mode switching gesture associated with switching between operational modes in a VR/AR enabled device.

Abstract: A stimulation system stimulates anatomical targets in a patient for treatment of dry eye. The system may include a controller and a microstimulator. The controller may be implemented externally to or internally within the microstimulator. The components of the controller and microstimulator may be implemented in a single unit or in separate devices. When implemented separately, the controller and microstimulator may communicate wirelessly or via a wired connection. The microstimulator may generate pulses from a controller signal and apply the signal via one or more electrodes to an anatomical target. The microstimulator may not have any intelligence or logic to shape or modify a signal. The microstimulator may be a passive device configured to generate a pulse based on a signal received from the controller. The microstimulator may shape or modify a signal. Waveforms having different frequency, amplitude and period characteristics may stimulate different anatomical targets in a patient.

Abstract: An apparatus for mounting on a head including a frame, A face-wearable near-ocular optics and a micro-display for displaying data in front of the eyes is provided. A computing device is coupled to the micro-display. At least one sensor is coupled to the computing device for receiving biometric human information.

Abstract: An apparatus for providing gaze tracking in a near-eye display. Certain examples provide an apparatus including a light modulator configured to receive light of a first range of wavelengths and generate an image beam therefrom. The light modulator is further configured to receive light of a second range of wavelengths and generate a probe beam therefrom. The apparatus also includes one or more light guides including one or more in-coupling element areas, and one or more out-coupling element areas. The one or more in-coupling diffractive element areas are configured to receive and in-couple the image beam and the probe beam into the one or more light guides. The one or more out-coupling element areas are configured to out-couple, from the one or more light guides: the image beam to a user's eye for user viewing, and the probe beam to the user's eye for detection of reflection therefrom.

Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.

Abstract: A method, computer program product, and computing system for receiving audio-based content from a user who is reviewing an image on a display screen; receiving gaze information that defines a gaze location of the user; and temporally aligning the audio-based content and the gaze information to form location-based content.

Abstract: Systems and methods are disclosed for evaluating human eye tracking. One method includes receiving data representing the location of and/or information tracked by an individual's eye or eyes before, during, or after the individual performs a task; identifying a temporal phase or a biomechanical phase of the task performed by the individual; identifying a visual cue in the identified temporal phase or biomechanical phase; and scoring the tracking of the individual's eye or eyes by comparing the data to the visual cue.

Abstract: A method for detecting an eye event of a user using an eye tracking system, the method comprising capturing a first image of a first eye of a user, capturing an image of a second eye of the user a first period after capturing the first image of the first eye and a second period before capturing a next image of the first eye, capturing a second image of the first eye the second period after capturing the image of the second eye, determining that an eye event has occurred based on a difference between the first and second images of the first eye, and performing at least one action if it is determined that that an eye event has occurred.

Abstract: A method is disclosed for testing hearing in infants based on pupil dilation response. It does not require sedation or depend on subjective judgments of human testers. Pupil dilation response to sound is measured by presenting on a display a visually engaging video containing periodic changes; presenting sounds synchronized with the periodic changes of the video; recording images from a camera directed in front of the display, where the camera is sensitive to infrared wavelengths; processing the images to measure pupil sizes; and processing the measured pupil sizes to determine, statistically, the presence of a pupil dilation response to the sounds.