Abstract: The disclosure relates to a method and a respective computer program with a program code to execute the method. In particular, disclosed is a method for training a preferred retinal locus of fixation (efficient PRL) for a person having an eye with a field of vision comprising an area of partially diminished or entirely degenerated visual acuity. The method includes: a) determining an inefficient retinal region outside the area in the field of vision of the eye of the person and a more efficient retinal region for the specific vision task outside the area in the field of vision of the eye of the person and b) inducing a preferred retinal locus of fixation (efficient PRL) for a vision task outside the inefficient retinal region but in the more efficient retinal region. In addition, the disclosure relates to a device for performing the method.

Abstract: Aspects of the present disclosure describe systems, methods, and structures that provide eye-tracking by 1) steering a beam of light through the effect of a microelectromechanical system (MEMS) onto a surface of the eye and 2) detecting light reflected from features of the eye including corneal surface, pupil, iris—among others. Positional/geometric/feature/structural information pertaining to the eye is determined from timing information associated with the reflected light.

Abstract: This application discloses a method for training a gaze tracking model, including: obtaining a training sample set; processing the eye sample images in the training sample set by using an initial gaze tracking model to obtain a predicted gaze vector of each eye sample image; determining a model loss according to a cosine distance between the predicted gaze vector and the labeled gaze vector for each eye sample image; and iteratively adjusting one or more reference parameters of the initial gaze tracking model until the model loss meets a convergence condition, to obtain a target gaze tracking model. According to the solution provided in this application, a gaze tracking procedure is simplified, a difference between a predicted value and a labeled value can be better represented by using the cosine distance as a model loss to train a model, to improve prediction accuracy of the gaze tracking model.

Abstract: There is provided an information processing apparatus to measure a distance in a real space with a simpler operation, the information processing apparatus including: an acquisition section that acquires an image captured by a predetermined imaging section, and position information based on at least any of a position and a direction of the imaging section; an estimation section that estimates a first position and a second position in a real space, on a basis of a first image and a second image which are the image captured at each of a first viewpoint and a second viewpoint, and first position information and second position information which are the position information about each of the first viewpoint and the second viewpoint; and a measurement section that measures a distance between the first position and the second position on a basis of the estimation result.

Abstract: An optical system for detecting and tracking the eye movements of an individual. The system includes a frame, intended to be worn on the face of the individual, that includes a plurality of illumination sources. The system includes at least one contact lens, intended to be worn by an eye of the individual facing the frame, in which are encapsulated: an autonomous integrated circuit, a plurality of photoreceptors and a wireless communication transmitter. Variation in a signal (e.g., voltage or current) delivered by the photoreceptors allows not only the closure of the eyelid but also eye movements to be detected.

Abstract: An apparatus (100) for deriving a gaze direction of a human eye (150) includes a light-guide optical element (LOE) (120) having pair of parallel faces (104a), (104b) deployed in facing relation to the eye (150). A coupling-in configuration, such as a set of partially-reflective surfaces (145), is associated with LOE (120) and configured for coupling-in a proportion of light incident on face (104a) so as to propagate within the LOE. Focusing optics (106) associated with LOE (120) converts sets of parallel light rays propagating within the LOE into converging beams of captured light which are sensed by an optical sensor (125). A processing system (108) processes signals from the optical sensor (125) to derive a current gaze direction of the eye. Despite the aperture-combining effect of the LOE, retinal images can be effectively recovered as the only image information brought to focus on the optical sensor.

Abstract: A head-mounted viewable device which includes a display configured to display and project a virtual scene image to a user's eye, a VR optical lens configured to construct an optical path between the display and the user's eye for allowing a virtual scene image being observed by the user's eye, and, an eye-tracking system configured to detect a sight direction of the user's eye and adjust a display position of the virtual scene image based on the detected sight direction. The eye-tracking system includes at least one light source configured to project the detection light and a receiving module configured to receive the reflected detection light reflected to determine the sight direction of the user's eye. The receiving module is positioned at a side of the VR optical lens and arranged to face towards the user's eye such that the detection light reflected by the user's eye is directly received by the receiving module.

Abstract: A wearable electronic device is provided. The wearable electronic device includes a housing including a first housing portion, a second housing portion, and a third housing portion, glasses surrounded by the second housing portion, a display for displaying screens in an inner direction and an outer direction on display areas of the glasses, a sensor module including a first sensor for identifying whether a user is wearing the wearable electronic device, a second sensor for determining a direction where the wearable electronic device is placed, and a third sensor for determining whether the first housing portion or the third housing portion is folded, a camera module including first cameras for tracking a hand gesture of the user and recognizing a space, second cameras for tracking pupils of the user, and a third camera for capturing the outside, and a processor connected with the display, the sensor module, and the camera module.

Abstract: A portable terminal includes a display control unit, an extraction unit, and a compositing unit. The display control unit displays a specifying frame for specifying a specified region which is a partial region in a display image displayed on a touch panel display, and a color designation mark for designating a reference color from colors included in an image of the specified region in the specifying frame, in superposition with the display image. The extraction unit extracts an image corresponding to the reference color designated by the color designation mark from the image of the specified region in the specifying frame, as a compositing target image. The compositing unit generates a composite image in which the compositing target image is composited in a selection image selected by a user.

Abstract: Aspects of the present invention relate to providing see-through computer display optics with improved content presentation. The see-through computer display includes an ambient light sensor adapted to measure environmental scene light in an area that forms the background for digital content presented in the see-through computer display, and a processor adapted to invert a color channel parameter of the digital content based on data from the ambient light sensor.

Abstract: An eye-tracking device includes an optical device that includes a light source with an optical cavity and a light sensor. The light source is positioned to output coherent light toward an eye of a user and receive at least a portion of the coherent light back from the eye of the user as feedback light. The feedback light enters the optical cavity and causes modulation of an intensity of the coherent light. The light sensor is optically coupled with the light source for detecting the modulated intensity of the coherent light and generating one or more signals based on the detected intensity of the coherent light. The eye-tracking device also includes one or more processors that are coupled to the optical device for determining, from the one or more signals, movement information of the eye. A method of detecting movement of an eye using the eye-tracking device is also disclosed.

Abstract: Methods and systems for processing user input to a computing system are disclosed. The computing system has access to an audio input and a visual input such as a camera. Face detection is performed on an image from the visual input, and if a face is detected this triggers the recording of audio and making the audio available to a speech processing function. Further verification steps can be combined with the face detection step for a multi-factor verification of user intent to interact with the system.

Abstract: The present invention relates to a measurement method in which, by predetermined illumination by means of a display device, in particular a holographic or autostereoscopic display device, with an intensity distribution of the illumination light in a plane of a light source image, a first location of an object, in particular an observer of the display device, is marked, and wherein the relative position of the first location in relation to a second location of the object is determined in a coordinate system of a camera.

Abstract: A visual tracking system, comprises an eye-tracking device and a cognitive load detection device disposed in electrical communication with the eye-tracking device, the cognitive load detection device comprising a controller having a memory and a processor. The controller is configured to receive eye-movement data from the eye-tracking device, the eye-movement data comprising pupil dilation event data and at least one of saccade event data and fixation event data, apply a classification function to the eye-movement data to detect a cognitive load associated with the eye-movement data and corresponding to a visual location of a field of view of the user, and output a notification regarding the cognitive load associated with the eye-movement data.

Abstract: At a first time point, a first light capturing device at a first spatial location in a three-dimensional (3D) space captures first light rays from light sources located at designated spatial locations on a viewer device in the 3D space. At the first time point, a second light capturing device at a second spatial location in the 3D space captures second light rays from the light sources located at the designated spatial locations on the viewer device in the 3D space. Based on the first light rays captured by the first light capturing device and the second light rays captured by the second light capturing device, at least one of a spatial position and a spatial direction, at the first time point, of the viewer device is determined.

Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Abstract: A method to self-test vision of a user for use with a handheld vision tester includes receiving image data of the user's face, determining dimensions of the user's face based on the received image data, computing a user viewing distance based on the determined dimensions, displaying a vision test based on the computed user viewing distance, receiving user input responses to the vision test, and outputting results of the vision test from the user input responses.

Abstract: In some aspects, a user device may receive, from a vision sensor of a user device, first image data associated with a first set of images. The user device may determine, using an image processing model, that a set of images depict a particular type of eye activity of an eye of a user. The user device may cause, based at least in part on determining that the first set of images depict the particular type of eye activity, a power level of a camera of the user device to be reduced.

Abstract: A device is provided that may include an illuminator operable to interrogate at least a lens of an eye. The illuminator may include at least one light source and a lens positioned with respect to the light source to produce interrogating radiation. The device also may include a detector operable to image the total autofluorescence response of the lens of the eye as viewable through a pupil of the eye, the detector comprising an image sensor. The device can also include a controller operable to control operation of the illuminator and the detector. The controller may interrogate at least the lens of the eye by activating the illuminator for a select time, obtain at least one image of the total autofluorescence response of the lens at the detector during or immediately subsequent to the select time, and transmit the at least one image to a remote device.

Abstract: Machine learning systems and methods that determine gaze direction by using face orientation information, such as facial landmarks, to modify eye direction information determined from images of the subject's eyes. System inputs include eye crops of the eyes of the subject, as well as face orientation information such as facial landmarks of the subject's face in the input image. Facial orientation information, or facial landmark information, is used to determine a coarse prediction of gaze direction as well as to learn a context vector of features describing subject face pose. The context vector is then used to adaptively re-weight the eye direction features determined from the eye crops. The re-weighted features are then combined with the coarse gaze prediction to determine gaze direction.

Abstract: A method, a structure, and a computer system for cardiorespiratory monitoring via rapid eye movement. The method comprises detecting eye movement of a user while asleep and determining whether the user is subject to a cardiorespiratory condition based on comparing the detected eye movement to a model.

Abstract: An apparatus having a computing device and a user interface—such as a user interface having a display that can provide a graphical user interface (GUI). The apparatus also includes a camera, and a processor in the computing device. The camera can be connected to the computing device and/or the user interface, and the camera can be configured to capture pupil location and/or eye movement of a user. The processor can be configured to: identify a visual focal point of the user relative to the user interface based on the captured pupil location, and/or identify a type of eye movement of the user (such as a saccade) based on the captured eye movement. The processor can also be configured to control parameters of the user interface based at least partially on the identified visual focal point and/or the identified type of eye movement.

Abstract: An electronic system including a display device, an image sensor, a face detection engine, an eye detection engine and an eye protection engine is provided. The image sensor captures an image. The face detection engine recognizes a user face in the image. The eye detection engine recognizes user eyes in the image. The eye protection engine turns off the display device when the user eyes are recognized in the image but the user face is not recognized in the image.

Abstract: A press and hold function for conducting online surveys with a respondent in order to obtain genuine responses to the online surveys is presented herein. A user interface associated with an online survey is presented to the respondent on a screen of a computing device. The online survey can include a set of questions. Each question of the online survey can include a set of response elements. Each of these response elements can be associated with one or more response duration. In order to select a response to a question, the respondent can press a response button that is associated with one or more response elements to that question. The respondent then holds the response button for the response duration associated with the response element. After the response duration is complete, the response associated with the response element is deemed to be the response of the respondent.

Abstract: Provided are a Fourier-beam shaper and a display apparatus including the Fourier-beam shaper. The Fourier-beam shaper includes: a waveguide; an input coupler configured to direct a plurality of light beams toward the waveguide in a time-sequential manner; and a spatial converter configured to output the plurality of light beams traveling in the waveguide through spatially different regions of the spatial converter.

Abstract: According to the techniques of this disclosure, a method includes capturing, using a camera system of a vehicle, at least one image of an occupant of the vehicle, determining, based on the at least one image of the occupant, a location of one or more eyes of the occupant within the vehicle, and determining, based on the at least one image of the occupant, an eye gaze vector. The method may also include determining, based on the eye gaze vector, the location of the one or more eyes of the occupant, and a vehicle data file of the vehicle, a region of interest from a plurality of regions of interests of the vehicle at which the occupant is looking, wherein the vehicle data file specifies respective locations of each of the plurality of regions of interest, and selectively performing, based on the region of interest, an action.

Abstract: A head-mounted display device includes an eye tracking sensor configured to obtain eye information by tracking both eyes of a user, a depth sensor configured to obtain depth information about one or more objects, and a processor configured to obtain information about a gaze point based on the eye information, and determine a measurement parameter of the depth sensor based on the information about the gaze point.

Abstract: Disclosed are a method and device for adjusting a pupil distance of a virtual reality display device. The method adjusts a second pupil distance on a virtual reality display device by means of a first pupil distance of a user wearing the virtual reality display device, the first pupil distance referring to a pupil distance of the user wearing the virtual reality display device, and the second pupil distance being used as a distance between focal points of two lenses of the virtual reality display device; the method comprises: detecting whether the first pupil distance and the second pupil distance match; if the first pupil distance and the second pupil distance do not match, then executing a preset matching operation on the virtual reality display device. The present application solves the technical problem of a virtual reality display device being bulky and heavy.

Abstract: Examples relate to an optical system and to a corresponding apparatus, method and computer program. The optical system comprises a display module for providing a visual overlay to be overlaid over an object in an augmented reality or mixed reality environment. The optical system comprises at least one sensor for sensing at least one optical property of the object. The optical system comprises a processing module configured to determine the at least one optical property of the object using the at least one sensor. The processing module is configured to determine a visual contrast between the visual overlay to be overlaid over the object and the object, as perceived within a field of view of the augmented reality or mixed reality environment, based on the at least one optical property of the object.

Abstract: System for determining a position of a tool-point-of-interest of a tool, relative to an eye-tissue-of-interest, which includes and imager a tool-tracker and a processor. The imager acquires an image of a tissue-reference-marker. The tool-tracker determines information relating to the P&O of the tool in a reference-coordinate-system. The imager and the tool-tracker are in registration with the reference-coordinate-system. The processor determines the position of the tissue-reference-marker in the reference-coordinate-system, according to the acquired image of the tissue-reference-marker. The processor determines the P&O of the eye-tissue-of-interest in the reference-coordinate-system according to at least the position of the tissue-reference-marker and a relative position between the tissue-reference-marker and the eye-tissue-of-interest. The relative position is pre-determined from a stored-3D-model.

Abstract: A method for predicting eye movement in a head mounted display (HMD). The method including tracking movement of an eye of a user with a gaze tracking system disposed in the HMD at a plurality of sample points. The method including determining velocity of the movement based on the movement of the eye. The method including determining that the eye of the user is in a saccade upon the velocity reaching a threshold velocity. The method including predicting a landing point on the display of the HMD corresponding to a direction of the eye for the saccade.

Abstract: The present disclosure provides for medical device administration and interaction by identifying a medical event affecting a first individual, a medical device associated with treating the medical event, and an initial attentiveness level of an administering individual; outputting a tutorial for how to use the medical device to treat the medical event with a first control level, wherein the first control level based on the initial attentiveness level of the administering individual; and in response to receiving a triggering event while outputting the tutorial: determining a current attentiveness level for the administering individual; and in response to the current attentiveness level indicating a change from the initial attentiveness level, adjusting the tutorial based on a second control level, different than the first control level, based on the change from the initial attentiveness level.

Abstract: An apparatus to illuminate a target includes a lens having a lens side to be positioned in opposing relation to the target. The apparatus includes a lightguide that circumscribes at least a portion of the periphery of the lens. The lightguide has an input end to receive light and a length along which the receive light propagates. The apparatus includes outcoupling elements that are spaced out along the length of the lightguide. The outcoupling elements couple light out of the lightguide at respective positions along the length of the lightguide. The outcoupling elements are oriented to direct the outcoupled light towards the target when the lens side is positioned in opposing relation to the target. An eye tracking apparatus including the illumination apparatus and a method of eye tracking are disclosed.

Abstract: Provided is a portable, hand-held, self-powered, self-calibrated, easy-to-use “iCOBRA” system, a neural/neurological assessment tool for both operational decision-making in military, aerospace, sports, and other high-performance settings, and to assist in diagnostics in medical practice. The system harnesses multimodal 3D imaging technologies for robust, calibration free, head and eye tracking to allow for visual, vestibular, and oculomotor assessment of human neural health and performance.

Abstract: The disclosed transparent circuit board may include a transparent substrate, a first conductive trace coupled to the transparent substrate, and an electrical component having a bottom surface facing the transparent substrate and a top surface facing away from the transparent substrate. The bottom surface may include a first electrical contact coupled to the first conductive trace, and the top surface may include a second electrical contact. The transparent circuit board may also include a second conductive trace electrically connected to the second electrical contact and a transparent encapsulation layer coupled to the transparent substrate and encapsulating the electrical component. Various other ophthalmic devices, systems, and methods are also disclosed.

Abstract: A method for training an eye tracking model is disclosed, as well as a corresponding system and storage medium. The eye tracking model is adapted to predict eye tracking data based on sensor data from a first eye tracking sensor. The method comprises receiving sensor data obtained by the first eye tracking sensor at a time instance and receiving reference eye tracking data for the time instance generated by an eye tracking system comprising a second eye tracking sensor. The reference eye tracking data is generated by the eye tracking system based on sensor data obtained by the second eye tracking sensor at the time instance. The method comprises training the eye tracking model based on the sensor data obtained by the first eye tracking sensor at the time instance and the generated reference eye tracking data.

Abstract: Disclosure herein concerns a method that includes illuminating a user's eye with an illumination source in a head-worn display, capturing an image of the user's eye with an eye camera in the head-worn display, wherein the image includes an eye glint produced by light from the illumination source that is reflected from a surface of the user's eye, determining a size of an eye glint in the captured image, and identifying a change in focus distance for the user's eye in correspondence with a change in the size of the eye glint.

Abstract: An eye is illuminated with infrared illumination light. Illuminating the eye includes illuminating a near-eye ellipsoidal lensing structure. A tracking image of Purkinje reflections of the infrared illumination light is captured by a camera. An eye position of the eye is determined in response to the tracking image.

Abstract: A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, and a control unit. The frame may be adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the at least one image sensor, and calibrate at least one illuminator, at least one image sensor, or an algorithm of the control unit.

Abstract: Disclosed are an optical detection method and an optical detection apparatus for a fatigue state of a user, and an optical detection device, this application relates to the field of detection technology, and is for improving accuracy of detection of the fatigue state. An optical detection method includes: irradiating eyes of the user with an infrared light; obtaining an intensity of an infrared light reflected by the eyes of the user; and determining whether the user is in a fatigue state based on the intensity of the reflected infrared light.

Abstract: Embodiments of the present disclosure provide a method and a device for determining a gaze placement and a computer readable storage medium. The method comprises acquiring an ocular image of a subject; determining at least one gaze characteristic vector based on an ocular image; determining a gaze placement of the subject, according to a gaze estimation model and the at least one characteristic vector. The characteristic vector comprises at least one of: a first characteristic vector from a first reference speckle center to a pupil center, wherein the first reference speckle is formed by a first reference source in the ocular image; a second characteristic vector from the pupil center to a second reference speckle center, wherein the second reference speckle is formed by a second reference source in the ocular image; a third characteristic vector from the second reference speckle center to the first reference speckle center.

Abstract: The invention relates to a method for performing a movement correction when measuring a human eye, in which the eye is scanned by a measurement beam in order to obtain a set of position values of an eye structure. Scanning extends over a measurement time interval, wherein the position values are each provided with a timestamp within the measurement time interval. A surface shape and a displacement function are determined, with the displacement function representing a movement pattern during the measurement time interval, and the surface shape and the displacement function being determined in such a way that the position values are approximated by the surface shape when the surface shape is moved according to the displacement function. Moreover, the invention relates to an associated measurement system.

Abstract: The disclosure relates to an eye tracking device for tracking movements of an eye comprising, a viewing plane for displaying a projection of an image to the eye of a user, an image module placed on a same side of the viewing plane as the eye, at least one illuminator for illuminating the eye, a control unit adapted to receive an image captured by the image module, and calculate a viewing angle of the eye, a holographic optical element (HOE), wherein a HOE is placed between the eye and the viewing plane, wherein the image module is adapted to capture an image of the HOE, and wherein the HOE is adapted to direct at last a first portion of incident light reflected from the eye, in a first angle towards the image module, the first angle being different from an angle of the incidence of the incident light.

Abstract: A method of identifying scleral reflections in an eye tracking system is disclosed. A glint is identified in an image from an image sensor, wherein the glint is a representation in the image of a reflection of light from a cornea of the eye of the user or from a sclera of the eye of the user. A first pixel intensity of the glint is determined, a second pixel intensity of neighbor pixels of the glint is determined, and an absolute value of the difference between the first pixel intensity of the glint and the second pixel intensity of the neighbor pixels of the glint is determined. The glint is identified as a representation of a reflection from the sclera of the eye of the user on condition that the determined absolute value of the difference is below a predetermine threshold value.

Abstract: A head mounted display comprises an eye tracking system configured to enable eye tracking using polarization. The eye tracking system includes one or more illumination sources and an optical detector comprising polarization sensitive pixels. The one or more illumination sources are configured to illuminate a user's eye and generate reflections directed towards the optical detector. The eye tracking system determines, for each polarization sensitive pixel in a subset of the polarization sensitive pixels, one or more estimation parameters. The eye tracking system determines, for the subset of the polarization sensitive pixels, depth information for one or more glints associated with one or more surfaces of the eye, based in part on the polarization of the reflections and the one or more estimation parameters. The determined depth information is used to update a model of the eye. The eye tracking system determines eye tracking information based on the updated model.

Abstract: A concise representation illustrating essential elements of a subjective refraction eye test that includes choices of optics offered to a test subject, responses by the test subject indicating respective choices among the optics, and time durations of, between, or both of and between, responses by the test subject indicating the respective choices of optics. The concise representation includes a presentation that illustrates the essential elements of the eye test.

Abstract: A system includes a camera positioned in an environment to capture image data of a subject; a computing device communicatively coupled to the camera, the computing device comprising a processor and a non-transitory computer-readable memory; and a machine-readable instruction set stored in the non-transitory computer-readable memory. The machine-readable instruction set causes the computing device to perform at least the following when executed by the processor: receive the image data from the camera; analyze the image data captured by the camera using a neural network trained on training data generated from a 360-degree panoramic camera configured to collect image data of a subject and a visual target that is moved about an environment; and predict a gaze direction vector of the subject with the neural network.

Abstract: The disclosure relates to a method of determining a gaze distance, the method including obtaining a plurality of images by capturing each of both eyes of a user, determining, from each of the plurality of images, a corner point located at an edge of the eye, a location of a pupil, and an eye contour, determining each of gaze directions of both of the eyes based on a difference between a reference point and the location of the pupil, wherein the reference point is determined based on the eye contour and a location of the corner point, and determining a gaze distance based on a difference between the gaze directions of both of the eyes.

Abstract: Systems and methods for eye image set selection, eye image collection, and eye image combination are described. Embodiments of the systems and methods for eye image collection can include displaying a graphic along a path connecting a plurality of eye pose regions. Eye images at a plurality of locations along the path can be obtained, and an iris code can be generated based at least partly on at least some of the obtained eye images.

Abstract: An information processing device according to an aspect of the present technology includes a user information acquiring unit, an object information acquiring unit, and an output control unit. The user information acquiring unit acquires information related to a gaze position of a user while a substance of content is being automatically reproduced, in accordance with a first control amount, from an audio source located in a space in which the user is located. The object information acquiring unit acquires position information related to the audio source and position information related to a first object gazed at by the user. The output control unit performs first output control of providing the user with the substance of the content in accordance with a second control amount different from the first control amount in a case where the gaze position within the first object moves toward the audio source.