Abstract: Introduced here are techniques to accurately and efficiently generate an image indicative of a fundus. An imaging device engaged to an ophthalmology device, such as an indirect ophthalmoscope, may capture a series of images of a fundus. The series of images may be segmented to identify a region of interest (ROI) representing the fundus in each image. The segmented series of images may be projected onto a coordinate space to remove any distortion in each of the series of images. The projected segmented series of images may be combined into an output fundus image. As a result, the output fundus image may remove distortion and glare included in the input images. The output fundus image may be utilized in detection and diagnosis of various conditions and diseases.

Abstract: An apparatus for generating an alert indicating an unreliability in a location of a landmark feature in a retinal image predicted by a machine learning algorithm, comprising: a receiver module which receives the predicted location; a probability indication determining module which uses the predicted location and a mixture model, which comprises a probability distribution of a landmark feature location and is based on determined locations of the landmark feature in retinal images having a plurality of retinal image classes, to determine, for each class, a respective probability indication indicating a probability that the retinal image belongs to the class; an outlier detector module which uses the probability indications to determine whether the retinal image is an outlier belonging to none of the classes; and an alert generator module which generates, when the retinal image belongs to none of the classes, an alert indicating unreliability of the predicted location.

Abstract: An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.

Abstract: A computing system may perform image processing on image data acquired by a camera at a property to determine at least a first feature of the image data. Based at least in part on a determination that the first feature satisfies a rule, the computing system may generate a vector representing a plurality of characteristics of a face represented in the image data. The vector may then be used to determine a particular person is represented in the image data.

Abstract: The present invention relates to a system for acquiring and visualizing OCT signals, comprising an OCT system and a display means designed for the time-resolved display of image data. The system further comprises a control unit configured to drive the OCT system to acquire a time-resolved OCT signal of a selected field of view of the sample and to determine a time-resolved OCT image on the basis of the acquired time-resolved OCT signal and a specifiable virtual viewing direction and to display the time-resolved OCT image on the display means. The present invention also relates to a corresponding method for acquiring and visualizing OCT signals.

Abstract: Techniques for optimizing which LEDs in a HMD to use, the brightness of those LEDs, and camera exposure are divulged based on the particular function to be performed. For instance, one set of optimization parameters may be implemented for eye tracking purposes while a different set of optimization parameters may be implemented for eye-based authentication purposes.

Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

Abstract: A wearable electronic device with a display is provided. The wearable electronic device includes: a stereo camera configured to detect infrared light, a self-luminous display including a plurality of visible light pixels configured to output visible light corresponding to a virtual object image and a plurality of infrared pixels configured to output infrared light, an optical waveguide configured to output the virtual object image by adjusting a path of the visible light, a first control circuit configured to supply driving power and a control signal to the self-luminous display, and a second control circuit configured to supply driving power and a control signal to the stereo camera. The optical waveguide includes a half mirror configured to output reflected infrared light and transmitted infrared light in response to the output infrared light.

Abstract: A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).

Abstract: Described techniques enable displaying a plurality of positions arranged around a central location on a display, the plurality of positions including at least one empty position and filled positions displaying a first subset of list elements, the filled positions including an adjacent position that is adjacent to the at least one empty position. Movement of a gaze point may be tracked, relative to the filled positions and around the central location towards the at least one empty position. The at least one empty position may be filled with a list element of the list elements, and the adjacent position may be emptied to thereby display a second subset of the list elements.

Abstract: Digital content can be viewed in a vehicle without suffering from motion sickness by use of a system which includes a vehicle and data glasses. The vehicle includes a control unit and a plurality of sensors connected to the control unit. The data glasses can be wirelessly connected to the control unit and are intended to display a virtual 3-D integrating the digital content.

Abstract: An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.

Abstract: A method for enhancing digital images during a microsurgery, e.g., an eye surgery, includes collecting digital images of target anatomy using a digital camera as the target anatomy is illuminated by warm white light. The method includes identifying, via a processor in communication with the digital camera, a predetermined stage of the microsurgery. Within the images, the processor digitally isolates a first pixel region, e.g., a pupil pixel region, from a second pixel region, e.g., an iris pixel region, and adjusts a characteristic of constituent pixels thereof. The method, possibly recorded as instructions in a computer-readable medium, may be used to enhance a red reflex at predetermined stages of an eye surgery. A system includes a lighting source for emitting warm white light having a color temperature of less than about 4000° K, the camera, and the processor.

Abstract: The invention is related to a method of presenting a digital information related to a real object, comprising determining a real object, providing a plurality of presentation modes, wherein the plurality of presentation modes comprises an augmented reality mode, and at least one of a virtual reality mode and an audio mode, providing at least one representation of a digital information related to the real object, determining a spatial relationship between a camera and a reference coordinate system under consideration of an image captured by the camera, selecting a presentation mode from the plurality of presentation modes according to the spatial relationship, and presenting the at least one representation of the digital information using the selected presentation mode.

Abstract: The present disclosure envisages an apparatus for communication to enable differently abled users to communicate their requirements to others. The apparatus comprises an eye wearable device adapted to emit infrared light signal from a certain area of at least one eye of the user. The apparatus further includes a monitoring device configured to receive the transmitted infrared light signal from the at least one eye of the user and further configured to identify the requirement of the user corresponding to the transmitted infrared light signal.

Abstract: A method (200) of activating a display screen of a device, includes establishing (201) a connection with each of one or more candidate display screens (119). A direction of gaze (121) of an eye of a user (117) is tracked (203), and a display screen (119) is selected (207) from the one or more candidate display screens when (205) the display screen (119) is in the direction of gaze (121) of the eye of the user (117). A confirmation code (305) is caused (209) to be displayed on the selected display screen and an image of the selected display screen is obtained. The selected display screen is activated (215) in response to detecting (213) the confirmation code (305) in the updated image of the selected display screen.

Abstract: A retinal projection display system includes at least one visible light source for projecting a visible light image, an infrared light source for projecting infrared light, a scanning mirror having a field of view larger than the visible light image, a reflective surface on which the visible light image is projected and on which the infrared light is reflected at least partially towards an eye of a user, wherein the reflective surface is larger than the visible light image, at least one infrared photodetector for receiving reflected infrared light that reflects off of the eye of the user, and a hardware computation module comprising a processor and a memory, the hardware computation module configured to determine a gaze direction of the user based at least in part on the reflected infrared light.

Abstract: Techniques for visual feature based video effects are described and are implementable to determine one or more visual features associated with an individual and generate a modified video feed based on the visual features. The described implementations enable automatic focus of a video feed to a particular focal region based on facial features of the individual. For instance, a visual feature such as pupillary distance or pupil size is determined from a video feed. A focal distance is calculated based on the visual feature, e.g., indicating a region that the individual is focused on. A modified video stream is then generated based on the focal distance, for instance to focus the video stream to a specific focal plane.

Abstract: An apparatus installed in a head-mounted display (HMD) has a coupling prism formed by packing diagonally-reflective (DR) prisms together. Each DR prism has an internal diagonal plane that is at least partially reflective. A captured image of eye or environmental scene received by a DR prism is reflected to an image-leaving end surface thereof. Image-leaving end surfaces of all DR prisms are oriented along a same direction to optically multiplex the captured images to create a multi-channel image. An imaging sensor on the coupling prism images the multi-channel image, avoiding inter-channel interference caused by spillover of captured-image signals while allowing one imaging sensor instead of multiple ones to image the captured images. A micro display displays a visible image to one DR prism, whose internal diagonal plane reflects the visible image along a direction towards an eye. Hence, the apparatus also enables image displaying to a HMD wearer.

Abstract: A wearable display system for cross reality (XR) systems may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR functions being performed. For object tracking, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. Objects may be tracked based on asynchronously acquired events indicating changes within patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. Tracked objects may include a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and the wearer's head.

Abstract: The present disclosure relates to an image processing method and apparatus, a screening system, and a computer-readable storage medium. An image processing method includes: acquiring an image to be processed; extracting a first feature of the image to be processed by using a first feature extractor; performing first classification on the image to be processed according to the first feature by using a first classifier; under the condition that a classification result is a first result, extracting a second feature of the image to be processed by using a second feature extractor; performing second classification on the image to be processed according to the second feature by using a second classifier; and outputting the classification result of the second classification.

Abstract: An imaging system is provided with: a first imaging apparatus (2) that captures an image of an imaging target (T, TP) that is located at a first point (P1); a second imaging apparatus (3) a focus position of which is set at a second point (P2) that is located at a forward side along a moving direction of the imaging target than the first point; and a control apparatus (6) that controls the second imaging apparatus to capture an image of the imaging target that is located at the second point on the basis of the image (200) captured by the first imaging apparatus.

Abstract: A method is provided, including: rendering a view of a virtual environment through a virtual reality (VR) headset; detecting a gaze direction of a user that wears the VR headset; detecting a gaze focus depth of the user that wears the VR headset; detecting an electroencephalography (EEG) signal of the user that wears the VR headset; using the gaze direction and gaze focus depth of the user to identify a virtual object in the virtual environment as being actively viewed by the user; using the EEG signal to determine a concentration of the user upon the identified virtual object; responsive to determining the concentration of the user upon the identified virtual object, then rendering a graphical indicator applied to the virtual object in the view of the virtual environment.

Abstract: A camera of a virtual reality (VR) headset captures a plurality of images of a reflection of a user in a mirror. The plurality of images include at least a first image of a reflection of the user in a first position with respect to the mirror and a second image of a reflection of the user in a second position with respect to the mirror. A three-dimensional avatar is generated based on the plurality of images captured by the camera.

Abstract: A wide field fundus camera is disclosed to implement multiple illumination beam projectors and to capture multiple retinal images at various viewing angles to facilitate wide field retinal examination. The wide field fundus camera contemplates an ultra-wide field lens that can provide edge to edge imaging of the entire retina at a single alignment. The wide field fundus camera contemplates configuration of said multiple illumination beam projectors to provide visualization of retina and Purkinje reflections simultaneously to facilitate determination of proper camera alignment with the eye. The wide field fundus camera further contemplates control of multiple illumination beam projectors in a programmable manner to further assess alignment of each illumination beam projector with the eye and to capture said multiple retinal images.

Abstract: Techniques for content protection for a glasses device are described and may be implemented to enable sensitive content on a glasses device to be protected from exposure to persons other than a user of the glasses device. Generally, the described implementations utilizing sensor data such as visual data from a camera to detect human gaze to determine whether a person other than a user of a glasses device is positioned to view sensitive content displayed by the glasses device. If a secondary person other than a user of a glasses device is detected as being positioned to view sensitive content, a protection process is implemented to mitigate exposure of the sensitive content to the secondary person.

Abstract: Iris image pick-up devices perform image pick-up of an iris of a moving subject. A guiding device guides the subject. A controller predicts a period in which the subject will blink next. Further, the controller predicts a period in which the subject will pass through the focusing point of the iris image pick-up devices. The controller controls the guiding device such that the subject does not blink at the focusing point in the case where the period in which the subject will blink next overlaps with the period in which the subject will pass through the focusing point.

Abstract: End user interactions at a display are monitored for predetermined conditions to provide augmentation of display presentation by a red light that illuminates in the 650 to 800 nm range, such as at substantially 670 nm. Instructions stored in non-transient memory and executed on a processor present visual images of varied color contrast and evaluate end user inputs to determine an end user visual acuity. Over time and use of the display and red light, end user visual acuity is periodically tested to evaluate the effectiveness of red light illumination to restore visual acuity.

Abstract: An operator behavior monitoring system, which includes: an operator behavior recognition system comprising hardware including a processor, a data storage facility and input/output interfaces, the system being configured to implement a set of convolutional neural networks including: an object detection group for detecting an object in the image and to delineate the object from the image; a feature extraction group which extracts features of the object detected by the object detection group; a classifier group which assess the features and classifying the features into a events and which is operable to report the events to a remote server; a server operable to communicate with the operator behavior recognition system for receiving predefined events detected by the operator behavior recognition system; a database in communication with the server, operable to store and retrieve detected operator incidents; and a web frontend, in communication with the server for interfacing with the server.

Abstract: Provided is an information processing device including: a control unit that performs position detection of an object, on which a light emitting unit or a reflective material is provided, on the basis of a captured image acquired by imaging of emitted light or reflected light of the object in a direction facing a side, on which the light emitting unit or the reflective material is provided, of the object, wherein the control unit adjusts algorithm for the position detection of the object according to an illuminance detection result of external light including at least a wavelength of the emitted light or the reflected light.

Abstract: Apparatuses, methods, systems, and program products are disclosed for capturing an image and determining whether a switch is in a filtering position or a non-filtering position. When the switch is in the filtering position, the camera apparatus detects a switch position and determines whether the switch is in the filtering position or the non-filtering position. The camera captures the image, including audio/visual signals, while the switch is detected to be in the filtering position and modifies the image to inhibit biometric data collection from the image in response to the switch being in the filtering position when the image is captured.

Abstract: A driver monitoring system of a vehicle includes: a camera configured to capture an image of a driver on a driver's seat within a passenger cabin of the vehicle; a gaze module configured to determine a gaze vector based on a direction of pupils of the driver in the image; an area module configured to determine an area on a vertical plane in front of the driver based on a road in front of the vehicle; a location module configured to determine a location on the vertical plane where the gaze vector intersects the vertical plane; and a monitor module that determines whether the location on the vertical plane where the gaze vector intersects the vertical plane is within the area on the vertical plane.

Abstract: Disclosed herein are methods, apparatus, and systems for iris recognition. A method includes acquiring at least two angularly differentiated iris images from a subject needing access, processing each of the at least two angularly differentiated iris images to generate at least one boundary delineated image from one of the at least two angularly differentiated iris images, applying image comparative analysis to the at least two angularly differentiated iris images to generate a boundary delineated image when the processing fails to produce the at least one boundary delineated image, segmenting and encoding one of the at least one boundary delineated image or the boundary delineated image to generate at least one iris template, matching the at least one iris template against an enrolled iris, and accepting the subject for access processing when the at least one iris template matches the enrolled iris.

Abstract: Provided herein are systems and methods for automatically limiting video surveillance collection to authorized uses and authorized users. To achieve this control, the authorization system can be configured to manage and secure a plurality of crypto keys associated with encrypting a plurality of corresponding video footages and release a crypto key for a video footage at approved times to limit user access to the video footage. In particular, the surveillance system can generate a video collection including a copy of portions of a received video footage that include one or more approved events from a watchlist of a user. Thereafter, the video footage can be encrypted by a first key managed by the authorization system and prevents the user from accessing video content of the video footage once encrypted. Accordingly, the user may be limited to accessing the video collection and not all the portions in the encrypted video footage.

Abstract: An information handling system camera is secured against unauthorized image captures by a shutter that mechanically closes across the camera lens to block visible light from entering the camera. The shutter integrates an infrared bypass filter that passes through infrared light while blocking visible light so that the camera can support facial recognition when the mechanical shutter secures the camera to prevent unauthorized capture of visual images.

Abstract: A non-contact body temperature detection system of a vehicle includes: a thermography camera configured to generate an image of a user within a passenger cabin of the vehicle; a head detection module configured to determine a first area of the image including a head of the user; an eye detection module configured to determine a second area of the first area of the image including an eye of the user; a tear duct detection module configured to determine a third area of the second area of the image including a tear duct of the user; a temperature module configured to determine a body temperature of the user based on pixels of the third area of the image; and an indicator module configured to indicate whether the user has an elevated body temperature when the body temperature of the user is greater than a temperature threshold.

Abstract: An iris image acquisition system for expanding an iris recognition range is proposed. The iris image acquisition system for expanding the iris recognition range enables that a direction, zoom, and focusing of an iris photographing camera for photographing an iris image of a distant subject are controlled quickly and easily without high-level information processing and arithmetic processing.

Abstract: A dynamic illuminator includes a central aperture, a ring of inner light sources, a plurality of primary illumination arrays, and a plurality of secondary illumination arrays. The ring of inner light sources is arranged around the central aperture. The plurality of primary illumination arrays extends along radial axes from the central aperture outside of the ring of inner light sources, wherein the primary illumination arrays each includes a plurality of primary light sources. The plurality of secondary illumination arrays is disposed along secondary axes extending from the central aperture outside of the ring of inner light sources. The secondary illumination arrays each includes a plurality of secondary light sources. The secondary axes of the secondary illumination arrays are disposed angularly between adjacent ones of the primary illumination arrays.

Abstract: A system includes a diffractive optical element including at least one substrate and a grating structure. The grating structure is configured to diffract a first light having an incidence angle within a predetermined range, and the at least one substrate is configured to reflect a second light. The system also includes a polarization selective mechanism configured to generate images based on the first light and the second light, respectively.

Abstract: Data is computed in order to visualize the velocity of blood fluid flowing through a blood vessel at a fundus. An image processing method includes a step of performing registration of each frame in a moving image configured by plural frames of an imaged fundus, and a step of computing visualization data enabling visualization of a state of blood fluid flowing through a blood vessel at the fundus based on a pixel value in each of the registered frames.

Abstract: Disclosed are methods and systems that include obtaining at least one image of a dendritic structure, analyzing the at least one image to identify one or more features associated with the dendritic structure, and determining a numerical value associated with the dendritic structure based on the one or more features.

Abstract: An eye tracking system can include a first camera configured to capture a first plurality of visual data of a right eye at a first sampling rate. The system can include a second camera configured to capture a second plurality of visual data of a left eye at a second sampling rate. The second plurality of visual data can be captured during different sampling times than the first plurality of visual data. The system can estimate, based on at least some visual data of the first and second plurality of visual data, visual data of at least one of the right or left eye at a sampling time during which visual data of an eye for which the visual data is being estimated are not being captured. Eye movements of the eye based on at least some of the estimated visual data and at least some visual data of the first or second plurality of visual data can be determined.

Abstract: A device includes a frame configured to be supported in front of a user eye. The frame has a first side facing the user eye and a second side opposite the first side and facing an environment. A light emitting diode is supported by the frame to emit light. The light emitting diode is obscured by an opaque material from an observer in front of the user in the environment. A light deflector is supported by the frame to direct the emitted light from the light emitting diode towards the user eye.

Abstract: The present disclosure relates to an apparatus for adjusting a steering wheel, which include: a camera unit installed inside a vehicle to photograph a driver's face; and a control unit which processes an image photographed by the camera unit to detect a face shape, checks whether higher and lower portions of detected face are photographed in an optimal face shape without being cut off, and outputs designated steering wheel adjustment information when the face shape is not the optimal face shape.

Abstract: An eye tracking system comprises at least one illuminator and at least one image sensor configured to produce an image of an eye of a user, the image including illuminator light reflected from the eye of a user. A Fresnel lens is positioned between the image sensor and the eye of the user, through which the image sensor views the eye. Processing circuitry receives an image from the image sensor, identifies glints in the image, assigns an angular position to each glint based on an angular relationship between each glint and a centre of the Fresnel lens and determines how many glints have the same angular position. Glints are classified as false glints if more than a predetermined number of glints have the same angular position.

Abstract: Embodiments are disclosed for using an apparatus to perform pupil identification. An example method includes toggling circuitry configured to determine, based on a measured ambient infrared light level, whether to perform pupil identification using one of either the dark pupil identification process or the bright pupil identification process; and pupil identification circuitry configured to perform pupil identification on a user using the bright identification process upon the determination that the measured ambient infrared light level falls within a first range and to perform dark pupil identification process upon the determination that the measured ambient infrared light level falls within a second range. Corresponding apparatuses and non-transitory computer readable storage media are also provided.

Abstract: An electronic apparatus includes a control unit that performs control to acquire first orientation information indicating a first orientation of the body and first line-of-sight information about the user's line-of-sight, of a case where a first eye tracking calibration display is displayed on the screen, acquire second orientation information indicating a second orientation of the body different from the first orientation and second line-of-sight information about the user's line-of-sight, of a case where a second eye tracking calibration display is displayed on the screen, and cause, in a case where the second orientation information is different from the first orientation information, the screen to display a predetermined display that prompts the user to change the orientation of the body to the first orientation.

Abstract: The optical coherence tomography apparatus is an optical coherence tomography apparatus that obtains a tomographic image of an eye to be examined by using combined light obtained by combining (a) return light from the eye to be examined irradiated with measurement light and (b) reference light, the optical coherence tomography apparatus including an optical path length difference changing unit arranged to change an optical path length difference between the measurement light and the reference light, a driving unit arranged to drive the optical path length difference changing unit, a determining unit configured to determine, using a learned model, a driving amount of the driving unit from the obtained tomographic image, and a controlling unit configured to control the driving unit using the determined driving amount.

Abstract: An eye tracking system configured to: receive a plurality of right eye images of a right eye of a user; receive a plurality of left eye images of a left eye of a user, each left eye image corresponding to a right eye image in the plurality of right eye images; detect a pupil and determine an associated pupil signal, for each of the plurality of right eye images and each of the plurality of left eye images; calculate a right eye pupil variation of the pupil signals for the plurality of right eye images and a left eye pupil variation of the pupil signals for the plurality of left eye images; and determine a right eye weighting and a left eye weighting based on the right eye pupil variation and the left eye pupil variation.

Abstract: The present disclosure relates to a computer implemented method and system for obtaining an image sensor exposure setting for use in capturing an image using a main flash.