Abstract: A processor divides a fundus region of an ultra-wide field fundus image into plural areas including at least a first area and a second area, generates first attribute information indicating an attribute of the first area and second attribute information indicating an attribute of the second area, and generates first mode instruction information to instruct display of the first area in a first mode corresponding to the first attribute information, and generates second mode instruction information to instruct display of the second area in a second mode corresponding to the second attribute information.

Abstract: A method may include capturing an image at a camera included at an information handling system, the camera coupled to a vision system. A position of a user relative to a display device may be determined based on analysis of the image by the vision system. The method may further include adjusting properties of an audio signal provided to a speaker based on the position of the user.

Abstract: A line-of-sight detection device includes a display unit configured to display an image, light sources configured to emit detection light to apply the detection light to an eyeball of a subject, an imaging unit configured to capture an image of the eyeball to which the detection light is applied, a position detection unit configured to detect, from the captured image, a position of a pupil center of the eyeball to which the detection light is applied and a position of a corneal reflex center, a gaze point detection unit configured to calculate a position of a gaze point of the subject based on the positions of the pupil center and corneal reflex center, and a light source control unit configured to change the light source for emitting the detection light among the light sources based on a target distance between the pupil center and the corneal reflex center.

Abstract: A control apparatus is configured to control a display apparatus for displaying a partial image based on a partial area of an omnidirectional image or hemispherical image on a display surface. The control apparatus includes a memory storing instructions; and a processor configured to execute the instructions to generate the partial image by performing transformation processing for the partial area of the omnidirectional image or hemispherical image, detect a first position of a line of sight of a user on the display surface, and generate a first partial image based on the first position and display the first partial image on the display surface in a case where the first position is located within a predetermined area for a predetermined duration.

Abstract: An imaging system is provided with: a first imaging apparatus (2) that captures an image of an imaging target (T, TP) that is located at a first point (P1); a second imaging apparatus (3) a focus position of which is set at a second point (P2) that is located at a forward side along a moving direction of the imaging target than the first point; and a control apparatus (6) that controls the second imaging apparatus to capture an image of the imaging target that is located at the second point on the basis of the image (200) captured by the first imaging apparatus.

Abstract: An embodiment of an adaptive video encoder may determine headset-related information including at least one of focus-related information and motion-related information and determine one or more video encode parameters based on the headset-related information. The adaptive video encoder may also encode a macroblock of a video image based on the one or more determined video encode parameters. Other embodiments are disclosed and claimed.

Abstract: An ophthalmic apparatus is provided that includes: an optical head unit; an information obtaining unit that, using a learned model obtained by learning information of a position relating to at least one of an eye to be examined and an optical head unit, obtains information of a position relating to at least one of an eye to be examined and the optical head unit from an image relating to an eye to be examined that is obtained using the optical head unit; and a drive controlling unit that controls driving of at least one of a supporter that supports a face of a subject and the optical head unit; in which, based on the obtained information of the position, the drive controlling unit controls the driving to cause at least one of the eye to be examined and the optical head unit to move to the position.

Abstract: Disclosed herein are methods and systems that use a photonic crystal (PC) for interference scattering microscopy. Incident light is directed onto a surface of the PC and couples into a photonic crystal guided resonance (PCGR) mode of the PC such that less than 1% of the incident light is transmitted through the PC as transmitted light. One or more particles adjacent to the surface of the PC scatter a portion of the light coupled into the PCGR mode as scattered light. An image comprising a pattern of constructive and destructive interference between the transmitted light and the scattered light is formed, and an image sensor may capture one or more image frames of the image. Imaging processing of the one or more image frames can be used to identify at least one scattering center corresponding to at least one particle of the one or more particles.

Abstract: Embodiments of this application provide a display device module, including a display panel, a non-coaxial optical component, a first optical element, and a second optical element. The non-coaxial optical component includes an incident surface and an emergent surface, and the incident surface of the non-coaxial optical component faces the display panel, so that light emitted by the display panel is capable of being transmitted through the incident surface and transmitted from the emergent surface. In this application, a thickness of a display module in a head-mounted display device in a viewing direction of human eyes is reduced, and a compact design of the head-mounted display device is implemented.

Abstract: Embodiments include methods of activating a display screen of a device. Such methods include establishing respective connections with one or more candidate devices, each having a candidate display screen, and obtaining angle of arrival information of respective signals transmitted from the candidate display screens or from the candidate devices. Such methods include selecting a display screen from the candidate display screens based on the angle of arrival information indicating that selected display screen is in a direction of gaze of the eye of the user, causing a confirmation code to be displayed on the selected display screen, and obtaining an image of the selected display screen having the confirmation code displayed thereon. Such methods include activating the selected display screen from an off or locked state based on detecting the confirmation code in the obtained image. Other embodiments include host systems configured to perform such methods.

Abstract: A method for enhancing digital images during an eye surgery includes producing warm white light via a lighting source by blocking blue and green wavelengths of light using an excitation filter. The method includes illuminating a pupil and iris of the eye with the warm white light during the eye surgery and collecting digital images of target anatomy using a digital camera. Within the images, a processor digitally isolates a pupil pixel region from an iris pixel region and adjusts a characteristic of constituent pixels of one of the regions. The method may be performed by executing instructions from a computer-readable storage medium to enhance a red reflex at predetermined stages of an eye surgery.

Abstract: An example method includes identifying at least one image of an eye of a patient. The method further includes detecting, by a first computing model, at least one first feature in the at least one image and detecting, by a second computing model, at least one second feature in the at least one image. Further, using a third computing model that is different than the first computing model or the second computing model, the method includes identifying a likelihood that the patient has one or more diseases consistent with the at least one feature and the at least one second feature. A recommendation for care of the patient is generated based on the likelihood.

Abstract: An information processing apparatus includes a memory which temporarily stores a program of a system and programs running on the system; and a processor which executes processing based on the programs stored in the memory. The processor performs first processing to perform control between display on and display off of a display unit based on the program of the system and control the brightness of the display unit in the display-on state based on a brightness setting value, second processing to change the brightness setting value based on a program running on the system in the display-on state, and third processing in which, when performing control from the display-on state to the display off by the first processing, the brightness setting value changed by the second processing based on the program running on the system is restored to the brightness setting value before change.

Abstract: An electronic device includes at least one memory storing instructions; and at least one processor which, upon execution of the instructions, configures the at least one processor to function as: an estimation unit configured to estimate a gaze area of a user; and a selection unit configured to select a selection area from one or more candidate areas based on the gaze area.

Abstract: The disclosed techniques provide enhanced eye tracking systems utilizing joint estimation of biological parameters and hardware parameters. A system uses joint estimation of biological parameters, e.g., direction and position of an eye, with concurrent estimation of hardware parameters, e.g., camera position or camera direction, to self-calibrate and provide eye tracking estimations to accommodate for deformations and other changes of a device. Sensor data is used to select hardware parameters of a camera for use in the joint estimation with the biological parameters, where the hardware parameters are estimated based on glint and pupil position of a user. The disclosed techniques include a method to model changes of a device, as well as detect and compensate for them while the eye-tracking device is in normal use, without requiring a factory-calibration procedure to be repeated.

Abstract: A method for reading sensory augmentation comprising displaying a text on a reading device, determining a reader's current location in the text with a gaze tracking system, identifying a subsequent location in the text, processing the text at the subsequent location with an emotion processing unit to predict an emotional response to the text at the subsequent location, generating a sensory augmentation routine based on the predicted emotional response, and initiating playback of the sensory augmentation routine at the subsequent location in the text. The sensory augmentation routine can include a musical composition, a sound, and/or an ambient lighting effect. The gaze tracking system can be configured to receive data from the reading device related to the text currently displayed thereon and to receive data from an image capture device related to eye movement tracking of the reader.

Abstract: Tracking an eye characteristic (e.g., gaze direction or pupil position) of a user's eyes by staggering image capture and using a predicted relationship between the user's eyes between eye captures to predict that eye's eye characteristic between those eye captures. Images of a user's eyes are captured in a staggered manner in the sense that the images of second eye are captured between the capture times of the images of the first eye and vice versa. An eye characteristic of the first eye at the capture times is determined based on the images of the first eye at those times. In addition, the eye characteristic of that first eye is predicted at additional times between captures based on a predicted relationship between the eyes.

Abstract: The present disclosure relates to a high precision method, model, and apparatus for calibrating the intrinsic camera parameter values of one or more intrinsic parameters of a camera. The intrinsic parameters include focal lengths, skew, optical center, and radial distortion coefficients. The practical implementation of the solution consists of a camera capturing several images of a planar calibration pattern from different viewpoints, and a computer implemented processing pipeline. The solution does not require additional human input and is robust to misdetection of the calibration pattern in some of the images.

Abstract: Systems and methods are provided for increasing driver awareness of external audible and visual alerts. The external alerts may be detected by external sensors of a vehicle. Systems may use internal sensors to determine whether a driver of the vehicle appears aware of the external alert or whether the external alert is detectable inside the vehicle. If the driver does not appear aware of the external alert, or the external alert is not detectable inside the vehicle, the vehicle may broadcast an internal alert to the driver. The internal alert may be one or more of a visual alert, an audible alert, or a tactile alert.

Abstract: An imaging system (10) according to the disclosure includes: a first control unit (11) configured to control, in such a way as to fix a focal position in a predetermined position, an iris imaging means for capturing an image focusing on an iris of a target person; an authentication unit (12) configured to authenticate the target person, based on an iris image of the target person being captured by the iris imaging means controlled by the first control unit (11); and a second control unit (13) configured to control the iris imaging means in such a way as to scan a focal position in a predetermined range, in order to re-authenticate the target person when authentication of the target person fails.

Abstract: Methods and systems for displaying an overlay superimposed with an intraoperative image of surgical field in a medical ophthalmic procedure, such that the overlay appears at a desired depth within the image are provided. Methods and system for displaying an overlay superimposed with a stereoscopic intraoperative image pair of a surgical field in a medical ophthalmic procedure are provided.

Abstract: Disclosed herein are methods, apparatus, and systems for iris recognition. A method includes acquiring at least two angularly differentiated iris images from a subject needing access, processing each of the at least two angularly differentiated iris images to generate at least one boundary delineated image from one of the at least two angularly differentiated iris images, applying image comparative analysis to the at least two angularly differentiated iris images to generate a boundary delineated image when the processing fails to produce the at least one boundary delineated image, segmenting and encoding one of the at least one boundary delineated image or the boundary delineated image to generate at least one iris template, matching the at least one iris template against an enrolled iris, and accepting the subject for access processing when the at least one iris template matches the enrolled iris.

Abstract: Provided are a method and an apparatus for detecting a delay amount of an eyeball tracking apparatus, an eyeball tracking system, and a non-transitory computer-readable storage medium. The method includes: receiving a detected gaze point coordinate of a mechanical eye at the at least one detection time point; determining an actual gaze point coordinate of the mechanical eye at the at least one detection time point; and determining the delay amount of the eyeball tracking apparatus according to a coordinate difference between the actual gaze point coordinate and the detected gaze point coordinate at the at least one detection time point.

Abstract: A method for monitoring occupants of a vehicle comprises identifying a respective body region for one or more occupants of the vehicle within an obtained image; identifying within the body regions, skeletal points including points on an arm of a body; identifying one or more hand regions; and determining a hand region to be either a left or a right hand of an occupant in accordance with its spatial relationship with identified skeletal points of the body region of an occupant. The left or right hand region for the occupant are provided to a pair of classifiers to provide an activity classification for the occupant, a first classifier being trained with images of hands of occupants in states where objects involved are not visible and a second classifier being trained with images of occupants in the states where the objects are visible in at least one hand region.

Abstract: Introduced here are techniques to accurately and efficiently generate an image indicative of a fundus. An imaging device engaged to an ophthalmology device, such as an indirect ophthalmoscope, may capture a series of images of a fundus. The series of images may be segmented to identify a region of interest (ROI) representing the fundus in each image. The segmented series of images may be projected onto a coordinate space to remove any distortion in each of the series of images. The projected segmented series of images may be combined into an output fundus image. As a result, the output fundus image may remove distortion and glare included in the input images. The output fundus image may be utilized in detection and diagnosis of various conditions and diseases.

Abstract: An apparatus for generating an alert indicating an unreliability in a location of a landmark feature in a retinal image predicted by a machine learning algorithm, comprising: a receiver module which receives the predicted location; a probability indication determining module which uses the predicted location and a mixture model, which comprises a probability distribution of a landmark feature location and is based on determined locations of the landmark feature in retinal images having a plurality of retinal image classes, to determine, for each class, a respective probability indication indicating a probability that the retinal image belongs to the class; an outlier detector module which uses the probability indications to determine whether the retinal image is an outlier belonging to none of the classes; and an alert generator module which generates, when the retinal image belongs to none of the classes, an alert indicating unreliability of the predicted location.

Abstract: An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.

Abstract: A computing system may perform image processing on image data acquired by a camera at a property to determine at least a first feature of the image data. Based at least in part on a determination that the first feature satisfies a rule, the computing system may generate a vector representing a plurality of characteristics of a face represented in the image data. The vector may then be used to determine a particular person is represented in the image data.

Abstract: The present invention relates to a system for acquiring and visualizing OCT signals, comprising an OCT system and a display means designed for the time-resolved display of image data. The system further comprises a control unit configured to drive the OCT system to acquire a time-resolved OCT signal of a selected field of view of the sample and to determine a time-resolved OCT image on the basis of the acquired time-resolved OCT signal and a specifiable virtual viewing direction and to display the time-resolved OCT image on the display means. The present invention also relates to a corresponding method for acquiring and visualizing OCT signals.

Abstract: Techniques for optimizing which LEDs in a HMD to use, the brightness of those LEDs, and camera exposure are divulged based on the particular function to be performed. For instance, one set of optimization parameters may be implemented for eye tracking purposes while a different set of optimization parameters may be implemented for eye-based authentication purposes.

Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.

Abstract: A wearable electronic device with a display is provided. The wearable electronic device includes: a stereo camera configured to detect infrared light, a self-luminous display including a plurality of visible light pixels configured to output visible light corresponding to a virtual object image and a plurality of infrared pixels configured to output infrared light, an optical waveguide configured to output the virtual object image by adjusting a path of the visible light, a first control circuit configured to supply driving power and a control signal to the self-luminous display, and a second control circuit configured to supply driving power and a control signal to the stereo camera. The optical waveguide includes a half mirror configured to output reflected infrared light and transmitted infrared light in response to the output infrared light.

Abstract: A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).

Abstract: Described techniques enable displaying a plurality of positions arranged around a central location on a display, the plurality of positions including at least one empty position and filled positions displaying a first subset of list elements, the filled positions including an adjacent position that is adjacent to the at least one empty position. Movement of a gaze point may be tracked, relative to the filled positions and around the central location towards the at least one empty position. The at least one empty position may be filled with a list element of the list elements, and the adjacent position may be emptied to thereby display a second subset of the list elements.

Abstract: Digital content can be viewed in a vehicle without suffering from motion sickness by use of a system which includes a vehicle and data glasses. The vehicle includes a control unit and a plurality of sensors connected to the control unit. The data glasses can be wirelessly connected to the control unit and are intended to display a virtual 3-D integrating the digital content.

Abstract: An information providing device according to one aspect of the present disclosure includes: at least one memory storing a set of instructions; and at least one processor configured to execute the set of instructions to: receive a face image; determine whether a person in the face image is unsuitable for iris data acquisition based on the face image; and output information based on determining that the person is unsuitable for the iris data acquisition when the person is determined to be unsuitable for the iris data acquisition.

Abstract: A method for enhancing digital images during a microsurgery, e.g., an eye surgery, includes collecting digital images of target anatomy using a digital camera as the target anatomy is illuminated by warm white light. The method includes identifying, via a processor in communication with the digital camera, a predetermined stage of the microsurgery. Within the images, the processor digitally isolates a first pixel region, e.g., a pupil pixel region, from a second pixel region, e.g., an iris pixel region, and adjusts a characteristic of constituent pixels thereof. The method, possibly recorded as instructions in a computer-readable medium, may be used to enhance a red reflex at predetermined stages of an eye surgery. A system includes a lighting source for emitting warm white light having a color temperature of less than about 4000° K, the camera, and the processor.

Abstract: The invention is related to a method of presenting a digital information related to a real object, comprising determining a real object, providing a plurality of presentation modes, wherein the plurality of presentation modes comprises an augmented reality mode, and at least one of a virtual reality mode and an audio mode, providing at least one representation of a digital information related to the real object, determining a spatial relationship between a camera and a reference coordinate system under consideration of an image captured by the camera, selecting a presentation mode from the plurality of presentation modes according to the spatial relationship, and presenting the at least one representation of the digital information using the selected presentation mode.

Abstract: The present disclosure envisages an apparatus for communication to enable differently abled users to communicate their requirements to others. The apparatus comprises an eye wearable device adapted to emit infrared light signal from a certain area of at least one eye of the user. The apparatus further includes a monitoring device configured to receive the transmitted infrared light signal from the at least one eye of the user and further configured to identify the requirement of the user corresponding to the transmitted infrared light signal.

Abstract: A method (200) of activating a display screen of a device, includes establishing (201) a connection with each of one or more candidate display screens (119). A direction of gaze (121) of an eye of a user (117) is tracked (203), and a display screen (119) is selected (207) from the one or more candidate display screens when (205) the display screen (119) is in the direction of gaze (121) of the eye of the user (117). A confirmation code (305) is caused (209) to be displayed on the selected display screen and an image of the selected display screen is obtained. The selected display screen is activated (215) in response to detecting (213) the confirmation code (305) in the updated image of the selected display screen.

Abstract: A retinal projection display system includes at least one visible light source for projecting a visible light image, an infrared light source for projecting infrared light, a scanning mirror having a field of view larger than the visible light image, a reflective surface on which the visible light image is projected and on which the infrared light is reflected at least partially towards an eye of a user, wherein the reflective surface is larger than the visible light image, at least one infrared photodetector for receiving reflected infrared light that reflects off of the eye of the user, and a hardware computation module comprising a processor and a memory, the hardware computation module configured to determine a gaze direction of the user based at least in part on the reflected infrared light.

Abstract: An apparatus installed in a head-mounted display (HMD) has a coupling prism formed by packing diagonally-reflective (DR) prisms together. Each DR prism has an internal diagonal plane that is at least partially reflective. A captured image of eye or environmental scene received by a DR prism is reflected to an image-leaving end surface thereof. Image-leaving end surfaces of all DR prisms are oriented along a same direction to optically multiplex the captured images to create a multi-channel image. An imaging sensor on the coupling prism images the multi-channel image, avoiding inter-channel interference caused by spillover of captured-image signals while allowing one imaging sensor instead of multiple ones to image the captured images. A micro display displays a visible image to one DR prism, whose internal diagonal plane reflects the visible image along a direction towards an eye. Hence, the apparatus also enables image displaying to a HMD wearer.

Abstract: Techniques for visual feature based video effects are described and are implementable to determine one or more visual features associated with an individual and generate a modified video feed based on the visual features. The described implementations enable automatic focus of a video feed to a particular focal region based on facial features of the individual. For instance, a visual feature such as pupillary distance or pupil size is determined from a video feed. A focal distance is calculated based on the visual feature, e.g., indicating a region that the individual is focused on. A modified video stream is then generated based on the focal distance, for instance to focus the video stream to a specific focal plane.

Abstract: A wearable display system for cross reality (XR) systems may have a dynamic vision sensor (DVS) camera and a color camera. At least one of the cameras may be a plenoptic camera. The wearable display system may dynamically restrict processing of image data from either or both cameras based on detected conditions and XR functions being performed. For object tracking, image information may be processed for patches of a field of view of either or both cameras corresponding to the object. Objects may be tracked based on asynchronously acquired events indicating changes within patches. Stereoscopic or other types of image information may be used when event-based object tacking yields an inadequate quality metric. Tracked objects may include a user's hand or a stationary object in the physical world, enabling calculation of the pose of the wearable display system and the wearer's head.

Abstract: The present disclosure relates to an image processing method and apparatus, a screening system, and a computer-readable storage medium. An image processing method includes: acquiring an image to be processed; extracting a first feature of the image to be processed by using a first feature extractor; performing first classification on the image to be processed according to the first feature by using a first classifier; under the condition that a classification result is a first result, extracting a second feature of the image to be processed by using a second feature extractor; performing second classification on the image to be processed according to the second feature by using a second classifier; and outputting the classification result of the second classification.

Abstract: A camera of a virtual reality (VR) headset captures a plurality of images of a reflection of a user in a mirror. The plurality of images include at least a first image of a reflection of the user in a first position with respect to the mirror and a second image of a reflection of the user in a second position with respect to the mirror. A three-dimensional avatar is generated based on the plurality of images captured by the camera.

Abstract: An imaging system is provided with: a first imaging apparatus (2) that captures an image of an imaging target (T, TP) that is located at a first point (P1); a second imaging apparatus (3) a focus position of which is set at a second point (P2) that is located at a forward side along a moving direction of the imaging target than the first point; and a control apparatus (6) that controls the second imaging apparatus to capture an image of the imaging target that is located at the second point on the basis of the image (200) captured by the first imaging apparatus.

Abstract: A method is provided, including: rendering a view of a virtual environment through a virtual reality (VR) headset; detecting a gaze direction of a user that wears the VR headset; detecting a gaze focus depth of the user that wears the VR headset; detecting an electroencephalography (EEG) signal of the user that wears the VR headset; using the gaze direction and gaze focus depth of the user to identify a virtual object in the virtual environment as being actively viewed by the user; using the EEG signal to determine a concentration of the user upon the identified virtual object; responsive to determining the concentration of the user upon the identified virtual object, then rendering a graphical indicator applied to the virtual object in the view of the virtual environment.

Abstract: A wide field fundus camera is disclosed to implement multiple illumination beam projectors and to capture multiple retinal images at various viewing angles to facilitate wide field retinal examination. The wide field fundus camera contemplates an ultra-wide field lens that can provide edge to edge imaging of the entire retina at a single alignment. The wide field fundus camera contemplates configuration of said multiple illumination beam projectors to provide visualization of retina and Purkinje reflections simultaneously to facilitate determination of proper camera alignment with the eye. The wide field fundus camera further contemplates control of multiple illumination beam projectors in a programmable manner to further assess alignment of each illumination beam projector with the eye and to capture said multiple retinal images.

Abstract: Techniques for content protection for a glasses device are described and may be implemented to enable sensitive content on a glasses device to be protected from exposure to persons other than a user of the glasses device. Generally, the described implementations utilizing sensor data such as visual data from a camera to detect human gaze to determine whether a person other than a user of a glasses device is positioned to view sensitive content displayed by the glasses device. If a secondary person other than a user of a glasses device is detected as being positioned to view sensitive content, a protection process is implemented to mitigate exposure of the sensitive content to the secondary person.