Abstract: The disclosure is inputting a first image obtained by capturing an object of authentication moving in a specific direction; inputting a second image at least for one eye obtained by capturing a right eye or a left eye of the object; determining whether the second image is of the left eye or the right eye of the object, based on information including the first image, and outputting a determination result associated with the second image as left/right information; comparing characteristic information relevant to the left/right information, the characteristic information being acquired from a memory that stores the characteristic information of a right eye and a left eye pertaining to object to be authenticated, with characteristic information associated with the left/right information, and calculating a verification score; and authenticating the object captured in the first image and the second image, based on the verification score, and outputting an authentication result.

Abstract: A gaze monitoring system comprising: an eye tracker comprising; a camera having an optical axis; a first IR source configured to illuminate a user's eyes; the first IR source located relatively near the optical axis of the camera; and at least one second IR source configured to illuminate the user's eyes, the at least one second IR source located relatively far from the camera's optical axis, in a position such that when the gaze angle is too large to get corneal reflection images of the first IR source, the image reflection of the at least one second IR source is visible by the camera, as a corneal reflection.

Abstract: A controller is configured to determine a position of an object point in a real space, based on a cornea image of a first eye and a cornea image of a second eye of a user who is viewing the object point, in a captured image generated by imaging the first and second eyes of the user by an imaging device.

Abstract: A control system, computer-readable storage medium and method of preventing occlusion of and minimizing shadows on the driver's face for driver monitoring. The system includes a steering wheel, a plurality of fiberscopes arranged evenly spaced around the steering wheel, and one or more video cameras arranged at remote ends of the plurality of fiberscopes. Distal ends of the fiberscopes emerge to a surface of the steering wheel through holes that are perpendicular to an axis of rotation of the steering wheel. Each of the distal ends of the fiberscopes includes a lens. The system includes a plurality of light sources and an electronic control unit connected to the one or more video cameras and the light sources.

Abstract: An image acquisition system includes: a first narrowband light source that emits first narrowband light for exciting a luminescent agent that exists in an observation target and emits light having a wavelength belonging to a visible light wavelength band; a second narrowband light source that emits second narrowband light in a wavelength band of ±30 nm of a peak light emission wavelength of the luminescent agent; a broadband light source that emits broadband light for illuminating the observation target; a first image sensor on which an image of light in a light emission wavelength band including a wavelength corresponding to light emitted from the luminescent agent is formed; and a second image sensor including one or more image sensors on which an image of light in a wavelength band other than the light emission wavelength band is formed.

Abstract: A head-worn see-through display includes a display panel adapted to generate image content light, a combiner adapted to reflect the image content light towards an eye of a user, wherein the combiner transmits scene light from a surrounding environment to the eye of the user, and an image expansion optic intermediate the display panel and the combiner. The image expansion optic includes a flat partially reflective and partially reflective surface (the “flat surface”), a curved partially reflective and partially reflective surface (the “curved surface”), and the flat surface adapted to reflect the image content light towards the curved surface and the curved surface adapted to reflect the image light back towards the flat surface, wherein the image light transmits through the flat surface towards the combiner.

Abstract: A reception unit receives an eye direction input that is an input based on an eye tracking process, and a control unit controls movement of a selected position based on an operation on an operation member. The control unit performs control such that, in a first state in which the selected position is not designated based on the eye direction input, the selected position is moved, in response to the operation member being operated by a predetermined operation amount, by a first amount from a position set before the operation member is operated, and that, in a second state in which the selected position is designated based on the eye direction input, the selected position is moved, in response to the operation member being operated by the predetermined operation amount, by a second amount smaller than the first amount from a position based on the eye direction input.

Abstract: It is desired to provide a technology capable of controlling an object so as to improve user convenience. An information processing apparatus is provided. The information processing apparatus includes an object control unit that: suppresses a movement of a first object, on the basis of a first line-of-sight movement in which a gaze point of a user moves toward a first part of the first object or has moved to the first part; and moves the first object such that the first object leaves away from the gaze point of the user, on the basis of a second line-of-sight movement in which the gaze point of the user moves toward a second part of the first object different from the first part or has moved to the second part.

Abstract: Interacting between users of mobile devices is provided by initiating a desired interaction at a first user device using a gesture sensed by the first user device, determining a gesture area, submitting a desired interaction request for interaction with associated users within the gesture area, and sending a notification to user devices indicating the desired interaction of the first user with one or more users of a local subset, wherein the notification identifies the first user with an identifier independent of identifiers used by the first user outside of interactions with a remote server.

Abstract: Systems, devices, and methods are described for assessing the risk of developmental, cognitive, social, or mental abilities or disabilities in very young patients (e.g., in the first 2-6 months of life). Generally, the decline in visual fixation of a subject over time with respect to certain dynamic stimuli provides a marker of possible abilities or disabilities (such as ASD). The visual fixation of the subject is identified, monitored, and tracked over time through repeated eye tracking sessions, and data relating to the visual fixation is then analyzed to determine a possible increased risk certain conditions in the subject. A change in visual fixation as compared to similar visual fixation data of typically-developing subjects or to a subject's own, prior visual fixation data provides an indication of a developmental, cognitive, or mental ability or disability.

Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.

Abstract: Vehicles and systems and methods for determining a viewing direction of a user are disclosed. In one embodiment, a system for detecting a viewing direction of a user includes a marker arranged at a fixed location, and an optical assembly. The optical assembly includes a first optical sensor arranged to view the marker, and a second optical sensor arranged to view the user. The first optical sensor detects the marker for determining a spatial location of the optical assembly with respect to the marker, and the second optical sensor detects an eye of the user for determining an eye angle of the user.

Abstract: An embodiment of a mind-view communication apparatus includes a first portable unit and a second portable unit. The first portable unit includes an eyeglass frame, at least one first optical unit disposed on the eyeglass frame for capturing at least one scene image corresponding to a field of view of a user, and at least one second optical unit disposed on the eyeglass frame for capturing at least one eye image corresponding to at least a portion of at least one eye of the user. The second portable unit is in communication with the first portable unit and includes at least one processor configured for receiving the at least one scene image and the at least one eye image, determining a direction within the field of view to which the at least one eye is directed based upon the at least one eye image, and generating a subset of the at least one scene image based on the determined direction.

Abstract: Techniques for performing viewing verification using a plurality of classifiers are disclosed. Images of an individual may be obtained concurrently with an electronic display presenting one or more images. Image classifiers for facial and head pose analysis may be obtained. The images of the individual may be analyzed to identify a face of the individual in one of the plurality of images. A viewing verification metric may be calculated using the image classifiers and a verified viewing duration of the screen images by the individual may be calculated based on the plurality of images and the analyzing. Viewing verification can involve determining whether the individual is in front of the screen, facing the screen, and gazing at the screen. A viewing verification metric can be generated in order to determine a level of interest of the individual in particular media and images.

Abstract: The image capture system of the present disclosure comprises an illuminator comprising at least one infrared light LED or laser and one visible light LED, an image sensor that is sensitive to infrared light and visible light, a memory configured to store instructions, and a processor configured to execute instructions to cause the image capture system to emit infrared light, receive image data comprising at least one infrared image, and determine depth maps, visible focus settings, or infrared exposure settings based on the infrared image data.

Abstract: A method and device for face identification, and a mobile terminal and a storage medium are provided. The method includes: (101) an image sensor is controlled to perform imaging; (102) imaging data obtained by the image sensor through the imaging is acquired; and (103) liveness detection is performed on an imaging object based on the imaging data.

Abstract: According to an aspect of an embodiment of the present disclosure, a device may include an optical scanner, a display, and one or more storage media storing instructions. The device may also include one or more processors configured to execute the instructions to cause the device to perform operations. The operations may include presenting content to a user of the device via the display, and capturing a depiction of an eye of the user via the optical scanner. The operations may also include comparing a size of a pupil of the eye of the user in the depiction to a reference size of a pupil stored in the one or more storage media to determine an amount of dilation of the eye of the user. The method may also include modifying, based on the amount of dilation, the presentation of the content.

Abstract: In this vehicular monitoring device, an imaging unit 2 captures an image of the driver of a vehicle. A driving state measurement unit 70 analyzes the image captured by the imaging unit 2 and measures a plurality of driving states including the eye opening degree of the driver. A travel state determination unit 71 determines the travel state of the vehicle. An alarm determination unit 72 uses the driving states and the travel state as a basis to determine whether to activate an alarm device 5. When the driving state measurement unit 70 fails to measure the eye opening degree but it is determined that the travel state and the driving states other than the eye opening degree are normal, the alarm determination unit 72 causes the driving state measurement unit 70 to perform measurement of the eye opening degree again.

Abstract: A signal processing device has tunable wavelength extraction and detection of a narrow band, while maintaining resolution. The signal processing device includes an acquisition unit that acquires a signal of a first wavelength band in which wavelength extraction is possible in a tunable manner by means of postprocessing and a signal of a second wavelength band to be used for a special purpose; and a signal processing unit that performs signal processing using the signal of the first wavelength band and the signal of the second wavelength band.

Abstract: A head mounted display, including at least one display, an image capture device, a light beam generator, and an optical compensation element, is provided. The display has an open area and generates at least one image light beam. The image capture device is disposed by overlapping with the display corresponding to the open area. The image capture device is configured to capture a target area image through the open area. The light beam generator is configured to project at least one light beam to a target area. The target area reflects the light beam to generate at least one reflection light beam. The optical compensation element is configured to convert a transmission direction of the image light beam and enable the reflection light beam to be directly transmitted to the image capture device.

Abstract: The present invention is related to improved methods for analysis of images of the vitreous and/or retina and/or choroid obtained by optical coherence tomography and to methods for making diagnoses of retinal disease based on the reflectivity profiles of various vitreous and/or retinal and/or choroidal layers of the retina.

Abstract: Embodiments of the present disclosure provide a method and an apparatus for clock synchronization, a device, a storage medium and a vehicle. The method includes: determining a first pose change of an image acquirer with respect to a reference coordinate system at different image acquisition time points; determining a second pose change of a calibration acquirer with respect to the reference coordinate system at different corrected image acquisition time points, in which, the different corrected image acquisition correction time points are determined according to the different image acquisition time points and each predetermined correction time variable; and performing a clock synchronization on the image acquirer and the calibration acquirer according to the first pose change of the image acquirer and the second pose change of the calibration acquirer corresponding to the each correction time variable.

Abstract: A system can include one or more processors that determine a first position of an object in view of a user of a head mounted display (HMD) and a first gaze direction towards the first position. The object can be detected by one or more sensors. The one or more processors detect that the user is gazing at the object. The one or more processors determine, responsive to detecting that the user is gazing at the object, a second gaze direction based on at least a second position of one or more eyes of the user of the HMD provided via an eye tracking operation of the HMD. The one or more processors calibrate, based at least on a difference between the first gaze direction and the second gaze direction, the eye tracking operation of the HMD.

Abstract: A face posture analysis method, an electronic device, and a computer-readable storage medium are provided. The face posture analysis method includes: obtaining a face key point of a to-be-processed face image; and inputting the face key point of the to-be-processed face image into a neural network, to obtain face posture information of the to-be-processed face image output by the neural network.

Abstract: Related methods are provided for establishing a baseline value to represent an eyelid opening dimension for a person engaged in an activity, where the activity may be driving a vehicle, operating industrial equipment, or performing a monitoring or control function; and for operating a system for monitoring eyelid opening values with real time video data.

Abstract: Methods and apparatus for collecting user feedback information from viewers of content are described. Feedback information is received from viewers of content. The feedback indicates, based on head tracking information in some embodiments, where users are looking in a simulated environment during different times of a content presentation, e.g., different frame times. The feedback information is used to prioritize different portions of an environment represented by the captured image content. Resolution allocation is performed based on the feedback information and the content re-encoded based on the resolution allocation. The resolution allocation may and normally does change as the priority of different portions of the environment change.

Abstract: The present invention relates to a display panel, an electronic device, and an operation method of the electronic device. The display panel is divided into a display region and a plurality of image capturing regions. Each of the image capturing regions includes: a camera module; a pixel module disposed on the camera module; and the pixel module includes a plurality of sub-pixel units, each of the sub-pixel units spaced apart on the camera module. By adding a plurality of cameras hidden under the display panel, the invention can not only improve accuracy of eye-tracking technology, but also prevent the problem of reduced appearance aesthetics caused by the plurality of cameras.

Abstract: View-through sensors each locatable proximate to an eye of a user and for use while the user is engaged in viewing activity. Each view-through sensor has a view-through region that allows the user to view through the sensor. An active peripheral region at least partially surrounds the view-through region and includes multiple light-sensing regions for sensing light reflected from an eye. In some embodiments, the view-through sensor is configured to use environmental light for eye tracking. When the view-through sensor uses environmental light, spatial and temporal information about the intensity of the environmental light can be used to enhance eye-tracking performance. This information can be obtained, for example, from light-sensing regions on the reverse side of the view-through sensor, from an electronic display, or from a forward-facing camera. In some embodiments, the view-through sensor includes light-emitting regions that emit the light that the sensor uses to track eye movement.

Abstract: Systems and methods for adjusting an image based on pupil size are disclosed. Particularly, a system for adjusting an image being presented on a display includes a processor. The processor is configured to identify a size of a pupil of a user viewing an image presented on the display, determine an intensity map based at least on the size of the pupil, and adjust the intensity values of at least a portion of the image using the intensity map. The intensity map indicates an amount of adjustment to intensity values of at least a portion of the image being displayed.

Abstract: A camera module according to an embodiment includes a liquid lens unit including a cavity, a conductive liquid and a non-conductive liquid disposed in the cavity, “n” individual electrodes (n being an integer of 2 or more), and a common electrode, an interface being formed between the conductive liquid and the non-conductive liquid, a main board including an element constituting a control circuit for controlling the operation of the liquid lens unit, and a holder coupled to the main board such that the open area of an insertion hole for insertion of the liquid lens unit is disposed along a first side of the main board.

Abstract: A method for calibrating eye tracking data for a head wearable optical device includes receiving eye tracking data from an imaging device oriented towards a combiner. The method includes determining a gaze direction of an eye of a user based on the eye tracking data. The method includes receiving calibration data from the imaging device that includes an indication of positions of one or more calibration indicators. The method includes determining the gaze direction based at least in part on the calibration data received from the imaging device (or factors adjusted by the calibration data).

Abstract: An electronic device according to one example of the present invention comprises: a proximity sensor for generating proximity information on an object which approaches the electronic device; an iris sensor for detecting an iris; and a first processor for controlling the electronic device, wherein the first processor can be set to: determine the distance between the electronic device and the object on the basis of the proximity information generated by the proximity sensor; detect the iris by using the iris sensor when the distance between the electronic device and the object is greater than a first reference value; and inactivate the iris sensor when the distance between the electronic device and the object is less than or equal to the first reference value. In addition, other examples are possible.

Abstract: The technology disclosed relates to a method of realistic rendering of a real object as a virtual object in a virtual space using an offset in the position of the hand in a three-dimensional (3D) sensory space. An offset between expected positions of the eye(s) of a wearer of a head mounted device and a sensor attached to the head mounted device for sensing a position of at least one hand in a three-dimensional (3D) sensory space is determined. A position of the hand in the three-dimensional (3D) sensory space can be sensed using a sensor. The sensed position of the hand can be transformed by the offset into a re-rendered position of the hand as would appear to the wearer of the head mounted device if the wearer were looking at the actual hand. The re-rendered hand can be depicted to the wearer of the head mounted device.

Abstract: A medical observation apparatus includes: a display unit that displays thereon an observation image corresponding to a result of examination on a subject; a first camera that performs imaging of plural persons surrounding the subject, and outputs a surrounding image; a selecting unit that selects, based on the surrounding image, an indicator from the plural persons; a line of sight detecting unit that detects a line of sight of the indicator; and a display control unit that causes the display unit to display thereon a superimposed image having a pointer superimposed on the observation image, the pointer being at a position according to a destination of the line of sight of the indicator.

Abstract: A lens unit includes: an imaging optical system; and a lens barrel holding the imaging optical system. The imaging optical system includes, in order from an object side: a first lens having a positive refractive power; a second lens including at least one surface having an aspherical shape; and a third lens having a negative refractive power, at least one surface having an aspherical shape, and an inflection point other than an intersection with an optical axis.

Abstract: A hybrid cornea and pupil eye-tracking technique includes receiving iris-backscattered light from an eye and determining a pupil-position of the eye based on the iris-backscattered light. Cornea-reflected light is received from the eye and an eye-tracking position of the eye is determined based on the cornea-reflected light and the pupil-position.

Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, and a complementary metal-oxide-semiconductor (CMOS) image sensor configured to output frames of image data. The apparatus further includes a hybrid feature handler configured to receive, as an input, one or more of a DVS output or a CMOS image sensor output, and provide tracked features to a visual-inertial simultaneous location and mapping (SLAM) pipeline performing inside-out device tracking, and a sensor scheduler configured to switch off the CMOS image sensor based on a current value of one or more CMOS control factors.

Abstract: An area extraction unit (2) extracts an eye area in an image of a driver. An eyelid detection unit (3) detects an eyelid in the eye area. A reliability calculation unit (4) calculates an eyelid reliability by using luminance information of the eye area and positional information of the eyelid detected by the eyelid detection unit (3). A determination unit (5) determines that the eyelid has not been properly detected, when the eyelid reliability is less than a first threshold value.

Abstract: According to various examples of the present invention, an electronic device and a gaze tracking method of the electronic device: detect optical signals, which are outputted from a first light-emitting device and a second light-emitting device and reflected from a user's left eye and right eye, by means of a first camera and a second camera corresponding to each of the first light-emitting device and the second light-emitting device; and determine the user's gaze on the basis of the detected optical signals, wherein the first light-emitting device and the second light-emitting device can be positioned so as to correspond to a left-eye display region and a right-eye display region included in a display of the electronic device, respectively, and various other examples are also possible.

Abstract: The present disclosure relates to a method, a device and storage medium for outputting communication message in the field of communication technologies. The method includes: detecting operating information corresponding to a terminal when a communication message is received, wherein the operating information instructs an operation that is different from an interface switching operation; acquiring an output condition corresponding to the communication message to respond to the operating information detected; and outputting the communication message in a current interface when the operating information satisfies the output condition, where the current interface is different from a display interface that is preset for the communication message.

Abstract: Aspects of the subject disclosure may include, for example, a device including a processing system including a processor and a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, including monitoring network traffic to determine a transmission control protocol traffic pattern, determining a target video rate from the transmission control protocol traffic pattern, and modifying an over-the-top video delivery service network according to the target video rate. Other embodiments are disclosed.

Abstract: Various aspects of the subject technology relate to prediction of eye movements of a user of a head-mountable display device. Predictive foveated display systems and methods, using the predicted eye movements are also disclosed. Predictive variable focus display systems and methods using the predicted eye movements are also disclosed. Predicting eye movements may include predicting a future gaze location and/or predicting a future vergence plane for the user's eyes, based on the current motion of one or both of the user's eyes. The predicted gaze location may be used to pre-render a foveated display image frame with a high-resolution region at the predicted gaze location. The predicted vergence plane may be used to modify an image plane of a display assembly to mitigate or avoid a vergence/accommodation conflict for the user.

Abstract: A driver monitoring device mounting structure that includes: a driver monitoring device main body that is attached to a steering column; a supporting component that has an anchoring portion and a fastening portion, and that supports a connector that is attached to a lead wire that is drawn out from the driver monitoring device main body; and a column cover that has a temporary fixing portion to which the anchoring portion is temporarily fixed, and a fixing portion to which the fastening portion is fixed, and that covers the steering column.

Abstract: Approaches are described for managing the processing of images or video on a computing device. A portable computing device can include one or more dedicated components, such as an application-specific integrated circuit (ASIC) or other dedicated processor component, to be integrated into the computing device to perform at least a portion of the imaging processing of captured images or video. For example, the dedicated processor component can enable the offloading of basic image signal processing, as well as higher level or “machine vision” processing from the device processor of the device. In this way, the dedicated processor component can perform signal processing for which the input is an image (or video), and where image or video data can be analyzed, interpreted and/or manipulated to generate an output, the output of image processing being either an image or a set of characteristics or parameters related to the image. The output can be provided to a device processor for further processing.

Abstract: A method and apparatus with emotion recognition acquires a plurality of pieces of data corresponding a plurality of inputs for each modality and corresponding to a plurality of modalities; determines a dynamics representation vector corresponding to each of the plurality of modalities based on a plurality of features for each modality extracted from the plurality of pieces of data; determines a fused representation vector based on the plurality of dynamics representation vectors corresponding to the plurality of modalities; and recognizes an emotion of a user based on the fused representation vector.

Abstract: Disclosed herein are techniques for imaging in eye tracking. An imaging system for eye tracking includes a camera configured to detect light in a first wavelength range, a substrate configured to be placed in front of an eye of a user, and at least one reflector located within the substrate. The at least one reflector is configured to receive light in the first wavelength range reflected by the eye of the user, reflect at least a portion of the received light in the first wavelength range to the camera, and transmit light in a second wavelength range different from the first wavelength range to the eye of the user. The substrate is transparent to both the light in the first wavelength range and the light in the second wavelength range.

Abstract: A method performed by an electronic device is described. The method includes receiving an image. The image depicts a face. The method also includes detecting at least one facial landmark of the face in the image. The method further includes receiving a depth image of the face and determining at least one landmark depth by mapping the at least one facial landmark to the depth image. The method also includes determining a plurality of scales of depth image pixels based on the at least one landmark depth and determining a scale smoothness measure for each of the plurality of scales of depth image pixels. The method additionally includes determining facial liveness based on at least two of the scale smoothness measures. Determining the facial liveness may be based on a depth-adaptive smoothness threshold and/or may be based on a natural face size criterion.

Abstract: Some embodiments of the invention provide a novel multi-layer node network to determine a set of misalignment values for a set of cameras that may be arranged with deviations from an ideal alignment or placement based on images captured by the set of cameras. A set of misalignment values for a set of cameras, in some embodiments, takes the form of translation vectors indicating the offsets between the centers of projection of the cameras relative to some useful coordinate system, and quaternions indicating the orientations of the cameras' optical axes and reference vectors associated with the cameras. Some embodiments train the multi-layer network using a set of inputs generated with random misalignments incorporated into the training set.

Abstract: The invention relates to a method for operating an eye tracking device (10) for multi¬user eye tracking, wherein images (24) of a predefined capturing area (14) of the eye tracking device (10) are captured by means of an imaging device (12) of the eye tracking device (10) and the captured images (24) are processed by means of a processing unit (16) of the eye tracking device (10). If a first user (26a) and a second user (26b) are present in the predefined capturing area (14) of the eye tracking device (10), a first information relating to the first user (26a) and a second information relating to the second user (26b) are determined on the basis of the captured images (24) by processing the images (24). Furthermore the images (24) are captured successively in a predeterminable time sequence.

Abstract: The present disclosure discloses an iris lens assembly including, sequentially from an object side to an image side along an optical axis, a first lens and at least one subsequent lens. Wherein an object-side surface of an lens closest to the image side and having optical power among the at least one subsequent lens is a concave surface. The iris lens further includes an optical filter disposed between the object side and the lens closest to the image side and having optical power, and a band-pass wavelength of the optical filter is from 700 nm to 900 nm.