Abstract: A line-of-sight detection device includes a camera, a light source that causes corneal reflection, and an image processing device that obtains information on a pupil shape of an eye, a position of a pupil center, and a position of the cornea reflection and obtains a line of sight of a subject. The image processing device includes a first optical axis acquisition unit that acquires a first optical axis candidate using the position of the pupil center and the position of the cornea reflection, a second optical axis acquisition unit that obtains a second optical axis candidate using the pupil shape, an optical axis information acquisition unit that generates information for acquiring the optical axis, a calibration information unit that provides calibration information, and a visual axis acquisition unit that obtains a visual axis as a line of sight by calibrating an optical axis using the calibration information.

Abstract: A pupil detection system according to an embodiment includes a vector calculation unit configured to calculate a plurality of candidate vectors each connecting a corneal sphere center and a pupil center by a stereo method based on a first pupil image of a subject which is picked up by a first camera and a second pupil image of the subject which is picked up by a second camera, and a determination unit configured to select, from among the plurality of candidate vectors, a candidate vector satisfying a vector condition in which an angle between the pupil center and a reference line is equal to or less than a predetermined threshold and determine that a pupil is located at a pupil center corresponding to the selected candidate vector.

Abstract: A corneal reflection position estimation system according to an embodiment includes: an image acquisition unit configured to continuously acquire an image of an eye of a subject by controlling a camera equipped with a light source, the image acquisition unit being configured to acquire a plurality of pupil images taken by using light from the light source and then acquire one unilluminated image taken without using light from the light source; and an estimation unit configured to calculate positions of corneal reflection or corneal sphere centers, which correspond to the plurality of pupil images, as reference positions, calculate a movement vector of the corneal reflection or the corneal sphere center based on a plurality of the reference positions, and estimate the corneal reflection position in the unilluminated image based on at least the movement vector.

Abstract: A line-of-sight detection device 1 includes a camera 10, a light source 13 that causes corneal reflection, and an image processing device 20 that obtains information on a pupil shape of an eye, a position (PS) of a pupil center, and a position (GS) of the cornea reflection and obtains a line of sight of a subject M. The image processing device 20 includes a first optical axis acquisition unit 28 that acquires a first optical axis candidate using the position (PS) of the pupil center and the position (GS) of the cornea reflection, a second optical axis acquisition unit 29 that obtains a second optical axis candidate using the pupil shape, an optical axis information acquisition unit 31 that generates information for acquiring the optical axis, a calibration information unit 33 that provides calibration information, and a visual axis acquisition unit 32 that obtains a visual axis AS as a line of sight by calibrating an optical axis AL using the calibration information.

Abstract: A pupil detection light source device includes an aperture disposed to face a subject to allow light from a pupil of the subject to pass therethrough, an illumination light for obtaining a light pupil image toward the subject from the inside or the vicinity of the aperture when seen from the subject, and an illumination light for forming a reflection image with glasses obtained by canceling a reflection image with glasses of the light pupil image using an image difference toward the subject from the inside or the vicinity of the aperture when seen from the subject.

Abstract: A corneal reflection position estimation system according to an embodiment includes: an image acquisition unit configured to continuously acquire an image of an eye of a subject by controlling a camera equipped with a light source, the image acquisition unit being configured to acquire a plurality of pupil images taken by using light from the light source and then acquire one unilluminated image taken without using light from the light source; and an estimation unit configured to calculate positions of corneal reflection or corneal sphere centers, which correspond to the plurality of pupil images, as reference positions, calculate a movement vector of the corneal reflection or the corneal sphere center based on a plurality of the reference positions, and estimate the corneal reflection position in the unilluminated image based on at least the movement vector.

Abstract: A pupil detection system according to an embodiment includes a vector calculation unit configured to calculate a plurality of candidate vectors each connecting a corneal sphere center and a pupil center by a stereo method based on a first pupil image of a subject which is picked up by a first camera and a second pupil image of the subject which is picked up by a second camera, and a determination unit configured to select, from among the plurality of candidate vectors, a candidate vector satisfying a vector condition in which an angle between the pupil center and a reference line is equal to or less than a predetermined threshold and determine that a pupil is located at a pupil center corresponding to the selected candidate vector.

Abstract: A pupil detection method includes a step of acquiring images by taking a facial image of a subject using each of a left camera and a right camera, a step of extracting one or more image candidate points serving as candidates for pupils from the images, a step of extracting points corresponding to a combination of image candidate points corresponding to the same point in a three-dimensional space as space candidate points, a step of selecting a pair of two space candidate points from the extracted space candidate points and calculating a distance between the selected pair, a step of excluding a pair of space candidate points where the calculated distance is not within a specified range, and a step of determining one or more pairs of space candidate points from the pairs not excluded and determining that a pair of pupils of the subject exist at the positions.

Abstract: A pupil detection light source device includes an aperture disposed to face a subject to allow light from a pupil of the subject to pass therethrough, an illumination light for obtaining a light pupil image toward the subject from the inside or the vicinity of the aperture when seen from the subject, and an illumination light for forming a reflection image with glasses obtained by canceling a reflection image with glasses of the light pupil image using an image difference toward the subject from the inside or the vicinity of the aperture when seen from the subject.

Abstract: A gaze point detection device 1 has four cameras 2a, 2b, 2c, 2d, light sources 3a, 3b, 3c, 3d, control circuits 4, 5, 6, and an image processor 7. The image processor 7 calculates vectors r, each of which is from a corneal reflection point to the center of a pupil, on a plane that is vertical to base lines. The image processor 7 also calculates angles ? of the line of sight on the basis of the vectors r and by using a function f including M parameters. Moreover, the image processor 7 determines the M parameters based on the angles ?, and detects a point of gaze Q based on the line of sight direction calculated using the determined parameters. The number of cameras is set at M×½ or higher.

Abstract: A pupil detection method includes a step of acquiring images by taking a facial image of a subject using each of a left camera and a right camera, a step of extracting one or more image candidate points serving as candidates for pupils from the images, a step of extracting points corresponding to a combination of image candidate points corresponding to the same point in a three-dimensional space as space candidate points, a step of selecting a pair of two space candidate points from the extracted space candidate points and calculating a distance between the selected pair, a step of excluding a pair of space candidate points where the calculated distance is not within a specified range, and a step of determining one or more pairs of space candidate points from the pairs not excluded and determining that a pair of pupils of the subject exist at the positions.

Abstract: A gaze point detection device 1 comprises two stereo cameras 2a, 2b for acquiring a face image of a subject A, light sources 3a, 3b disposed on the outside of apertures 9a, 9b, a control circuit 4, 5, 6, and an image processor 7. The image processor 7 calculates a vector r from a corneal reflection point to a pupil on a plane perpendicular to reference lines of the stereo cameras 2a, 2b, computes an angle ? of lines of sight of the subject A with respect to the respective reference lines by using a function f1, corrects the function f1 such that directions of lines of sight are closer to each other, and calculates the line of sight directions to detect a gaze point Q on a display screen.

Abstract: A gaze point detection device 1 has four cameras 2a, 2b, 2c, 2d, light sources 3a, 3b, 3c, 3d, control circuits 4, 5, 6, and an image processor 7. The image processor 7 calculates vectors r, each of which is from a corneal reflection point to the center of a pupil, on a plane that is vertical to base lines. The image processor 7 also calculates angles ? of the line of sight on the basis of the vectors r and by using a function f including M parameters. Moreover, the image processor 7 determines the M parameters based on the angles ?, and detects a point of gaze Q based on the line of sight direction calculated using the determined parameters. The number of cameras is set at M×1/2 or higher.

Abstract: A gaze point detection device 1 comprises two stereo cameras 2a, 2b for acquiring a face image of a subject A, light sources 3a, 3b disposed on the outside of apertures 9a, 9b, a control circuit 4, 5, 6, and an image processor 7. The image processor 7 calculates a vector r from a corneal reflection point to a pupil on a plane perpendicular to reference lines of the stereo cameras 2a, 2b, computes an angle ? of lines of sight of the subject A with respect to the respective reference lines by using a function f1, corrects the function f1 such that directions of lines of sight are closer to each other, and calculates the line of sight directions to detect a gaze point Q on a display screen.

Abstract: An autism diagnosis support apparatus 1 according to the present invention is an autism diagnosis support apparatus that detects a symptom of autism based on a state of a subject looking at a target, including: an eye-gaze point detection unit 2 that detects a line-of-sight direction of the subject looking at the target; a color camera 3 that takes an image of the target; a pupil position detection unit 4 that measures a pupil coordinate of the target; and a data analysis unit 7 that calculates a relationship between the line-of-sight direction of the subject and a pupil position of the target using the line-of-sight direction and the pupil coordinate and outputs the relationship along with the image of the target.

Abstract: A pupil detection device includes a camera, a light source disposed at the camera, an optical system, and an image processing system, which are disposed so that the examinee's face is irradiated with the light from the light source from the camera, and a face image including a pupil is formed in the camera. The light source includes a first light source, having a first wavelength that makes a bright pupil image by reflection in the examinee's pupil, and a second light source having a second wavelength that makes a dark pupil image by reflection in the examinee's pupil, but otherwise exhibiting the same illumination effect as the first light source. The camera includes a first image data acquisition system using the first illumination light source, and a second image data acquisition system using the second illumination light source.

Abstract: An autism diagnosis support apparatus 1 according to the present invention is an autism diagnosis support apparatus that detects a symptom of autism based on a state of a subject looking at a target, including: an eye-gaze point detection unit 2 that detects a line-of-sight direction of the subject looking at the target; a color camera 3 that takes an image of the target; a pupil position detection unit 4 that measures a pupil coordinate of the target; and a data analysis unit 7 that calculates a relationship between the line-of-sight direction of the subject and a pupil position of the target using the line-of-sight direction and the pupil coordinate and outputs the relationship along with the image of the target.

Abstract: A gaze point detecting device 1 detects a gaze point of an object person by projecting a display image displayed by an LCD 8 to outside via a finder 4 and capturing an eye image of the object person by a CCD 11 in response to illumination light irradiated toward outside from the finder 4, and the device comprises an optical system 5 arranged spaced only a focal length apart from a display surface 8a on an optical path of an image displaying optical system between the LCD 8 and the finder 4; the optical system 5 being arranged on an optical path of an imaging optical system between the finder 4 and the CCD 11; a telecentric optical system including a diaphragm 9 arranged spaced only a focal length apart from the optical system 5 on the optical path; and a controller 3 that detects a position of the gaze point of the object person based on the eye image captured by the CCD 11.

Abstract: A gaze point detecting device 1 detects a gaze point of an object person by projecting a display image displayed by an LCD 8 to outside via a finder 4 and capturing an eye image of the object person by a CCD 11 in response to illumination light irradiated toward outside from the finder 4, and the device comprises an optical system 5 arranged spaced only a focal length apart from a display surface 8a on an optical path of an image displaying optical system between the LCD 8 and the finder 4; the optical system 5 being arranged on an optical path of an imaging optical system between the finder 4 and the CCD 11; a telecentric optical system including a diaphragm 9 arranged spaced only a focal length apart from the optical system 5 on the optical path; and a controller 3 that detects a position of the gaze point of the object person based on the eye image captured by the CCD 11.

Abstract: The pupil detection device according to the present invention includes a camera means C, a light source L, an optical path forming means, and a calculation means, which are disposed in a manner to retain the relation by means of the optical path forming means, such that the examinee's face is irradiated with the light from the light source from an aperture of the camera means, and that a face image including a pupil EB is formed in the above camera means. The formed image data is calculated to detect the pupil. The above light source L includes a first illumination light source, having a first wavelength light component to make a bright pupil by reflection in the examinee's pupil, and a second illumination light source having a second wavelength light component to make a dark pupil by reflection in the examinee's pupil and exhibiting the same illumination effect as the first illumination light source except for the pupil.