Patents by Inventor Masaru NINOMIYA
Masaru NINOMIYA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11807264Abstract: A driving assistance apparatus includes: a driver identifying unit that identifies a driver driving a vehicle; an evaluation data obtaining unit that obtains, based on an identification result of the driver identifying unit, evaluation data on the driver's visual cognitive ability for an event that occurs when the driver is driving the vehicle; an event detecting unit that detects, on the basis of surrounding information data indicating a situation of the vehicle's surroundings, whether or not the event has occurred; and a processing unit that determines, in a case where the event has been detected and on the basis of the evaluation data on the driver, the evaluation data being related to the event, whether or not notification information is to be output from an output unit.Type: GrantFiled: January 28, 2022Date of Patent: November 7, 2023Assignee: JVCKENWOOD CorporationInventors: Hiroyuki Takei, Masaru Ninomiya, Shuji Hakoshima, Miku Komurata
-
Publication number: 20220144302Abstract: A driving assistance apparatus includes: a driver identifying unit that identifies a driver driving a vehicle; an evaluation data obtaining unit that obtains, based on an identification result of the driver identifying unit, evaluation data on the driver's visual cognitive ability for an event that occurs when the driver is driving the vehicle; an event detecting unit that detects, on the basis of surrounding information data indicating a situation of the vehicle's surroundings, whether or not the event has occurred; and a processing unit that determines, in a case where the event has been detected and on the basis of the evaluation data on the driver, the evaluation data being related to the event, whether or not notification information is to be output from an output unit.Type: ApplicationFiled: January 28, 2022Publication date: May 12, 2022Inventors: Hiroyuki Takei, Masaru Ninomiya, Shuji Hakoshima, Miku Komurata
-
Patent number: 11061470Abstract: An eye tracking device includes at least one light source configured to irradiate detection light for eye tracking to at least one eyeball of a subject; at least one imager configured to capture image of the at least one eyeball; a position detecting unit configured to detect a position of a pupil center of the at least one eyeball and a position of a corneal reflex center of the at least one eyeball from the captured image; a gaze determining unit configured to determine whether the subject is gazing at a target position based on the position of the pupil center and the position of the corneal reflex center; and a calibration unit configured to perform calibration for the eye tracking based on the captured image when the gaze determining unit determines that the target position is gazed at by the subject.Type: GrantFiled: September 23, 2019Date of Patent: July 13, 2021Assignee: JVCKENWOOD CorporationInventor: Masaru Ninomiya
-
Patent number: 10996747Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.Type: GrantFiled: September 5, 2019Date of Patent: May 4, 2021Assignee: JVCKENWOOD CorporationInventor: Masaru Ninomiya
-
Patent number: 10832401Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.Type: GrantFiled: January 10, 2018Date of Patent: November 10, 2020Assignee: JVC KENWOOD CorporationInventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
-
Publication number: 20200019241Abstract: An eye tracking device includes at least one light source configured to irradiate detection light for eye tracking to at least one eyeball of a subject; at least one imager configured to capture image of the at least one eyeball; a position detecting unit configured to detect a position of a pupil center of the at least one eyeball and a position of a corneal reflex center of the at least one eyeball from the captured image; a gaze determining unit configured to determine whether the subject is gazing at a target position based on the position of the pupil center and the position of the corneal reflex center; and a calibration unit configured to perform calibration for the eye tracking based on the captured image when the gaze determining unit determines that the target position is gazed at by the subject.Type: ApplicationFiled: September 23, 2019Publication date: January 16, 2020Inventor: Masaru Ninomiya
-
Publication number: 20190391643Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.Type: ApplicationFiled: September 5, 2019Publication date: December 26, 2019Inventor: Masaru Ninomiya
-
Patent number: 10149643Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: GrantFiled: January 5, 2017Date of Patent: December 11, 2018Assignee: JVC KENWOOD CorporationInventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
-
Patent number: 10123695Abstract: A display, imaging units that capture a subject, an eye gaze detector that detects an eye gaze direction of the subject, from the captured image captured by the imaging units, a gaze point detector that detects a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller that displays any of a plurality of diagnosis images on the display, selects the diagnosis image to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, from the plurality of diagnosis images, and further displays the selected diagnosis image on the display, and an evaluator that calculates an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: GrantFiled: January 26, 2016Date of Patent: November 13, 2018Assignee: JVC KENWOOD CorporationInventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya
-
Patent number: 10117569Abstract: A diagnosis supporting device includes an imaging unit that images a subject, an eye gaze detector that detects an eye gaze direction of the subject from an image captured by the imaging unit, a gaze point detector that detects a gaze point of the subject in a display area of a display on the basis of the eye gaze direction, and an output controller that causes the display area to display a diagnostic image composed by superposing a pattern image onto a natural image.Type: GrantFiled: September 3, 2015Date of Patent: November 6, 2018Assignee: JVC KENWOOD CorporationInventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
-
Patent number: 10085636Abstract: An eye gaze detection apparatus includes a plurality of illuminators each including a light source for emitting light and disposed symmetrically with respect to a predetermined position, a plurality of imaging units each disposed at an inner or outer position with respect to the plurality of illuminators, a position detector configured to detect a first position indicating a pupil center and a second position indicating a corneal reflection center based on an image of an eyeball of a subject, the image being captured by the imaging unit with the light emitted by the illuminator, and a calculator configured to calculate a fourth position indicating a corneal curvature center, based on the predetermined position, a third position on a display, the first position, and the second position.Type: GrantFiled: October 20, 2015Date of Patent: October 2, 2018Assignee: JVC KENWOOD CorporationInventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
-
Patent number: 9993154Abstract: An eye gaze detection supporting device includes an illuminator including a light source that performs irradiation with light, a plurality of imaging units, position detectors that detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by the illuminator, and captured by the imaging units, and a calculator that calculates a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position.Type: GrantFiled: May 20, 2016Date of Patent: June 12, 2018Assignee: JVC KENWOOD CorporationInventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
-
Publication number: 20180130206Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.Type: ApplicationFiled: January 10, 2018Publication date: May 10, 2018Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
-
Patent number: 9898816Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.Type: GrantFiled: March 26, 2015Date of Patent: February 20, 2018Assignee: JVC KENWOOD CorporationInventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
-
Publication number: 20170112424Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: ApplicationFiled: January 5, 2017Publication date: April 27, 2017Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
-
Patent number: 9579054Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: GrantFiled: December 28, 2015Date of Patent: February 28, 2017Assignee: JVC KENWOOD CORPORATIONInventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
-
Publication number: 20160262614Abstract: An eye gaze detection supporting device includes an illuminator including a light source that performs irradiation with light, a plurality of imaging units, position detectors that detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by the illuminator, and captured by the imaging units, and a calculator that calculates a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position.Type: ApplicationFiled: May 20, 2016Publication date: September 15, 2016Inventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
-
Publication number: 20160150956Abstract: A display, imaging units that capture a subject, an eye gaze detector that detects an eye gaze direction of the subject, from the captured image captured by the imaging units, a gaze point detector that detects a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller that displays any of a plurality of diagnosis images on the display, selects the diagnosis image to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, from the plurality of diagnosis images, and further displays the selected diagnosis image on the display, and an evaluator that calculates an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: ApplicationFiled: January 26, 2016Publication date: June 2, 2016Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya
-
Publication number: 20160113486Abstract: An eye gaze detection apparatus includes a plurality of illuminators each including a light source for emitting light and disposed symmetrically with respect to a predetermined position, a plurality of imaging units each disposed at an inner or outer position with respect to the plurality of illuminators, a position detector configured to detect a first position indicating a pupil center and a second position indicating a corneal reflection center based on an image of an eyeball of a subject, the image being captured by the imaging unit with the light emitted by the illuminator, and a calculator configured to calculate a fourth position indicating a corneal curvature center, based on the predetermined position, a third position on a display, the first position, and the second position.Type: ApplicationFiled: October 20, 2015Publication date: April 28, 2016Inventors: Masaru NINOMIYA, Katsuyuki SHUDO, Shuji HAKOSHIMA
-
Publication number: 20160106354Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.Type: ApplicationFiled: December 28, 2015Publication date: April 21, 2016Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima