Patents by Inventor Masaru NINOMIYA

Masaru NINOMIYA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11807264
    Abstract: A driving assistance apparatus includes: a driver identifying unit that identifies a driver driving a vehicle; an evaluation data obtaining unit that obtains, based on an identification result of the driver identifying unit, evaluation data on the driver's visual cognitive ability for an event that occurs when the driver is driving the vehicle; an event detecting unit that detects, on the basis of surrounding information data indicating a situation of the vehicle's surroundings, whether or not the event has occurred; and a processing unit that determines, in a case where the event has been detected and on the basis of the evaluation data on the driver, the evaluation data being related to the event, whether or not notification information is to be output from an output unit.
    Type: Grant
    Filed: January 28, 2022
    Date of Patent: November 7, 2023
    Assignee: JVCKENWOOD Corporation
    Inventors: Hiroyuki Takei, Masaru Ninomiya, Shuji Hakoshima, Miku Komurata
  • Publication number: 20220144302
    Abstract: A driving assistance apparatus includes: a driver identifying unit that identifies a driver driving a vehicle; an evaluation data obtaining unit that obtains, based on an identification result of the driver identifying unit, evaluation data on the driver's visual cognitive ability for an event that occurs when the driver is driving the vehicle; an event detecting unit that detects, on the basis of surrounding information data indicating a situation of the vehicle's surroundings, whether or not the event has occurred; and a processing unit that determines, in a case where the event has been detected and on the basis of the evaluation data on the driver, the evaluation data being related to the event, whether or not notification information is to be output from an output unit.
    Type: Application
    Filed: January 28, 2022
    Publication date: May 12, 2022
    Inventors: Hiroyuki Takei, Masaru Ninomiya, Shuji Hakoshima, Miku Komurata
  • Patent number: 11061470
    Abstract: An eye tracking device includes at least one light source configured to irradiate detection light for eye tracking to at least one eyeball of a subject; at least one imager configured to capture image of the at least one eyeball; a position detecting unit configured to detect a position of a pupil center of the at least one eyeball and a position of a corneal reflex center of the at least one eyeball from the captured image; a gaze determining unit configured to determine whether the subject is gazing at a target position based on the position of the pupil center and the position of the corneal reflex center; and a calibration unit configured to perform calibration for the eye tracking based on the captured image when the gaze determining unit determines that the target position is gazed at by the subject.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: July 13, 2021
    Assignee: JVCKENWOOD Corporation
    Inventor: Masaru Ninomiya
  • Patent number: 10996747
    Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.
    Type: Grant
    Filed: September 5, 2019
    Date of Patent: May 4, 2021
    Assignee: JVCKENWOOD Corporation
    Inventor: Masaru Ninomiya
  • Patent number: 10832401
    Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.
    Type: Grant
    Filed: January 10, 2018
    Date of Patent: November 10, 2020
    Assignee: JVC KENWOOD Corporation
    Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
  • Publication number: 20200019241
    Abstract: An eye tracking device includes at least one light source configured to irradiate detection light for eye tracking to at least one eyeball of a subject; at least one imager configured to capture image of the at least one eyeball; a position detecting unit configured to detect a position of a pupil center of the at least one eyeball and a position of a corneal reflex center of the at least one eyeball from the captured image; a gaze determining unit configured to determine whether the subject is gazing at a target position based on the position of the pupil center and the position of the corneal reflex center; and a calibration unit configured to perform calibration for the eye tracking based on the captured image when the gaze determining unit determines that the target position is gazed at by the subject.
    Type: Application
    Filed: September 23, 2019
    Publication date: January 16, 2020
    Inventor: Masaru Ninomiya
  • Publication number: 20190391643
    Abstract: Validity of a line-of-sight direction detected by a gaze point detection unit is determined by using a positional difference that is a calibration value used for detecting a position of a corneal curvature center. Therefore, it is possible to easily and effectively determine the validity of the line-of-sight direction without additionally using a system or the like for detecting the validity of the line-of-sight direction. Consequently, it is possible to accurately detect line-of-sight directions of various subjects, such as a subject whose left and right eyeballs have different corneal curvature radii or a subject whose line-of-sight directions of left and right eyeballs are largely different due to the influence of strabismus or the like.
    Type: Application
    Filed: September 5, 2019
    Publication date: December 26, 2019
    Inventor: Masaru Ninomiya
  • Patent number: 10149643
    Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Grant
    Filed: January 5, 2017
    Date of Patent: December 11, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
  • Patent number: 10123695
    Abstract: A display, imaging units that capture a subject, an eye gaze detector that detects an eye gaze direction of the subject, from the captured image captured by the imaging units, a gaze point detector that detects a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller that displays any of a plurality of diagnosis images on the display, selects the diagnosis image to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, from the plurality of diagnosis images, and further displays the selected diagnosis image on the display, and an evaluator that calculates an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Grant
    Filed: January 26, 2016
    Date of Patent: November 13, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya
  • Patent number: 10117569
    Abstract: A diagnosis supporting device includes an imaging unit that images a subject, an eye gaze detector that detects an eye gaze direction of the subject from an image captured by the imaging unit, a gaze point detector that detects a gaze point of the subject in a display area of a display on the basis of the eye gaze direction, and an output controller that causes the display area to display a diagnostic image composed by superposing a pattern image onto a natural image.
    Type: Grant
    Filed: September 3, 2015
    Date of Patent: November 6, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
  • Patent number: 10085636
    Abstract: An eye gaze detection apparatus includes a plurality of illuminators each including a light source for emitting light and disposed symmetrically with respect to a predetermined position, a plurality of imaging units each disposed at an inner or outer position with respect to the plurality of illuminators, a position detector configured to detect a first position indicating a pupil center and a second position indicating a corneal reflection center based on an image of an eyeball of a subject, the image being captured by the imaging unit with the light emitted by the illuminator, and a calculator configured to calculate a fourth position indicating a corneal curvature center, based on the predetermined position, a third position on a display, the first position, and the second position.
    Type: Grant
    Filed: October 20, 2015
    Date of Patent: October 2, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
  • Patent number: 9993154
    Abstract: An eye gaze detection supporting device includes an illuminator including a light source that performs irradiation with light, a plurality of imaging units, position detectors that detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by the illuminator, and captured by the imaging units, and a calculator that calculates a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position.
    Type: Grant
    Filed: May 20, 2016
    Date of Patent: June 12, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
  • Publication number: 20180130206
    Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.
    Type: Application
    Filed: January 10, 2018
    Publication date: May 10, 2018
    Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
  • Patent number: 9898816
    Abstract: A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: February 20, 2018
    Assignee: JVC KENWOOD Corporation
    Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya, Makoto Kito
  • Publication number: 20170112424
    Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Application
    Filed: January 5, 2017
    Publication date: April 27, 2017
    Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
  • Patent number: 9579054
    Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Grant
    Filed: December 28, 2015
    Date of Patent: February 28, 2017
    Assignee: JVC KENWOOD CORPORATION
    Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima
  • Publication number: 20160262614
    Abstract: An eye gaze detection supporting device includes an illuminator including a light source that performs irradiation with light, a plurality of imaging units, position detectors that detect a first position indicating a center of a pupil and a second position indicating a center of corneal reflection, from an image of an eye ball of a subject irradiated with light by the illuminator, and captured by the imaging units, and a calculator that calculates a fourth position indicating a curvature center of a cornea, based on a position of the light source, a third position on a display, the first position, and the second position.
    Type: Application
    Filed: May 20, 2016
    Publication date: September 15, 2016
    Inventors: Masaru Ninomiya, Katsuyuki Shudo, Shuji Hakoshima
  • Publication number: 20160150956
    Abstract: A display, imaging units that capture a subject, an eye gaze detector that detects an eye gaze direction of the subject, from the captured image captured by the imaging units, a gaze point detector that detects a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller that displays any of a plurality of diagnosis images on the display, selects the diagnosis image to be displayed next according to a position of the gaze point detected when the diagnosis image is displayed, from the plurality of diagnosis images, and further displays the selected diagnosis image on the display, and an evaluator that calculates an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Application
    Filed: January 26, 2016
    Publication date: June 2, 2016
    Inventors: Shuji Hakoshima, Katsuyuki Shudo, Masaru Ninomiya
  • Publication number: 20160113486
    Abstract: An eye gaze detection apparatus includes a plurality of illuminators each including a light source for emitting light and disposed symmetrically with respect to a predetermined position, a plurality of imaging units each disposed at an inner or outer position with respect to the plurality of illuminators, a position detector configured to detect a first position indicating a pupil center and a second position indicating a corneal reflection center based on an image of an eyeball of a subject, the image being captured by the imaging unit with the light emitted by the illuminator, and a calculator configured to calculate a fourth position indicating a corneal curvature center, based on the predetermined position, a third position on a display, the first position, and the second position.
    Type: Application
    Filed: October 20, 2015
    Publication date: April 28, 2016
    Inventors: Masaru NINOMIYA, Katsuyuki SHUDO, Shuji HAKOSHIMA
  • Publication number: 20160106354
    Abstract: A diagnosis supporting device includes a display, an imaging unit configured to capture a subject, an eye gaze detector configured to detect an eye gaze direction of the subject from a captured image captured by the imaging unit, a gaze point detector configured to detect a gaze point of the subject in a display region of the display, based on the eye gaze direction, an output controller configured to display, on the display, a diagnosis image that includes a person image and a geometric pattern image, and in which at least one of contrast, color density, and a degree of transmittance of the person image or the geometric pattern image is changed over time, and an evaluator configured to calculate an evaluation value of the subject, based on the gaze point detected by the gaze point detector when the diagnosis image is displayed.
    Type: Application
    Filed: December 28, 2015
    Publication date: April 21, 2016
    Inventors: Katsuyuki Shudo, Masaru Ninomiya, Shuji Hakoshima