Patents by Inventor Yudai NAKAMURA

Yudai NAKAMURA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11787421
    Abstract: A motion sickness estimation device including processing circuitry configured to calculate a sensory conflict amount on a basis of a motion of an occupant's head caused by vibration of a vehicle; extract a feature of a traveling situation on a basis of at least one of the motion of the occupant's head or a motion of the vehicle; determine a habituation progress state, which is a state in which the occupant's habituation to the traveling situation has progressed, on a basis of biometric information of the occupant; set sensitivity to the feature of the traveling situation on a basis of the habituation progress state; correct the sensory conflict amount on a basis of the sensitivity; and estimate a motion sickness state of the occupant on a basis of the sensory conflict amount that has been corrected.
    Type: Grant
    Filed: January 9, 2020
    Date of Patent: October 17, 2023
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Yudai Nakamura, Masahiro Naito
  • Publication number: 20230200684
    Abstract: A respiration information estimation device includes a specific region setting unit that sets a specific region and a motion vector calculation point as a point as a reference of a motion vector based on an image including an upper body of an object person, a motion vector calculation unit that calculates the motion vector from a movement amount of the motion vector calculation point in each of the images captured consecutively, a respiration reference axis calculation unit that calculates a respiration reference axis from a respiration central point and the motion vector calculation point, a respiration signal calculation unit that calculates a respiration signal from a component of the motion vector in a direction of the respiration reference axis, and a respiration information calculation unit that calculates a respiration information estimation result, as a result of estimating a body motion caused by the respiration, from the respiration signal.
    Type: Application
    Filed: June 2, 2020
    Publication date: June 29, 2023
    Applicant: Mitsubishi Electric Corporation
    Inventors: Taichi KOJIMA, Yudai NAKAMURA
  • Publication number: 20220135054
    Abstract: A motion sickness estimation device including processing circuitry configured to calculate a sensory conflict amount on a basis of a motion of an occupant's head caused by vibration of a vehicle; extract a feature of a traveling situation on a basis of at least one of the motion of the occupant's head or a motion of the vehicle; determine a habituation progress state, which is a state in which the occupant's habituation to the traveling situation has progressed, on a basis of biometric information of the occupant; set sensitivity to the feature of the traveling situation on a basis of the habituation progress state; correct the sensory conflict amount on a basis of the sensitivity; and estimate a motion sickness state of the occupant on a basis of the sensory conflict amount that has been corrected.
    Type: Application
    Filed: January 9, 2020
    Publication date: May 5, 2022
    Applicant: Mitsubishi Electric Corporation
    Inventors: Yudai NAKAMURA, Masahiro NAITO
  • Patent number: 11259710
    Abstract: A remote photoplethysmography (RPPG) system includes an input interface to receive a sequence of measurements of intensities of different regions of a skin of a person indicative of vital signs of the person; a solver to solve an optimization problem to determine frequency coefficients of photoplethysmographic waveforms corresponding to the measured intensities at the different regions, wherein the solver determines the frequency coefficients to reduce a distance between intensities of the skin reconstructed from the frequency coefficients and the corresponding measured intensities of the skin while enforcing joint sparsity on the frequency coefficients; and an estimator to estimate the vital signs of the person from the determined frequency coefficients of photoplethysmographic waveforms.
    Type: Grant
    Filed: October 23, 2018
    Date of Patent: March 1, 2022
    Assignee: Mitsubishi Electric Research Laboratories, Inc.
    Inventors: Hassan Mansour, Tim Marks, Ewa Nowara, Yudai Nakamura, Ashok Veeraraghavan
  • Patent number: 11200417
    Abstract: An area extraction unit (2) extracts an eye area in an image of a driver. An eyelid detection unit (3) detects an eyelid in the eye area. A reliability calculation unit (4) calculates an eyelid reliability by using luminance information of the eye area and positional information of the eyelid detected by the eyelid detection unit (3). A determination unit (5) determines that the eyelid has not been properly detected, when the eyelid reliability is less than a first threshold value.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: December 14, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Kazuki Kunihiro, Yudai Nakamura, Takashi Hirano
  • Publication number: 20210224983
    Abstract: A remote photoplethysmography (RPPG) system for estimating vital signs of a person is provided. The RPPG system is configured to receive a set of imaging photoplethysmography (iPPG) signals measured from different regions of a skin of a person. The RPPG system is further configured to determine frequency coefficients at the frequency bins of the quantized frequency spectrum of the measured iPPG signals by minimizing a distance between the measured iPPG signals and corresponding iPPG signals reconstructed from the determined frequency coefficients, while enforcing joint sparsity of the determined frequency coefficients subject to the sparsity level constraint, such that the determined frequency coefficients of different iPPG signals have the non-zero values at the same frequency bins; and output one or a combination of the determined frequency coefficients, the iPPG signals reconstructed from the determined frequency coefficients, and a vital sign signal corresponding to the reconstructed iPPG signals.
    Type: Application
    Filed: March 12, 2021
    Publication date: July 22, 2021
    Applicants: Mitsubishi Electric Research Laboratories, Inc., Mitsubishi Electric Corporation
    Inventors: Tim Marks, Hassan Mansour, Ewa Nowara, Yudai Nakamura, Ashok Veeraghavan
  • Publication number: 20210186346
    Abstract: An information processing device includes a skin-region detecting unit, a measurement-region setting unit, a pulse-wave source signal extracting unit, a phase-coincidence-degree calculating unit, and a pulse-wave estimating unit. The skin-region detecting unit detects a skin region of a person in each of multiple frames in a predetermined time period. The measurement-region setting unit sets multiple measurement regions in the skin region. The pulse-wave source signal extracting unit extracts multiple pulse-wave source signals indicating a change in luminance from the multiple measurement regions. The phase-coincidence-degree calculating unit calculates multiple phase coincidence degrees each indicating a degree of phase coincidence between phases of corresponding base components constituting each of the multiple pulse-wave source signals.
    Type: Application
    Filed: April 24, 2019
    Publication date: June 24, 2021
    Applicant: Mitsubishi Electric Corporation
    Inventors: Yudai NAKAMURA, Masahiro NAITO
  • Patent number: 10949690
    Abstract: There are included: a frequency distribution creating unit for referring to the face information detected by the face information detecting unit, and when a preset change occurs in the driver's face, creating a frequency distribution of face information in a preset time section from the face information detected by a face information detecting unit; a mode value calculating unit for calculating a mode value of the face information from the frequency distribution created; and a reference value calculating unit for calculating a reference value indicating a steady state of the driver from the mode value of the face information.
    Type: Grant
    Filed: February 15, 2017
    Date of Patent: March 16, 2021
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Hisashi Sugawara, Ryosuke Torama, Yudai Nakamura
  • Publication number: 20210073510
    Abstract: An area extraction unit (2) extracts an eye area in an image of a driver. An eyelid detection unit (3) detects an eyelid in the eye area. A reliability calculation unit (4) calculates an eyelid reliability by using luminance information of the eye area and positional information of the eyelid detected by the eyelid detection unit (3). A determination unit (5) determines that the eyelid has not been properly detected, when the eyelid reliability is less than a first threshold value.
    Type: Application
    Filed: February 13, 2018
    Publication date: March 11, 2021
    Applicant: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Kazuki KUNIHIRO, Yudai NAKAMURA, Takashi HIRANO
  • Patent number: 10849496
    Abstract: A motion sickness estimation device includes: a line-of-sight oscillation detector to detect oscillation of a line of sight of an occupant by using an imaging device; an object oscillation detector to detect oscillation of an object located in the line of sight; an oscillation comparator to calculate an oscillation difference from the oscillation of the line of sight and the oscillation of the object; and a motion sickness determiner to determine, on a basis of the oscillation difference, whether the occupant is in a motion sickness state.
    Type: Grant
    Filed: October 5, 2017
    Date of Patent: December 1, 2020
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Takuya Murakami, Yudai Nakamura, Masahiro Naito
  • Patent number: 10719697
    Abstract: A gesture judgment device includes a reference part detection unit that outputs reference part information indicating a reference part region, a movement extraction unit that outputs movement information indicating a movement region, a reference part disappearance judgment unit that generates a reference part disappearance information, a timing judgment unit that judges whether first timing indicated by the reference part disappearance information and second timing of occurrence of a frame in which the movement region overlaps with the reference part region indicated by the reference part information are synchronized with each other or not and outputs a timing judgment result as the result of the judging, and an operation judgment unit that judges contents of a gesture operation performed by an operator based on the timing judgment result and the movement information.
    Type: Grant
    Filed: April 21, 2017
    Date of Patent: July 21, 2020
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Yudai Nakamura, Masashi Kamiya, Masahiro Naito
  • Publication number: 20200143150
    Abstract: A gesture judgment device includes a reference part detection unit that outputs reference part information indicating a reference part region, a movement extraction unit that outputs movement information indicating a movement region, a reference part disappearance judgment unit that generates a reference part disappearance information, a timing judgment unit that judges whether first timing indicated by the reference part disappearance information and second timing of occurrence of a frame in which the movement region overlaps with the reference part region indicated by the reference part information are synchronized with each other or not and outputs a timing judgment result as the result of the judging, and an operation judgment unit that judges contents of a gesture operation performed by an operator based on the timing judgment result and the movement information.
    Type: Application
    Filed: April 21, 2017
    Publication date: May 7, 2020
    Applicant: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Yudai NAKAMURA, Masashi KAMIYA, Masahiro NAITO
  • Patent number: 10624538
    Abstract: An eyelid detection device includes a face feature point detecting unit for detecting outer and inner eye corners as face feature points from a captured image, an eye region detecting unit for detecting an eye region including both an upper eyelid area and an eye area from the captured image on the basis of the face feature points, and an upper eyelid detecting unit for, for each of a plurality of divided areas into which the eye region is divided, detecting the boundary between the upper eyelid area and the eye area on the basis of the pattern of arrangement of the intensity values of pixels aligned in the divided region, and for connecting the boundary detected for each of the divided regions, to determine an upper eyelid.
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: April 21, 2020
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Natsuki Tahara, Yudai Nakamura, Takashi Hirano, Masanobu Osawa
  • Publication number: 20190370579
    Abstract: There are included: a frequency distribution creating unit for referring to the face information detected by the face information detecting unit, and when a preset change occurs in the driver's face, creating a frequency distribution of face information in a preset time section from the face information detected by a face information detecting unit; a mode value calculating unit for calculating a mode value of the face information from the frequency distribution created; and a reference value calculating unit for calculating a reference value indicating a steady state of the driver from the mode value of the face information.
    Type: Application
    Filed: February 15, 2017
    Publication date: December 5, 2019
    Applicant: Mitsubishi Electric Corporation
    Inventors: Hisashi SUGAWARA, Ryosuke TORAMA, Yudai NAKAMURA
  • Publication number: 20190350471
    Abstract: A remote photoplethysmography (RPPG) system includes an input interface to receive a sequence of measurements of intensities of different regions of a skin of a person indicative of vital signs of the person; a solver to solve an optimization problem to determine frequency coefficients of photoplethysmographic waveforms corresponding to the measured intensities at the different regions, wherein the solver determines the frequency coefficients to reduce a distance between intensities of the skin reconstructed from the frequency coefficients and the corresponding measured intensities of the skin while enforcing joint sparsity on the frequency coefficients; and an estimator to estimate the vital signs of the person from the determined frequency coefficients of photoplethysmographic waveforms.
    Type: Application
    Filed: October 23, 2018
    Publication date: November 21, 2019
    Inventors: Tim Marks, Hassan Mansour, Ewa Nowara, Yudai Nakamura, Ashok Veeraraghavan
  • Patent number: 10460195
    Abstract: A luminance variation (dI) pertaining to each pixel is calculated (21) using a plurality of captured images obtained by image capturing under different illumination conditions, a texture variation (dF) pertaining to each pixel is calculated (22) using a plurality of captured images obtained by image capturing at different time points, and a subject region is extracted (23) based on the luminance variation (dI) and the texture variation (dF). A variation in the texture feature (F) pertaining to each pixel between the images is calculated as the texture variation (dF). The subject can be extracted with a high accuracy even when there are changes in the ambient light or the background.
    Type: Grant
    Filed: March 27, 2015
    Date of Patent: October 29, 2019
    Assignee: Mitsubishi Electric Corporation
    Inventors: Yudai Nakamura, Tomonori Fukuta, Masashi Kamiya, Masahiro Naito
  • Publication number: 20190320890
    Abstract: An eyelid detection device includes a face feature point detecting unit for detecting outer and inner eye corners as face feature points from a captured image, an eye region detecting unit for detecting an eye region including both an upper eyelid area and an eye area from the captured image on the basis of the face feature points, and an upper eyelid detecting unit for, for each of a plurality of divided areas into which the eye region is divided, detecting the boundary between the upper eyelid area and the eye area on the basis of the pattern of arrangement of the intensity values of pixels aligned in the divided region, and for connecting the boundary detected for each of the divided regions, to determine an upper eyelid.
    Type: Application
    Filed: January 17, 2017
    Publication date: October 24, 2019
    Applicant: Mitsubishi Electric Corporation
    Inventors: Natsuki TAHARA, Yudai NAKAMURA, Takashi HIRANO, Masanobu OSAWA
  • Publication number: 20190269321
    Abstract: A motion sickness estimation device includes: a line-of-sight oscillation detector to detect oscillation of a line of sight of an occupant by using an imaging device; an object oscillation detector to detect oscillation of an object located in the line of sight; an oscillation comparator to calculate an oscillation difference from the oscillation of the line of sight and the oscillation of the object; and a motion sickness determiner to determine, on a basis of the oscillation difference, whether the occupant is in a motion sickness state.
    Type: Application
    Filed: October 5, 2017
    Publication date: September 5, 2019
    Applicant: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Takuya MURAKAMI, Yudai NAKAMURA, Masahiro NAITO
  • Patent number: 10156909
    Abstract: Provided are a gesture recognition device, a gesture recognition method and an information processing device for making it possible to quickly recognize a gesture of a user. The gesture recognition device includes a motion information generator that generates body part motion information by performing detection and tracking of the body part, a prediction processor that makes a first comparison of comparing the generated body part motion information with previously stored pre-gesture motion model information and generates a prediction result regarding a pre-gesture motion on the basis of a result of the first comparison, and a recognition processor that makes a second comparison of comparing the generated body part motion information with previously stored gesture model information and generates a result of recognition of the gesture represented by a motion of the detected body part on the basis of the prediction result and a result of the second comparison.
    Type: Grant
    Filed: April 15, 2016
    Date of Patent: December 18, 2018
    Assignee: MITSUBISHI ELECTRIC CORPORATION
    Inventors: Masashi Kamiya, Yudai Nakamura
  • Patent number: 9939909
    Abstract: A hand region is detected in a captured image, and for each part of the background area, a light source presence degree indicating the probability that a light source is present is determined according to the luminance or color of that part; on the basis of the light source presence degree, a region in which the captured image is affected by a light source is estimated, and if the captured image includes a region estimated to be affected by a light source, whether or not a dropout has occurred in the hand region in the captured image is decided; on the basis of the result of this decision, an action is determined. Gesture determinations can be made correctly even when the hand region in the captured image is affected by a light source at the time of gesture manipulation input.
    Type: Grant
    Filed: May 15, 2014
    Date of Patent: April 10, 2018
    Assignee: Mitsubishi Electric Corporation
    Inventors: Nobuhiko Yamagishi, Yudai Nakamura, Tomonori Fukuta