Patents by Inventor Yudai NAKAMURA
Yudai NAKAMURA has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11787421Abstract: A motion sickness estimation device including processing circuitry configured to calculate a sensory conflict amount on a basis of a motion of an occupant's head caused by vibration of a vehicle; extract a feature of a traveling situation on a basis of at least one of the motion of the occupant's head or a motion of the vehicle; determine a habituation progress state, which is a state in which the occupant's habituation to the traveling situation has progressed, on a basis of biometric information of the occupant; set sensitivity to the feature of the traveling situation on a basis of the habituation progress state; correct the sensory conflict amount on a basis of the sensitivity; and estimate a motion sickness state of the occupant on a basis of the sensory conflict amount that has been corrected.Type: GrantFiled: January 9, 2020Date of Patent: October 17, 2023Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Yudai Nakamura, Masahiro Naito
-
Publication number: 20230200684Abstract: A respiration information estimation device includes a specific region setting unit that sets a specific region and a motion vector calculation point as a point as a reference of a motion vector based on an image including an upper body of an object person, a motion vector calculation unit that calculates the motion vector from a movement amount of the motion vector calculation point in each of the images captured consecutively, a respiration reference axis calculation unit that calculates a respiration reference axis from a respiration central point and the motion vector calculation point, a respiration signal calculation unit that calculates a respiration signal from a component of the motion vector in a direction of the respiration reference axis, and a respiration information calculation unit that calculates a respiration information estimation result, as a result of estimating a body motion caused by the respiration, from the respiration signal.Type: ApplicationFiled: June 2, 2020Publication date: June 29, 2023Applicant: Mitsubishi Electric CorporationInventors: Taichi KOJIMA, Yudai NAKAMURA
-
Publication number: 20220135054Abstract: A motion sickness estimation device including processing circuitry configured to calculate a sensory conflict amount on a basis of a motion of an occupant's head caused by vibration of a vehicle; extract a feature of a traveling situation on a basis of at least one of the motion of the occupant's head or a motion of the vehicle; determine a habituation progress state, which is a state in which the occupant's habituation to the traveling situation has progressed, on a basis of biometric information of the occupant; set sensitivity to the feature of the traveling situation on a basis of the habituation progress state; correct the sensory conflict amount on a basis of the sensitivity; and estimate a motion sickness state of the occupant on a basis of the sensory conflict amount that has been corrected.Type: ApplicationFiled: January 9, 2020Publication date: May 5, 2022Applicant: Mitsubishi Electric CorporationInventors: Yudai NAKAMURA, Masahiro NAITO
-
Patent number: 11259710Abstract: A remote photoplethysmography (RPPG) system includes an input interface to receive a sequence of measurements of intensities of different regions of a skin of a person indicative of vital signs of the person; a solver to solve an optimization problem to determine frequency coefficients of photoplethysmographic waveforms corresponding to the measured intensities at the different regions, wherein the solver determines the frequency coefficients to reduce a distance between intensities of the skin reconstructed from the frequency coefficients and the corresponding measured intensities of the skin while enforcing joint sparsity on the frequency coefficients; and an estimator to estimate the vital signs of the person from the determined frequency coefficients of photoplethysmographic waveforms.Type: GrantFiled: October 23, 2018Date of Patent: March 1, 2022Assignee: Mitsubishi Electric Research Laboratories, Inc.Inventors: Hassan Mansour, Tim Marks, Ewa Nowara, Yudai Nakamura, Ashok Veeraraghavan
-
Patent number: 11200417Abstract: An area extraction unit (2) extracts an eye area in an image of a driver. An eyelid detection unit (3) detects an eyelid in the eye area. A reliability calculation unit (4) calculates an eyelid reliability by using luminance information of the eye area and positional information of the eyelid detected by the eyelid detection unit (3). A determination unit (5) determines that the eyelid has not been properly detected, when the eyelid reliability is less than a first threshold value.Type: GrantFiled: February 13, 2018Date of Patent: December 14, 2021Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Kazuki Kunihiro, Yudai Nakamura, Takashi Hirano
-
Publication number: 20210224983Abstract: A remote photoplethysmography (RPPG) system for estimating vital signs of a person is provided. The RPPG system is configured to receive a set of imaging photoplethysmography (iPPG) signals measured from different regions of a skin of a person. The RPPG system is further configured to determine frequency coefficients at the frequency bins of the quantized frequency spectrum of the measured iPPG signals by minimizing a distance between the measured iPPG signals and corresponding iPPG signals reconstructed from the determined frequency coefficients, while enforcing joint sparsity of the determined frequency coefficients subject to the sparsity level constraint, such that the determined frequency coefficients of different iPPG signals have the non-zero values at the same frequency bins; and output one or a combination of the determined frequency coefficients, the iPPG signals reconstructed from the determined frequency coefficients, and a vital sign signal corresponding to the reconstructed iPPG signals.Type: ApplicationFiled: March 12, 2021Publication date: July 22, 2021Applicants: Mitsubishi Electric Research Laboratories, Inc., Mitsubishi Electric CorporationInventors: Tim Marks, Hassan Mansour, Ewa Nowara, Yudai Nakamura, Ashok Veeraghavan
-
Publication number: 20210186346Abstract: An information processing device includes a skin-region detecting unit, a measurement-region setting unit, a pulse-wave source signal extracting unit, a phase-coincidence-degree calculating unit, and a pulse-wave estimating unit. The skin-region detecting unit detects a skin region of a person in each of multiple frames in a predetermined time period. The measurement-region setting unit sets multiple measurement regions in the skin region. The pulse-wave source signal extracting unit extracts multiple pulse-wave source signals indicating a change in luminance from the multiple measurement regions. The phase-coincidence-degree calculating unit calculates multiple phase coincidence degrees each indicating a degree of phase coincidence between phases of corresponding base components constituting each of the multiple pulse-wave source signals.Type: ApplicationFiled: April 24, 2019Publication date: June 24, 2021Applicant: Mitsubishi Electric CorporationInventors: Yudai NAKAMURA, Masahiro NAITO
-
Patent number: 10949690Abstract: There are included: a frequency distribution creating unit for referring to the face information detected by the face information detecting unit, and when a preset change occurs in the driver's face, creating a frequency distribution of face information in a preset time section from the face information detected by a face information detecting unit; a mode value calculating unit for calculating a mode value of the face information from the frequency distribution created; and a reference value calculating unit for calculating a reference value indicating a steady state of the driver from the mode value of the face information.Type: GrantFiled: February 15, 2017Date of Patent: March 16, 2021Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Hisashi Sugawara, Ryosuke Torama, Yudai Nakamura
-
Publication number: 20210073510Abstract: An area extraction unit (2) extracts an eye area in an image of a driver. An eyelid detection unit (3) detects an eyelid in the eye area. A reliability calculation unit (4) calculates an eyelid reliability by using luminance information of the eye area and positional information of the eyelid detected by the eyelid detection unit (3). A determination unit (5) determines that the eyelid has not been properly detected, when the eyelid reliability is less than a first threshold value.Type: ApplicationFiled: February 13, 2018Publication date: March 11, 2021Applicant: MITSUBISHI ELECTRIC CORPORATIONInventors: Kazuki KUNIHIRO, Yudai NAKAMURA, Takashi HIRANO
-
Patent number: 10849496Abstract: A motion sickness estimation device includes: a line-of-sight oscillation detector to detect oscillation of a line of sight of an occupant by using an imaging device; an object oscillation detector to detect oscillation of an object located in the line of sight; an oscillation comparator to calculate an oscillation difference from the oscillation of the line of sight and the oscillation of the object; and a motion sickness determiner to determine, on a basis of the oscillation difference, whether the occupant is in a motion sickness state.Type: GrantFiled: October 5, 2017Date of Patent: December 1, 2020Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Takuya Murakami, Yudai Nakamura, Masahiro Naito
-
Patent number: 10719697Abstract: A gesture judgment device includes a reference part detection unit that outputs reference part information indicating a reference part region, a movement extraction unit that outputs movement information indicating a movement region, a reference part disappearance judgment unit that generates a reference part disappearance information, a timing judgment unit that judges whether first timing indicated by the reference part disappearance information and second timing of occurrence of a frame in which the movement region overlaps with the reference part region indicated by the reference part information are synchronized with each other or not and outputs a timing judgment result as the result of the judging, and an operation judgment unit that judges contents of a gesture operation performed by an operator based on the timing judgment result and the movement information.Type: GrantFiled: April 21, 2017Date of Patent: July 21, 2020Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Yudai Nakamura, Masashi Kamiya, Masahiro Naito
-
Publication number: 20200143150Abstract: A gesture judgment device includes a reference part detection unit that outputs reference part information indicating a reference part region, a movement extraction unit that outputs movement information indicating a movement region, a reference part disappearance judgment unit that generates a reference part disappearance information, a timing judgment unit that judges whether first timing indicated by the reference part disappearance information and second timing of occurrence of a frame in which the movement region overlaps with the reference part region indicated by the reference part information are synchronized with each other or not and outputs a timing judgment result as the result of the judging, and an operation judgment unit that judges contents of a gesture operation performed by an operator based on the timing judgment result and the movement information.Type: ApplicationFiled: April 21, 2017Publication date: May 7, 2020Applicant: MITSUBISHI ELECTRIC CORPORATIONInventors: Yudai NAKAMURA, Masashi KAMIYA, Masahiro NAITO
-
Patent number: 10624538Abstract: An eyelid detection device includes a face feature point detecting unit for detecting outer and inner eye corners as face feature points from a captured image, an eye region detecting unit for detecting an eye region including both an upper eyelid area and an eye area from the captured image on the basis of the face feature points, and an upper eyelid detecting unit for, for each of a plurality of divided areas into which the eye region is divided, detecting the boundary between the upper eyelid area and the eye area on the basis of the pattern of arrangement of the intensity values of pixels aligned in the divided region, and for connecting the boundary detected for each of the divided regions, to determine an upper eyelid.Type: GrantFiled: January 17, 2017Date of Patent: April 21, 2020Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Natsuki Tahara, Yudai Nakamura, Takashi Hirano, Masanobu Osawa
-
Publication number: 20190370579Abstract: There are included: a frequency distribution creating unit for referring to the face information detected by the face information detecting unit, and when a preset change occurs in the driver's face, creating a frequency distribution of face information in a preset time section from the face information detected by a face information detecting unit; a mode value calculating unit for calculating a mode value of the face information from the frequency distribution created; and a reference value calculating unit for calculating a reference value indicating a steady state of the driver from the mode value of the face information.Type: ApplicationFiled: February 15, 2017Publication date: December 5, 2019Applicant: Mitsubishi Electric CorporationInventors: Hisashi SUGAWARA, Ryosuke TORAMA, Yudai NAKAMURA
-
Publication number: 20190350471Abstract: A remote photoplethysmography (RPPG) system includes an input interface to receive a sequence of measurements of intensities of different regions of a skin of a person indicative of vital signs of the person; a solver to solve an optimization problem to determine frequency coefficients of photoplethysmographic waveforms corresponding to the measured intensities at the different regions, wherein the solver determines the frequency coefficients to reduce a distance between intensities of the skin reconstructed from the frequency coefficients and the corresponding measured intensities of the skin while enforcing joint sparsity on the frequency coefficients; and an estimator to estimate the vital signs of the person from the determined frequency coefficients of photoplethysmographic waveforms.Type: ApplicationFiled: October 23, 2018Publication date: November 21, 2019Inventors: Tim Marks, Hassan Mansour, Ewa Nowara, Yudai Nakamura, Ashok Veeraraghavan
-
Patent number: 10460195Abstract: A luminance variation (dI) pertaining to each pixel is calculated (21) using a plurality of captured images obtained by image capturing under different illumination conditions, a texture variation (dF) pertaining to each pixel is calculated (22) using a plurality of captured images obtained by image capturing at different time points, and a subject region is extracted (23) based on the luminance variation (dI) and the texture variation (dF). A variation in the texture feature (F) pertaining to each pixel between the images is calculated as the texture variation (dF). The subject can be extracted with a high accuracy even when there are changes in the ambient light or the background.Type: GrantFiled: March 27, 2015Date of Patent: October 29, 2019Assignee: Mitsubishi Electric CorporationInventors: Yudai Nakamura, Tomonori Fukuta, Masashi Kamiya, Masahiro Naito
-
Publication number: 20190320890Abstract: An eyelid detection device includes a face feature point detecting unit for detecting outer and inner eye corners as face feature points from a captured image, an eye region detecting unit for detecting an eye region including both an upper eyelid area and an eye area from the captured image on the basis of the face feature points, and an upper eyelid detecting unit for, for each of a plurality of divided areas into which the eye region is divided, detecting the boundary between the upper eyelid area and the eye area on the basis of the pattern of arrangement of the intensity values of pixels aligned in the divided region, and for connecting the boundary detected for each of the divided regions, to determine an upper eyelid.Type: ApplicationFiled: January 17, 2017Publication date: October 24, 2019Applicant: Mitsubishi Electric CorporationInventors: Natsuki TAHARA, Yudai NAKAMURA, Takashi HIRANO, Masanobu OSAWA
-
Publication number: 20190269321Abstract: A motion sickness estimation device includes: a line-of-sight oscillation detector to detect oscillation of a line of sight of an occupant by using an imaging device; an object oscillation detector to detect oscillation of an object located in the line of sight; an oscillation comparator to calculate an oscillation difference from the oscillation of the line of sight and the oscillation of the object; and a motion sickness determiner to determine, on a basis of the oscillation difference, whether the occupant is in a motion sickness state.Type: ApplicationFiled: October 5, 2017Publication date: September 5, 2019Applicant: MITSUBISHI ELECTRIC CORPORATIONInventors: Takuya MURAKAMI, Yudai NAKAMURA, Masahiro NAITO
-
Patent number: 10156909Abstract: Provided are a gesture recognition device, a gesture recognition method and an information processing device for making it possible to quickly recognize a gesture of a user. The gesture recognition device includes a motion information generator that generates body part motion information by performing detection and tracking of the body part, a prediction processor that makes a first comparison of comparing the generated body part motion information with previously stored pre-gesture motion model information and generates a prediction result regarding a pre-gesture motion on the basis of a result of the first comparison, and a recognition processor that makes a second comparison of comparing the generated body part motion information with previously stored gesture model information and generates a result of recognition of the gesture represented by a motion of the detected body part on the basis of the prediction result and a result of the second comparison.Type: GrantFiled: April 15, 2016Date of Patent: December 18, 2018Assignee: MITSUBISHI ELECTRIC CORPORATIONInventors: Masashi Kamiya, Yudai Nakamura
-
Patent number: 9939909Abstract: A hand region is detected in a captured image, and for each part of the background area, a light source presence degree indicating the probability that a light source is present is determined according to the luminance or color of that part; on the basis of the light source presence degree, a region in which the captured image is affected by a light source is estimated, and if the captured image includes a region estimated to be affected by a light source, whether or not a dropout has occurred in the hand region in the captured image is decided; on the basis of the result of this decision, an action is determined. Gesture determinations can be made correctly even when the hand region in the captured image is affected by a light source at the time of gesture manipulation input.Type: GrantFiled: May 15, 2014Date of Patent: April 10, 2018Assignee: Mitsubishi Electric CorporationInventors: Nobuhiko Yamagishi, Yudai Nakamura, Tomonori Fukuta