Patents by Inventor Hatsumi AOI

Hatsumi AOI has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11222439
    Abstract: An image processing apparatus includes a first learner trained to detect an orientation of a face in an image including a human face for receiving an input of a target image including a human face and outputting first information associated with an orientation of a face included in the target image, at least one second learner trained, for the first information, to detect a position of a facial component in an image including a human face for receiving an input of the target image and outputting second information associated with a position of a facial component included in the target image, and a control unit that controls the first learner and the second learner. The control unit uses the first learner to obtain the first information from the target image, and uses the second learner corresponding to the first information to obtain the second information from the target image.
    Type: Grant
    Filed: August 20, 2019
    Date of Patent: January 11, 2022
    Assignee: OMRON Corporation
    Inventors: Tomohiro Yabuuchi, Koichi Kinoshita, Tomoyoshi Aizawa, Tadashi Hyuga, Hatsumi Aoi, Mei Uetani
  • Patent number: 11188781
    Abstract: An image analyzer repeatedly obtains a captured image including a subject to be detected, and detects, in the captured image, a first area likely to include the subject without a cover, detects, in the captured image, a second area likely to include the subject with a cover, and determines whether the subject is covered by the cover based on a detection result of the first area and a detection result of the second area and a determination result for the captured image obtained previously.
    Type: Grant
    Filed: August 22, 2019
    Date of Patent: November 30, 2021
    Assignee: OMRON Corporation
    Inventors: Tomohiro Yabuuchi, Tomoyoshi Aizawa, Koichi Kinoshita, Tadashi Hyuga, Hatsumi Aoi, Mei Uetani
  • Patent number: 11027746
    Abstract: A driver state determination unit of a drive mode switching control device regularly or irregularly determines whether a driver's state is a state of being able to perform a driving operation in a manual drive mode. The drive mode switching control device determines whether an operation performed by the driver is an emergency override operation or a non-emergency override operation. The drive mode switching control device outputs a switching signal for switching an automatic drive mode to the manual drive mode when a determination result by the driver state determination unit immediately before detection of the emergency override operation is that a driver's state is a state of being able to perform a driving operation in the manual drive mode.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: June 8, 2021
    Assignee: OMRON Corporation
    Inventors: Hatsumi Aoi, Tomoyoshi Aizawa, Kazuyoshi Okaji, Hiroshi Sugahara, Michie Uno, Koji Takizawa
  • Publication number: 20200334477
    Abstract: A state estimation apparatus includes an image obtaining unit that obtains a captured image from an imaging device placed to capture an image of a target person to be at a predetermined position, a first analysis unit that analyzes a facial behavior of the target person based on the captured image and obtains first information about the facial behavior of the target person, a second analysis unit that analyzes body movement of the target person based on the captured image and obtains second information about the body movement of the target person, and an estimation unit that estimates a state of the target person based on the first information and the second information.
    Type: Application
    Filed: June 1, 2017
    Publication date: October 22, 2020
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Koichi KINOSHITA, Tomoyoshi AIZAWA, Hideto HAMABASHIRI, Tadashi HYUGA, Mei UETANI
  • Publication number: 20200064834
    Abstract: An operation switching support device whereby some of the labor of safety checking motion is taken off a driver at the time of switching from automatic operation to manual operation, and the switching to the manual operation can be conducted just with required safety checking motions, is provided, the operation switching support device, including an area checking urging processing part for conducting processing of urging checking of areas visually unconfirmed when the driver is decided to be in a state of being able to perform the manual operation by a driver state deciding part and the areas visually unconfirmed are decided to be present by a visual confirmation area deciding part, and a signal output part for outputting a signal for permitting switching from the automatic operation to the manual operation to an automatic operation control device after the urging processing.
    Type: Application
    Filed: November 27, 2017
    Publication date: February 27, 2020
    Applicant: OMRON CORPORATION
    Inventors: Tadashi HYUGA, Hatsumi AOI, Mei UETANI
  • Publication number: 20200018100
    Abstract: In an occupant assisting apparatus, a destination arrival determination unit determines whether a vehicle has arrived at a destination of an occupant, a situation determination unit determines whether a surrounding situation is safe for the occupant to exit the vehicle based on a sensing result obtained from a surrounding situation detection sensor for detecting the surrounding situation of the vehicle when the destination arrival determination unit determines that the vehicle has arrived at the destination, and a door lock controller unlocks a door at a doorway of the vehicle when the surrounding situation is determined to be safe for the occupant to exit the vehicle.
    Type: Application
    Filed: July 20, 2017
    Publication date: January 16, 2020
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Hiroshi SUGAHARA, Kazuyoshi OKAJI, Michie UNO, Koji TAKIZAWA
  • Publication number: 20200017123
    Abstract: A drive mode switch controller receives a switch request for switching from a manual drive mode to an automatic drive mode when switching the drive mode of a vehicle between the manual drive mode and the automatic drive mode. In response to the received switch request, the drive mode switch controller outputs a first switch signal for switching from the manual drive mode to the automatic drive mode, and a steering wheel operation command for disconnecting a steering wheel from wheels of the vehicle to allow the steering wheel to operate independently of the orientation of the wheels.
    Type: Application
    Filed: July 20, 2017
    Publication date: January 16, 2020
    Applicant: OMRON Corporation
    Inventors: Tomoyoshi AIZAWA, Hatsumi AOI, Kazuyoshi OKAJI, Hiroshi SUGAHARA, Michie UNO, Koji TAKIZAWA
  • Publication number: 20200001892
    Abstract: In a passenger assisting apparatus, a passenger information obtaining unit obtains a destination and a contact of a passenger, a state determination unit determines, at the destination for example, whether the passenger is able to exit the vehicle based on a sensing result from a passenger state detection sensor for detecting a state of the passenger. An awakening assistance unit performs an awakening operation for the passenger when the state determination unit determines that the passenger is unable to exit the vehicle, and a contact notification unit provides a notification to the contact obtained by the passenger information obtaining unit when the state determination unit determines that the passenger is unable to exit the vehicle after the awakening operation.
    Type: Application
    Filed: July 20, 2017
    Publication date: January 2, 2020
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Hiroshi SUGAHARA, Kazuyoshi OKAJI, Michie UNO, Koji TAKIZAWA
  • Publication number: 20190377967
    Abstract: An image analyzer repeatedly obtains a captured image including a subject to be detected, and detects, in the captured image, a first area likely to include the subject without a cover, detects, in the captured image, a second area likely to include the subject with a cover, and determines whether the subject is covered by the cover based on a detection result of the first area and a detection result of the second area and a determination result for the captured image obtained previously.
    Type: Application
    Filed: August 22, 2019
    Publication date: December 12, 2019
    Applicant: OMRON Corporation
    Inventors: Tomohiro YABUUCHI, Tomoyoshi AIZAWA, Koichi KINOSHITA, Tadashi HYUGA, Hatsumi AOI, Mei UETANI
  • Publication number: 20190375428
    Abstract: A driver state determination unit of a drive mode switching control device regularly or irregularly determines whether a driver's state is a state of being able to perform a driving operation in a manual drive mode. The drive mode switching control device determines whether an operation performed by the driver is an emergency override operation or a non-emergency override operation. The drive mode switching control device outputs a switching signal for switching an automatic drive mode to the manual drive mode when a determination result by the driver state determination unit immediately before detection of the emergency override operation is that a driver's state is a state of being able to perform a driving operation in the manual drive mode.
    Type: Application
    Filed: December 12, 2017
    Publication date: December 12, 2019
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Tomoyoshi AIZAWA, Kazuyoshi OKAJI, Hiroshi SUGAHARA, Michie UNO, Koji TAKIZAWA
  • Publication number: 20190370580
    Abstract: A driver monitoring apparatus according to an aspect of the present invention includes: an image obtaining unit that obtains a captured image from an imaging apparatus arranged so as to capture an image of a driver seated in a driver seat of a vehicle; an observation information obtaining unit that obtains observation information regarding the driver, the observation information including facial behavior information regarding behavior of a face of the driver; and a driver state estimating unit that inputs the captured image and the observation information to a trained learner that has been trained to estimate a degree of concentration of the driver on driving, and obtains, from the learner, driving concentration information regarding the degree of concentration of the driver on driving.
    Type: Application
    Filed: May 26, 2017
    Publication date: December 5, 2019
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Koichi KINOSHITA, Tomoyoshi AIZAWA, Tadashi HYUGA, Tomohiro YABUUCHI, Mei UETANI
  • Publication number: 20190370996
    Abstract: An image processing apparatus includes a first learner trained to detect an orientation of a face in an image including a human face for receiving an input of a target image including a human face and outputting first information associated with an orientation of a face included in the target image, at least one second learner trained, for the first information, to detect a position of a facial component in an image including a human face for receiving an input of the target image and outputting second information associated with a position of a facial component included in the target image, and a control unit that controls the first learner and the second learner. The control unit uses the first learner to obtain the first information from the target image, and uses the second learner corresponding to the first information to obtain the second information from the target image.
    Type: Application
    Filed: August 20, 2019
    Publication date: December 5, 2019
    Applicant: OMRON Corporation
    Inventors: Tomohiro YABUUCHI, Koichi KINOSHITA, Tomoyoshi AIZAWA, Tadashi HYUGA, Hatsumi AOI, Mei UETANI
  • Publication number: 20190318151
    Abstract: In a state where a tracking flag is on, a search controller determines, with respect to a previous frame, whether an amount of change in positional coordinates of a feature point of a face in the current frame is within a predetermined range, whether an amount of change in face orientation is within a predetermined angle range, and whether an amount of change in sight line direction is within a predetermined range. When the conditions are satisfied in all these determinations, the change in the detection result in the current frame with respect to the previous frame is considered as being within an allowable range, and continuously in a subsequent frame, detection processing for a face image is performed in accordance with a face image area saved in a tracking information storage unit.
    Type: Application
    Filed: March 20, 2019
    Publication date: October 17, 2019
    Applicant: OMRON Corporation
    Inventors: Daiki SHICHIJO, Tomoyoshi AIZAWA, Hatsumi AOI
  • Publication number: 20190318152
    Abstract: In a reference position determination unit, for example, a plurality of feature points of eyes and a nose of a face are detected by rough search from an image area including a driver's face extracted by a face area extractor with a rectangular frame. Based on the feature points of the respective organs, a position between eyebrows of the driver's face is detected, and this is determined as a reference position of the face. Then, a face area re-extractor corrects the position of the rectangular frame with respect to image data so that the determined reference position of the face is the center of the rectangular frame, and an image area including the face is re-extracted from the image data by using the rectangular frame in the corrected position.
    Type: Application
    Filed: March 12, 2019
    Publication date: October 17, 2019
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Tomoyoshi AIZAWA
  • Publication number: 20190318485
    Abstract: During tracking, a rough search is performed on a face image area detected in a current frame, and when the reliability of the result of the rough search is equal to or smaller than a threshold value, a value obtained by multiplying a reliability of a rough search result detected in one previous frame by a predetermined coefficient is set as a new threshold value, and it is determined whether or not the reliability of the rough search result detected in the current frame exceeds the newly set threshold value. Then, when the reliability of the rough search result exceeds the new threshold value, the decrease in reliability of the rough search result is considered as temporary, and a tracking flag is kept on while tracking information is also held.
    Type: Application
    Filed: March 14, 2019
    Publication date: October 17, 2019
    Applicant: OMRON Corporation
    Inventors: Daiki SHICHIJO, Tomoyoshi AIZAWA, Hatsumi AOI
  • Publication number: 20190243360
    Abstract: A mode switch controller controls mode switching for switching a drive mode of a vehicle between a manual drive mode and an automatic drive mode. The mode switch controller includes an obtaining unit and a calculation unit. The obtaining unit obtains sensing data representing a surrounding situation in a switching section defined for the mode switching from a sensor for monitoring surroundings of the vehicle. The calculation unit calculates a recommended mode switching position at which the mode switching is recommended in the switching section based on the sensing data.
    Type: Application
    Filed: April 15, 2019
    Publication date: August 8, 2019
    Applicant: OMRON Corporation
    Inventors: Mei UETANI, Tadashi HYUGA, Hatsumi AOI
  • Publication number: 20190232976
    Abstract: An assisting apparatus assists in mode switching for switching a drive mode of a vehicle between a manual drive mode and an automatic drive mode. The assisting apparatus includes an obtaining unit and a calculation unit. The obtaining unit obtains surrounding data representing a surrounding situation of the vehicle. The calculation unit calculates a recommended mode switching position at which the mode switching is recommended based on the obtained surrounding data.
    Type: Application
    Filed: April 12, 2019
    Publication date: August 1, 2019
    Applicant: OMRON Corporation
    Inventors: Mei UETANI, Tadashi HYUGA, Hatsumi AOI
  • Publication number: 20190210586
    Abstract: A drive mode switch controller receives a switch request for switching from a manual drive mode to an automatic drive mode when switching the drive mode of a vehicle between the manual drive mode and the automatic drive mode. The drive mode switch controller outputs, in response to the received switch request, a first switch signal for switching from the manual drive mode to the automatic drive mode, and a disconnecting command for disconnecting the steering wheel from the wheels of the vehicle.
    Type: Application
    Filed: July 20, 2017
    Publication date: July 11, 2019
    Applicant: OMRON Corporation
    Inventors: Tomoyoshi AIZAWA, Hatsumi AOI, Kazuyoshi OKAJI, Hiroshi SUGAHARA, Michie UNO, Koji TAKIZAWA
  • Publication number: 20190144003
    Abstract: To alert a driver looking in one direction for a relatively long time when changing the vehicle traveling direction, an apparatus includes a data obtaining unit, which obtains sensing data, a gaze direction detector, which detects a driver gaze direction, a gaze direction determiner, which determines distracted driving based on whether the gaze direction deviates by at least a predetermined angle from a traveling direction, and the deviation continues for at least a predetermined allowable duration allowing distracted driving, an alert controller, which outputs a signal instructing to generate an alert, a traveling direction determiner, which detects a change in the traveling direction, and a duration changer, which shortens the allowable duration in response to an intersection being recognized and a change detected in the traveling direction.
    Type: Application
    Filed: September 27, 2018
    Publication date: May 16, 2019
    Applicant: OMRON Corporation
    Inventors: Tadashi HYUGA, Tomoyoshi AIZAWA, Hatsumi AOI, Yoshio MATSUURA, Masato TANAKA, Keisuke YOKOTA, Hisashi SAITO
  • Publication number: 20190147264
    Abstract: A concentration determination apparatus compares a degree of concentration on driving with a first criterion when a location of a traveling vehicle is within a first area different from a dangerous area, and compares the degree of concentration on driving with a second criterion higher than the first criterion when the location of the traveling vehicle is within a second area corresponding to the dangerous area, and outputs an instruction signal for supporting the driver when the location of the traveling vehicle is within the second area and the degree of concentration on driving does not satisfy the second criterion.
    Type: Application
    Filed: September 14, 2018
    Publication date: May 16, 2019
    Applicant: OMRON Corporation
    Inventors: Hatsumi AOI, Tomoyoshi AIZAWA, Tadashi HYUGA