Patents by Inventor Haisong Liu
Haisong Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11414052Abstract: The present invention includes: a vehicle exterior image acquisition unit acquiring a vehicle exterior image being an image of an external surrounding of a vehicle; a vehicle interior image acquisition unit acquiring a vehicle interior image being an image of an interior of the vehicle; a person recognition unit respectively recognizing, based on the vehicle exterior and interior images, motions of a person outside the vehicle and a person in the vehicle; and a door control unit controlling a state of a door of the vehicle, wherein, if a person outside the vehicle approaching the vehicle has been recognized based on a recognition result of the person recognition unit, the door control unit executes an opening operation on the door if it has been determined that the person in the vehicle has performed a specific motion determined in advance regarding the approaching person outside the vehicle.Type: GrantFiled: May 25, 2021Date of Patent: August 16, 2022Assignee: HONDA MOTOR CO., LTD.Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Patent number: 11399158Abstract: A vehicle control system: allows a first camera to repeatedly capture an image around a vehicle at a predetermined interval to determine, with a first accuracy, whether or not the captured image includes a possible facial image of a user of the vehicle; sets the polling interval in accordance with a predetermined polling interval setting condition; allows a second camera to capture an image around the vehicle to determine, with a second accuracy higher than the first accuracy, whether or not the captured image includes a facial image of the user in a case where the captured image is determined to include the possible facial image of the user; and permits the user to enter the vehicle in a case where the captured image is recognized to include the facial image of the user.Type: GrantFiled: February 3, 2021Date of Patent: July 26, 2022Assignee: HONDA MOTOR CO., LTD.Inventors: Haisong Liu, Ryo Morosawa, Seonghun Lee, Katsuyasu Yamane
-
Patent number: 11364876Abstract: A vehicle control device includes: an unregistered-user-face-image acquiring unit that acquires an unregistered-user-face-image when an unregistered-user-getting-on recognizing unit recognizes that an unregistered user gets on the vehicle, the unregistered-user-face-image being a face image of the unregistered user; and a vehicle entry control unit that sets vehicle to a first entry-enabled-state when a matching degree between a user-candidate-face-image and the unregistered-user-face-image is equal to or higher than a first determination level, after the unregistered-user-getting-on recognizing unit recognizes that the unregistered user gets on the vehicle until a predetermined time elapses, the user-candidate-face-image being acquired by a user-candidate-face-image acquiring unit.Type: GrantFiled: March 10, 2021Date of Patent: June 21, 2022Assignee: HONDA MOTOR CO., LTD.Inventors: Ryo Morosawa, Haisong Liu, Fumiaki Yamaguchi, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi
-
Patent number: 11279320Abstract: An entry support system includes: a first identification information acquisition unit which acquires first identification information of a first related person in a first predetermined relation with a registered user; a first related person authentication unit which determines whether or not an externally located person is the first related person when the externally located person is recognized by an externally located person recognition unit in a state where an internal user determined as the registered user by a registered user authentication unit is recognized by an internal user recognition unit; and an entry permission unit which executes entry permission processing for enabling entry of the externally located person to a closed space from an entrance, when the externally located person is determined as the first related person by the first related person authentication unit.Type: GrantFiled: May 25, 2021Date of Patent: March 22, 2022Assignee: HONDA MOTOR CO., LTD.Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370882Abstract: A vehicle control system includes: a service arrangement information acquisition unit which acquires service arrangement information including identification information of at least either one of a person in charge of a service who executes a predetermined service that targets a predetermined vehicle and a service vehicle used when executing the predetermined service; a surrounding object recognition unit which recognizes an object present in an area around the predetermined vehicle; and a service reception handling unit which executes predetermined processing for receiving the predetermined service in a case where the object is determined as the service vehicle or the person in charge of the service by an object authentication unit.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370873Abstract: An entry support system includes: a first identification information acquisition unit which acquires first identification information of a first related person in a first predetermined relation with a registered user; a first related person authentication unit which determines whether or not an externally located person is the first related person when the externally located person is recognized by an externally located person recognition unit in a state where an internal user determined as the registered user by a registered user authentication unit is recognized by an internal user recognition unit; and an entry permission unit which executes entry permission processing for enabling entry of the externally located person to a closed space from an entrance, when the externally located person is determined as the first related person by the first related person authentication unit.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370883Abstract: An entry support system includes: an externally located person reporting unit which executes predetermined reporting by a reporting unit used by an internal user when an externally located person is recognized by an externally located person recognition unit in a state where the internal user is recognized by an internal user recognition unit; and an entry permission unit which executes entry permission processing for enabling entry to a vehicle when a permission operation of the entry to the vehicle is performed to an operation unit used by the internal user after the predetermined reporting is executed.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370878Abstract: The present invention includes: a vehicle exterior image acquisition unit acquiring a vehicle exterior image being an image of an external surrounding of a vehicle; a vehicle interior image acquisition unit acquiring a vehicle interior image being an image of an interior of the vehicle; a person recognition unit respectively recognizing, based on the vehicle exterior and interior images, motions of a person outside the vehicle and a person in the vehicle; and a door control unit controlling a state of a door of the vehicle, wherein, if a person outside the vehicle approaching the vehicle has been recognized based on a recognition result of the person recognition unit, the door control unit executes an opening operation on the door if it has been determined that the person in the vehicle has performed a specific motion determined in advance regarding the approaching person outside the vehicle.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370867Abstract: The present invention includes: a vehicle exterior image acquisition unit acquiring a vehicle exterior image, a vehicle interior image acquisition unit acquiring a vehicle interior image, a person recognition unit recognizing, based on the vehicle exterior and interior images, a presence of a person in the vehicle and a motion of a person outside the vehicle, a door control unit controlling a state of a door of the vehicle, and a motion determination unit determining a specific motion to be carried out when the person outside the vehicle instructs an opening operation of the door, wherein the door control unit executes the opening operation when the person outside the vehicle has performed the specific motion, if the presence of a person in the vehicle has been recognized based on a recognition result of the person recognition unit.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210374433Abstract: In a vehicle control system, when a vehicle peripheral condition recognizing unit recognizes a person outside a vehicle and the vehicle peripheral condition recognizing unit recognizes an in-vehicle user, a notification control unit performs notification processing on outside of the vehicle, based on personal information which is predetermined information relating to the in-vehicle user or an action taken by at least one of the person outside the vehicle and the in-vehicle user.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210370866Abstract: The present invention includes: a vehicle exterior image acquisition unit acquiring a vehicle exterior image being an image of an external surrounding of a vehicle; a vehicle interior image acquisition unit acquiring a vehicle interior image being an image of an interior of the vehicle; a person recognition unit recognizing, based on the vehicle exterior and interior images, respective motions of a person outside the vehicle and a person in the vehicle; and a door control unit controlling a state of a door of the vehicle, wherein, if a person outside the vehicle approaching the vehicle has been recognized based on a recognition result of the person recognition unit, if the person in the vehicle has performed an instruction motion indicating any seat of the vehicle, the door control unit executes an opening operation on the door corresponding to the seat indicated by the instruction motion.Type: ApplicationFiled: May 25, 2021Publication date: December 2, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210293074Abstract: A vehicle control device includes a power door control unit that executes first power-door-opening control for causing a power door to perform an opening operation, when the power door is in a closed state and a vehicle-interior-situation recognizing unit recognizes a first user who uses a predetermined seat provided in a vehicle, and when a vehicle-surrounding-situation recognizing unit recognizes that a second user who has got off the vehicle approaches the power door corresponding to the predetermined seat.Type: ApplicationFiled: March 10, 2021Publication date: September 23, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210293073Abstract: A vehicle control device includes a power door control unit that: when a getting-off-intention of a user is recognized by a getting-off-intention recognizing unit, determines whether a door-opening-prohibition condition of a predetermined door is satisfied based on a surrounding situation of a vehicle recognized by a vehicle-surrounding-situation recognizing unit; and executes power-door-automatic-opening control, the power-door-automatic-opening control causing a power door to perform an opening operation when the door-opening-prohibition condition is not satisfied, the power-door-automatic-opening control prohibiting the opening operation of the power door when the door-opening-prohibition condition is satisfied.Type: ApplicationFiled: March 9, 2021Publication date: September 23, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210291790Abstract: A vehicle control device includes: an unregistered-user-face-image acquiring unit that acquires an unregistered-user-face-image when an unregistered-user-getting-on recognizing unit recognizes that an unregistered user gets on the vehicle, the unregistered-user-face-image being a face image of the unregistered user; and a vehicle entry control unit that sets vehicle to a first entry-enabled-state when a matching degree between a user-candidate-face-image and the unregistered-user-face-image is equal to or higher than a first determination level, after the unregistered-user-getting-on recognizing unit recognizes that the unregistered user gets on the vehicle until a predetermined time elapses, the user-candidate-face-image being acquired by a user-candidate-face-image acquiring unit.Type: ApplicationFiled: March 10, 2021Publication date: September 23, 2021Inventors: Ryo Morosawa, Haisong Liu, Fumiaki Yamaguchi, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi
-
Publication number: 20210291781Abstract: A vehicle control device includes: an on-vehicle-user-number recognizing unit that performs recognition of an on-vehicle-user-number, and stores the on-vehicle-user-number in a storage unit, the on-vehicle-user-number being a number of users who have got on a vehicle; an off-vehicle-user-number recognizing unit that recognizes an off-vehicle-user-number, the off-vehicle-user-number being a number of the users who have got off the vehicle after the recognition of the on-vehicle-user-number by the on-vehicle-user-number recognizing unit; and a power door control unit that causes at least one power door to perform closing operation when the on-vehicle-user-number stored in the storage unit equals the off-vehicle-user-number recognized by the off-vehicle-user-number recognizing unit, the at least one power door being a power door that the user has used at a time of getting off the vehicle.Type: ApplicationFiled: March 10, 2021Publication date: September 23, 2021Inventors: Ryo Morosawa, Haisong Liu, Akira Nakajima, Kenji Okuma, Hiroaki Maruyama, Yoshikazu Matsuo, Shuto Higashi, Fumiaki Yamaguchi
-
Publication number: 20210248389Abstract: A vehicle control system includes: a possible user determination section that allows a first camera having a first resolution to capture an image around a vehicle to determine whether or not the captured image includes a possible facial image of a user; a user determination section that allows a second camera having a second resolution which is higher than the first resolution and consuming more power than the first camera to capture an image around the vehicle to determine whether or not the captured image includes a facial image of the user in a case where the possible user determination section determines that the possible facial image of the user is included; and an entry permission section that permits the user to enter the vehicle in a case where the user determination section recognizes that the facial image of the user is included.Type: ApplicationFiled: February 3, 2021Publication date: August 12, 2021Inventors: Haisong Liu, Ryo Morosawa, Seonghun Lee, Katsuyasu Yamane
-
Publication number: 20210250554Abstract: A vehicle control system includes: a possible user determination section that allows a first camera to repeatedly capture an image around a vehicle at a predetermined interval to determine, with a first accuracy, whether or not the captured image includes a possible facial image of a user of the vehicle; a polling interval setting section that sets the polling interval in accordance with a predetermined polling interval setting condition; a user determination section that allows a second camera to capture an image around the vehicle to determine, with a second accuracy higher than the first accuracy, whether or not the captured image includes a facial image of the user in a case where the possible user determination section determines that the captured image includes the possible facial image of the user; and an entry permission section that permits the user to enter the vehicle in a case where the user determination section recognizes that the captured image includes the facial image of the user.Type: ApplicationFiled: February 3, 2021Publication date: August 12, 2021Inventors: Haisong Liu, Ryo Morosawa, Seonghun Lee, Katsuyasu Yamane
-
Publication number: 20210214990Abstract: A vehicle control device includes image capturing units, control equipment that extracts at least one living body from image information captured by the image capturing units and performs processing, and a door operating system capable of unlocking the doors of a vehicle and executing an opening operation for the doors. When a user of the vehicle is included among a plurality of the extracted living bodies and it is estimated that a predetermined type of living body is in contact with the user, the control equipment causes the doors to be operated in a first mode. When the user is included among the plurality of the extracted living bodies and it is estimated that the predetermined type of living body is not in contact with the user, the control equipment causes the doors to be operated in a second mode that differs from the first mode.Type: ApplicationFiled: January 13, 2021Publication date: July 15, 2021Inventors: Ryo MOROSAWA, Katsuyasu YAMANE, Haisong LIU, Seonghun LEE
-
Patent number: 11002736Abstract: SUSD2 protein is used as a marker in identification, selection or separation of pancreatic internal secretion precursor cells and/or newborn pancreatic internal secretion cells; and a use of an mRNA, for encoding the SUSD2 protein, of a precursor protein as the marker in identification of the pancreatic internal secretion precursor cells and/or the newborn pancreatic internal secretion cells. Analysis of gene expression of pancreatic endoderm cells sourced by induced directional differentiation of human pluripotent stem cells finds the enrichment expression of a SUSD2 gene in the pancreatic internal secretion precursor cells and the newborn pancreatic internal secretion cells. A protein encoded by the SUSD2 gene is a receptor protein on cell membranes. Using the protein as the marker, the identification, the selection or the separation of the pancreatic internal secretion precursor cells and the newborn pancreatic internal secretion cells can be conducted.Type: GrantFiled: August 4, 2015Date of Patent: May 11, 2021Assignees: PEKING UNIVERSITY, PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL, BEIJING RUIPU CHENCHUANG TECHNOLOGY CO., LTD.Inventors: Hongkui Deng, Haisong Liu, Dicong Zhu, Huan Yang, Zhen Liang
-
Patent number: 10993076Abstract: A vehicle control apparatus includes: a distance acquiring unit that acquires a distance between the vehicle and a mobile terminal having an unlocking function of the vehicle; and a lighting control unit that controls lit states of room lights and under lights that are provided to the vehicle.Type: GrantFiled: March 10, 2020Date of Patent: April 27, 2021Assignee: HONDA MOTOR CO., LTD.Inventors: Kenya Sakurai, Ryo Morosawa, Haisong Liu, Katsuyasu Yamane, Tomoya Nishino