Patents Assigned to Honda Research Institute Europe GmbH
  • Patent number: 11049301
    Abstract: A system and method for automatically generating an appealing visual based on an original visual captured by a vehicle mounted camera are provided. A semantic image content and its arrangement in the original visual is computed; an optimization process is performed that improves an appeal of the original visual by making it more similar to a set of predetermined traits. The optimization process may include adding information to the original visual to generate an enhanced visual by adapting content from further visuals, and adapting iteratively a geometric parameter set of the enhanced visual to generate a certain perspective or morphing to improve an arrangement of semantics in the enhanced visual. The optimized parameter set may be applied to the enhanced visual. Post-processing may be conducted after applying the optimized parameter set using a set of templates to generate a final visual that may be output for immediate or later use.
    Type: Grant
    Filed: May 24, 2019
    Date of Patent: June 29, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Stefan Menzel, Bernhard Sendhoff, Thomas Weißwange
  • Patent number: 11021173
    Abstract: A system for automated execution of a maneuver or behavior determines at first a situation in which the system currently is based on environment sensing. Then, based on the determined situation, maneuver options or behavior options are determined. Such options are maneuvers or behaviors which potentially can be executed by the system in the determined situation. Then information on at least one of the determined maneuver options or behavior options are output using a haptic display. The system receives an input selecting one of the options from a user. On the basis of the selected option then the selected option or maneuver is executed in an automated fashion.
    Type: Grant
    Filed: May 29, 2018
    Date of Patent: June 1, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventor: Christian Goerick
  • Publication number: 20210156711
    Abstract: The invention relates to a method for analyzing localization errors, wherein the method includes the steps of obtaining relative positions and absolute positions of an object moving within a mapped environment, which are generated sequentially over time, calculating differences between the relative positions and absolute positions to determine sequential localization errors, and decomposing the localization errors into a systematic error that is dependent on the orientation of the object and into a systematic error that is independent on the orientation of the object by analyzing the intrinsic dynamics of the localization errors.
    Type: Application
    Filed: November 26, 2020
    Publication date: May 27, 2021
    Applicant: Honda Research Institute Europe GmbH
    Inventors: Benedict Flade, Julian Eggert, Axel Koppert, Simon Kohaut
  • Publication number: 20210110262
    Abstract: A computer-implemented method for detecting an anomalous operating status of a technical system. A training phase obtains a first set of time-series values generated by a digital twin simulation of the technical system for a regular operating status and a second set of time-series values measured by sensors in an anomalous operating status, and adjusts parameters of a machine learning model for detecting the regular operating status and for discriminating data samples of the regular operating status from data samples of the anomalous operating status to generate a trained machine learning model. A monitoring phase obtains a set of multivariate time-series values measured by the sensors, calculates an anomaly score value for determining whether the technical system is in an anomalous operating status based on the obtained set of multi-variate time-series values and the trained machine learning model, and outputs a signal including information on the determined anomalous operating status.
    Type: Application
    Filed: October 13, 2020
    Publication date: April 15, 2021
    Applicant: Honda Research Institute Europe GmbH
    Inventors: Sebastian Schmitt, Andrea Castellani, Stefano Squartini
  • Patent number: 10955852
    Abstract: A method and system for navigating a mobile system and corresponding mobile system is disclosed, in particular for autonomous mobile systems such as robots, for example lawn mowers or even smartphones. The mobile device includes at least one sensor, an electronic control unit, and an output unit. The method includes acquiring sensor data on an environment of the mobile device, calculating a gradient of a difference of a target environmental representation and a current environmental representation, and determining a movement direction to reach a target position corresponding to the target environmental representation based on the estimated gradient. The determined movement direction for navigating the mobile device is output, for example to a steering system of the mobile device or to a display. The method can include generating an environmental representation by performing unsupervised learning from the acquired sensor data.
    Type: Grant
    Filed: February 27, 2018
    Date of Patent: March 23, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Mathias Franzius, Benjamin Metka, Ute Bauer-Wersing
  • Patent number: 10940864
    Abstract: Control commands in a system and method for autonomously driving a vehicle or partially autonomously driving a vehicle are generated on the basis of an environment representation, which is generated from sensor signal of a sensing means. The environment representation where ambiguous objects are identified is such that information obtained from the driver of the vehicle are added. The system generates an information request. Additional information is extracted and accumulated in the environment representation map. Traffic is then determined and suitable control signals for the vehicles are generated. In case no ambiguous objects are included in the environment representation but the system is not capable of deciding on traffic, the driver is asked to disambiguate the situation or to instruct on dealing with the traffic.
    Type: Grant
    Filed: August 10, 2016
    Date of Patent: March 9, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Martin Heckmann, Heiko Wersing
  • Patent number: 10937175
    Abstract: The method for assisting a person in operating in a dynamic environment may form part of a mobility assistance system. The method comprises a step of acquiring sensor data comprising a time sequence of at least two consecutive images of the dynamic environment from at least one sensor, for example a camera. Optical flows are calculated based on the at least two consecutive images. Feature scores associated to spatial positions for selected regions in an image space are determined in order to generate a feature score field. An output signal including directional stimulus information is generated based on the generated feature score field, wherein the directional stimulus information comprises information on relative spatial relations between the selected regions. The generated output signal is provided to at least one actuator, which signals the directional stimulus information to the person.
    Type: Grant
    Filed: February 21, 2019
    Date of Patent: March 2, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Matti Kruger, Heiko Wersing, Julian Eggert
  • Patent number: 10915770
    Abstract: A method for assisting a driver of an ego-vehicle in making use of a gap between vehicles to enter a traffic flow at an intersection is suggested, comprising the following method steps: First, other vehicles in the environment of the ego-vehicle are physically sensed using at least one environment sensor mounted on the ego-vehicle. Second, a gap size of at least one gap between two successive vehicles are calculated in a processor based on the sensor's/sensors' output. An ego-vehicle driver's gazing behavior using at least one driver sensor mounted on the ego-vehicle is observed and analyzed and an assistance signal is generated based on the result of the analysis and the determined size of the at least one gap. Finally, a recommendation or warning perceivable for the ego-vehicle's driver is output in accordance with the assistance signal.
    Type: Grant
    Filed: November 18, 2019
    Date of Patent: February 9, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Martin Heckmann, Dennis Orth, Dorothea Kolossa
  • Patent number: 10912253
    Abstract: The invention regards a robotic gardening device comprising driving means for propelling the robotic gardening device, a working tool for performing dedicated gardening work and a controlling unit for controlling said driving means and the working tool and a method for controlling the same. The robotic gardening device further comprises at least one environment sensor generating a signal indicative of objects in the environment of the robotic gardening device, a computing unit for classifying these objects, wherein the classes comprise at least two different classes for objects being determined to be humans. The computing unit is configured to control the driving means and/or the working device according to a predetermined behavior associated with the respective objects class.
    Type: Grant
    Filed: September 21, 2017
    Date of Patent: February 9, 2021
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Nils Einecke, Mathias Franzius
  • Patent number: 10853528
    Abstract: In one aspect, a computer-assisted method for the optimization of the design of physical bodies, such as land, air and sea vehicles and robots and/or parts thereof, is provided comprising the steps of: representing the design to be optimized as a mesh, generating update signals to optimize the mesh representation, applying an optimization algorithm until a stop criterion has been reached, and outputting a signal representing the optimized design.
    Type: Grant
    Filed: January 23, 2014
    Date of Patent: December 1, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Markus Olhofer, Nikola Aulig
  • Patent number: 10824163
    Abstract: A method and a system can generate a representation of a working area of an autonomous lawn mower. The system can include an autonomous lawn mower and a base station, and a boundary wire forming a closed loop which can be connected with the base station. The lawn mower and the base station interact such that the lawn mower can determine whether it is in its home position, a predetermined position that is taken when the mower returns to the base station. The lawn mower further includes a memory, for storing values from a movement sensor. A trajectory is generated based on the values, wherein a processor is configured to calculate an error between the position and orientation according to the trajectory and the home position. This total position error and total orientation error is then used to correct the position and corresponding orientations of the trajectory.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: November 3, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Nils Einecke, Sven Rebhan, Mathias Franzius, Jörg Deigmöller, Keiji Muro
  • Patent number: 10809960
    Abstract: The invention regards a method for reproducing visual and/or audio data synchronously by a group of devices, as well as a system for realizing such method. According to the invention first, a spatial location of each of the devices of the group is determined. Then, the visual and/or audio content is partitioned into content parts, each part dedicated to be reproduced by one device of the group respectively, based on the spatial location of the device. The dedicated portions are transmitted to their associated devices together with a time stamp, and the group of devices reproduces commonly and synchronously the transmitted portions.
    Type: Grant
    Filed: May 28, 2019
    Date of Patent: October 20, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Nils Einecke, Stefan Menzel
  • Patent number: 10789836
    Abstract: The invention relates to a system and method for assisting a driver in driving a vehicle. First information on an environment of the vehicle is obtained and an instruction from the vehicle driver is received. An evaluation task defining an aspect of a current traffic situation encountered by the vehicle and to be evaluated is defined from the received instruction. An evaluation of the obtained information according to the evaluation task is performed, and an evaluation result is generated. Other aspects of the traffic situation and their relation to the aspect defined in the task are then evaluated additionally. Finally an information on the basis of the evaluation result and the other determined aspects is generated and output.
    Type: Grant
    Filed: April 19, 2017
    Date of Patent: September 29, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Martin Heckmann, Heiko Wersing
  • Patent number: 10753748
    Abstract: A system corrects errors of a measurement system. The system comprises base measurement system BS and a correction system. BS sensor data is acquired and provided to an algorithm. The data is stored associated with a time stamp indicating time of sensing. Output values are calculated and stored with time stamps indicating time of the sensor data upon which the output values are calculated. Data having corresponding time stamps are supplied to a filter where correction values and correction increments are calculated. The correction increments reflect the change of error in a base system output value over time due to integration or summing up BS sensor data errors in the processing algorithm. The correction values are applied to the BS data and corrected base navigation output values are calculated. These output values are corrected by the correction increments. Output values of the processing algorithm are further processed in succeeding applications.
    Type: Grant
    Filed: April 18, 2017
    Date of Patent: August 25, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventor: Nico Steinhardt
  • Patent number: 10636301
    Abstract: A method for assisting operation of an ego-vehicle in addressing a dynamic environment in which at least one further traffic object is present, an assistance system and a vehicle are provided. Information on the presence of the at least one other traffic object in the environment of the ego-vehicle is obtained. Then, information whether the other traffic participant has detected the ego-vehicle is obtained. Based on this information, a signal including information about whether the other traffic participant has detected the ego-vehicle is generated and supplied to an output device. An output signal is output based on the information whether the other traffic participant has detected the ego-vehicle, such that a parameter of the output signal is indicative of a detection probability of the detection of the ego-vehicle by the other traffic participant, an elapsed time since the detection and/or a complexity of the dynamic environment.
    Type: Grant
    Filed: March 14, 2019
    Date of Patent: April 28, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Christiane Wiebel-Herboth, Matti Kruger
  • Patent number: 10625776
    Abstract: The invention relates to a driving assistant adapted for active control of a vehicle based on predictions of a behavior of a detected object. A method aspect of the invention comprises accepting a first prediction of a behavior associated with the detected object from a first prediction subsystem and a second prediction from a second prediction subsystem; determining a control signal based on a combination of the first prediction and the second prediction; and initiating active control of the vehicle based on the control signal.
    Type: Grant
    Filed: September 5, 2014
    Date of Patent: April 21, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Sven Rebhan, Jens Schmüdderich, Marcus Kleinehagenbrock, Robert Kastner, Naoki Mori, Shunsuke Kusuhara, Hiroyuki Kamiya
  • Patent number: 10627812
    Abstract: An automotive driver assistance for a vehicle with an improved capability to handle obstructed sensor coverage includes steps of acquiring sensor data on an environment of the vehicle from at least one sensor, of generating an environment representation based on the acquired sensor data and of predicting at least one behavior of the vehicle. The method determines at least one area in the environment of the vehicle wherein for the at least one area either a confidence for the sensor data is below a threshold or no sensor data is available and generates at least one virtual traffic entity in the at least one determined area, wherein the virtual traffic entity is adapted to interact with the at least one predicted behavior of the vehicle. A risk measure for each combination of the at least one virtual traffic entity and the predicted behavior of the vehicle is estimated, the calculated risk measure is evaluated and a controlling action for the vehicle is executed based on the evaluated risk measure.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: April 21, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Julian Eggert, Tim Puphal, Tsukasa Sugino, Florian Damerow
  • Patent number: 10583831
    Abstract: A method and a system for communicating a an ego-vehicle's determined behavior to a target object is for use in a driver assistance system of a vehicle. The method includes steps of acquiring data of a traffic scene preferably by sensor means configured to sense an environment of the vehicle, calculating a prediction result including a target object's behaviour based on the acquired sensor data, determining an action of the host vehicle based on the prediction result and generating an actuation signal for performing the determined action, and determining a communication information indicating the determined action. The communication information is output to a communication means for communication to the target object via at least one of a lighting means of the vehicle and a car-to-x communication means.
    Type: Grant
    Filed: December 9, 2015
    Date of Patent: March 10, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventor: Jens Schmüdderich
  • Patent number: 10543854
    Abstract: The invention assists a person in acting in a dynamic environment. A method and a system for assisting a person operating an ego-vehicle a person supporting the operation of the ego-vehicle in a dynamic environment such as a traffic environment is proposed. The method encompasses determining a gaze direction of the person and identifying a target object based thereon, generating prediction information predicting a future behavior of the target object and the ego-vehicle, estimating a time-to-event or a distance or a distance variation for the ego-vehicle and the target object and generating a signal for driving an actuator and indicative of the estimated time-to-event, distance or distance variation. The actuator causes a stimulation being perceivable by the person by its perceptual capabilities based on the generated signal. The method determines whether assistance for assessing the dynamic situation is requested, for example by monitoring a gaze behavior of the person.
    Type: Grant
    Filed: October 19, 2018
    Date of Patent: January 28, 2020
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventors: Christiane Wiebel-Herboth, Matti Krüger
  • Patent number: 10475348
    Abstract: The invention regards a method and a system for assisting a person in acting in a dynamic environment. At first, information on states at least two entities in a common environment is obtained. A future behaviour of each of the entities is then predicted based on the obtained information and a time to event for at least one predetermined event involving the at least two entities and a position of occurrence of the event relative to the person is estimated. Then, a signal indicative of the relative direction of the predicted event with respect to the person and indicative of the time to event for driving an actuator is generated, the signal causing a stimulation being perceivable by the person by its perceptual capabilities, wherein the time to event is encoded such that the signal's saliency is the higher the smaller the time to event is.
    Type: Grant
    Filed: June 5, 2018
    Date of Patent: November 12, 2019
    Assignee: HONDA RESEARCH INSTITUTE EUROPE GMBH
    Inventor: Matti Krüger