Patents by Inventor Lukas Froehlich

Lukas Froehlich has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12246450
    Abstract: A computer-implemented method for for learning a policy. The method includes: recording at least an episode of interactions of the agent with its environment following policy and adding the recorded episode to a set of training data; optimizing a transition dynamics model based on the training data such that the transition dynamics model predicts the next states of the environment depending on the states and actions contained in the training data; optimizing policy parameters based on the training data and the transition dynamics model by optimizing a reward. In the method, the transition dynamics model comprises a first model characterizing the global model and a second model characterizing a correction model, which is configured to correct outputs of the first model.
    Type: Grant
    Filed: March 1, 2022
    Date of Patent: March 11, 2025
    Assignee: Robert Bosch GmbH
    Inventors: Felix Berkenkamp, Lukas Froehlich, Maksym Lefarov, Andreas Doerr
  • Patent number: 12158734
    Abstract: Methods for ascertaining a control strategy for a technical system using a Bayesian optimization method. The control strategy is created based on model parameters of a control model and is executable. The method includes providing a quality function whose shape corresponds to a regression function and that evaluates a quality of a controlling of the technical system based on model parameters; carrying out a Bayesian optimization method based on the quality function in order to iteratively ascertain a model parameter set having model parameters within a model parameter domain that indicates the permissible value ranges for the model parameters; and determining the model parameter domain for at least one of the model parameters as a function of an associated maximum a posteriori estimated value of the quality function.
    Type: Grant
    Filed: May 27, 2020
    Date of Patent: December 3, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: Lukas Froehlich, Christian Daniel, Edgar Klenske
  • Patent number: 12090662
    Abstract: A method is described for selecting evaluation points for a Bayesian optimization method for optimizing a physical or chemical process that is modeled by a statistical model. The method includes the ascertainment of a posterior model of the statistical model in accordance with the results of one or multiple evaluations at previous evaluation points and the selection of a next evaluation point by optimizing an acquisition function over a search space, which is given by a specified limit for the predictive variance of the points in the search space given by the posterior model.
    Type: Grant
    Filed: May 18, 2021
    Date of Patent: September 17, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: Edgar Klenske, Lukas Froehlich
  • Patent number: 11992943
    Abstract: A method for optimizing a predefined policy for a robot, the policy being a Gaussian mixture model. The method begins with an initialization of a Gaussian process, the Gaussian process including at least one kernel k which, as an input parameter, obtains a distance that is ascertained between probability distributions, which are characterized in each case by the Gaussian mixture model and the Gaussian process, according to the probability product kernel. This is followed by an optimization of the Gaussian process in such a way that it predicts the costs as a function of the parameters of the Gaussian mixture model. This is followed by an ascertainment of optimal parameters of the Gaussian mixture model as a function of the Gaussian process, the parameters being selected, as a function of the Gaussian process, in such a way that the Gaussian process outputs the optimal cost function.
    Type: Grant
    Filed: October 13, 2021
    Date of Patent: May 28, 2024
    Assignee: ROBERT BOSCH GMBH
    Inventors: Lukas Froehlich, Edgar Klenske, Leonel Rozo
  • Patent number: 11762346
    Abstract: A computer-implemented method for creating a control process for a technical system using a Bayesian optimization method, the control process being created and executable based on model parameters of a control model, the following steps being performed in order to optimize the control process: furnishing a quality function that corresponds to a trainable regression function, and that assesses a quality of a control process of the technical system based on model parameters; executing a Bayesian optimization method based on the quality function in order to iteratively ascertain an optimized model parameter set having model parameters, such that during execution of the Bayesian optimization method, a model parameter domain that indicates the permissible value ranges for the model parameters is expanded, by an amount equal to an expansion distance, with respect to those dimensions for which the model parameter ascertained in the current iteration lies at a range boundary.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: September 19, 2023
    Assignee: ROBERT BOSCH GMBH
    Inventors: Edgar Klenske, Lukas Froehlich
  • Publication number: 20220297290
    Abstract: A computer-implemented method for for learning a policy. The method includes: recording at least an episode of interactions of the agent with its environment following policy and adding the recorded episode to a set of training data; optimizing a transition dynamics model based on the training data such that the transition dynamics model predicts the next states of the environment depending on the states and actions contained in the training data; optimizing policy parameters based on the training data and the transition dynamics model by optimizing a reward. In the method, the transition dynamics model comprises a first model characterizing the global model and a second model characterizing a correction model, which is configured to correct outputs of the first model.
    Type: Application
    Filed: March 1, 2022
    Publication date: September 22, 2022
    Inventors: Felix Berkenkamp, Lukas Froehlich, Maksym Lefarov, Andreas Doerr
  • Publication number: 20220236698
    Abstract: Methods for ascertaining a control strategy for a technical system using a Bayesian optimization method. The control strategy is created based on model parameters of a control model and is executable. The method includes providing a quality function whose shape corresponds to a regression function and that evaluates a quality of a controlling of the technical system based on model parameters; carrying out a Bayesian optimization method based on the quality function in order to iteratively ascertain a model parameter set having model parameters within a model parameter domain that indicates the permissible value ranges for the model parameters; and determining the model parameter domain for at least one of the model parameters as a function of an associated maximum a posteriori estimated value of the quality function.
    Type: Application
    Filed: May 27, 2020
    Publication date: July 28, 2022
    Inventors: Lukas Froehlich, Christian Daniel, Edgar Klenske
  • Publication number: 20220197229
    Abstract: A computer-implemented method for creating a control process for a technical system using a Bayesian optimization method, the control process being created and executable based on model parameters of a control model, the following steps being performed in order to optimize the control process: furnishing a quality function that corresponds to a trainable regression function, and that assesses a quality of a control process of the technical system based on model parameters; executing a Bayesian optimization method based on the quality function in order to iteratively ascertain an optimized model parameter set having model parameters, such that during execution of the Bayesian optimization method, a model parameter domain that indicates the permissible value ranges for the model parameters is expanded, by an amount equal to an expansion distance, with respect to those dimensions for which the model parameter ascertained in the current iteration lies at a range boundary.
    Type: Application
    Filed: June 3, 2020
    Publication date: June 23, 2022
    Inventors: Edgar Klenske, Lukas Froehlich
  • Publication number: 20220126441
    Abstract: A method for optimizing a predefined policy for a robot, the policy being a Gaussian mixture model. The method begins with an initialization of a Gaussian process, the Gaussian process including at least one kernel k which, as an input parameter, obtains a distance that is ascertained between probability distributions, which are characterized in each case by the Gaussian mixture model and the Gaussian process, according to the probability product kernel. This is followed by an optimization of the Gaussian process in such a way that it predicts the costs as a function of the parameters of the Gaussian mixture model. This is followed by an ascertainment of optimal parameters of the Gaussian mixture model as a function of the Gaussian process, the parameters being selected, as a function of the Gaussian process, in such a way that the Gaussian process outputs the optimal cost function.
    Type: Application
    Filed: October 13, 2021
    Publication date: April 28, 2022
    Inventors: Lukas Froehlich, Edgar Klenske, Leonel Rozo
  • Publication number: 20210379761
    Abstract: A method is described for selecting evaluation points for a Bayesian optimization method for optimizing a physical or chemical process that is modeled by a statistical model. The method includes the ascertainment of a posterior model of the statistical model in accordance with the results of one or multiple evaluations at previous evaluation points and the selection of a next evaluation point by optimizing an acquisition function over a search space, which is given by a specified limit for the predictive variance of the points in the search space given by the posterior model.
    Type: Application
    Filed: May 18, 2021
    Publication date: December 9, 2021
    Inventors: Edgar Klenske, Lukas Froehlich