Patents by Inventor Kai Heesche

Kai Heesche has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12254389
    Abstract: A technical system controller is trained using a machine learning method. For this purpose, a chronological sequence of training data is detected for the machine learning method. The training data includes state data, which specifies states of the technical system, and control action data, which specifies control actions of the technical system. A chronological sequence of control action data is extracted specifically from the training data and is checked for a change over time. If a change over time is ascertained, a time window including the change is ascertained, and training data which can be found within the time window is extracted in a manner which is specific to the time window. The controller is then trained by the machine learning method using the extracted training data and is thus configured for controlling the technical system.
    Type: Grant
    Filed: June 26, 2019
    Date of Patent: March 18, 2025
    Assignee: Siemens Aktiengesellschaft
    Inventors: Siegmund Düll, Kai Heesche, Volkmar Sterzing, Marc Christian Weber
  • Publication number: 20240345546
    Abstract: For controlling a production system product version-specific training data sets are read in for each of multiple product versions. Each training data set comprises a design data set. The design data sets are fed into a machine learning module covering all product versions. An output signal is fed into both a first product version-specific machine learning module and also a second product version-specific machine learning module. The machine learning modules are jointly trained so that output data (O1) of the first machine learning module reproduces the performance values of the first product version and output data of the second machine learning module reproduces the performance values of the second product version. Then, a plurality of synthetic design data sets are generated and fed into the trained machine learning module. The resulting output signal is fed into the trained first machine learning module. A performance-optimized design data set is derived.
    Type: Application
    Filed: August 2, 2022
    Publication date: October 17, 2024
    Inventors: Markus Kaiser, Kai Heesche, Stefan Depeweg
  • Publication number: 20240280976
    Abstract: A machine learning module is provided trained to generate from a design data record specifying a design variant, a predictive performance distribution and a constraint compliance distribution of the design variant. A predictive performance distribution and a constraint compliance distribution are generated by the machine learning module. The predictive performance distribution is compared with performance values of previously evaluated design data records. A simulation of the corresponding design variant is either run or skipped. A design evaluation record is output which includes a performance value and constraint compliance data each derived from the simulation if the simulation is run or, otherwise, each derived from the predictive performance distribution and the constraint compliance distribution. Depending on the design evaluation records, a performance-optimizing and constraint-compliant design data record is selected from the variety of design data records.
    Type: Application
    Filed: February 14, 2024
    Publication date: August 22, 2024
    Inventors: Stefan Depeweg, Kai Heesche, Gabriel Amine-Eddine
  • Publication number: 20240241487
    Abstract: A plurality of test data sets include: a first design data set specifying a design variant of a product; and first target values, which quantify target variables of the design variant which are to be optimized and ranked. Furthermore, a plurality of design evaluation modules for predicting target values on the basis of design data sets is provided. For each of the design evaluation modules, a second ranking of the first design data sets with respect to the predicted target values and a deviation of the second ranking from the first ranking are then determined. One design evaluation module is then selected in accordance with the determined deviations. Furthermore, a plurality of second design data sets is generated, and are predicted by the selected design evaluation module. A target-value-optimized design data set is then derived from the second design data sets and is output for the manufacturing of the product.
    Type: Application
    Filed: May 10, 2022
    Publication date: July 18, 2024
    Inventors: Stefan Depeweg, Kai Heesche, Markus Kaiser
  • Patent number: 11994852
    Abstract: For reducing oscillations in a technical system plurality of different controller settings for the technical system is received. For a respective controller setting signal representing a time series of operational data of the technical system controlled by the respective controller setting is received, the signal is processed, whereby the processing includes a transformation into a frequency domain, and an entropy value of the processed signal is determined. Depending on the determined entropy values a controller setting from the plurality of controller settings is selected, and the selected controller setting is output for configuring the technical system.
    Type: Grant
    Filed: November 23, 2017
    Date of Patent: May 28, 2024
    Assignee: Siemens Aktiengesellschaft
    Inventors: Siegmund Düll, Kai Heesche, Gurdev Singh, Marc Christian Weber
  • Publication number: 20240160159
    Abstract: An operating signal is fed to a first machine learning module to reproduce a behavior signal of a technical system, the behavior signal occurring specifically without the current use of a control action and output the reproduced behavior signal as a first output signal. The first output signal is fed to a second machine learning module to reproduce a resulting behavior signal using a control action signal and output the reproduced behavior signal as a second output signal. Furthermore, an operating signal is fed to a third machine learning module, and a third output signal is fed to the trained second machine learning module. A control action performance ascertained using the second output signal, and the control action performance is used to train the third machine learning module to optimize the control action performance. By training the third machine learning module, a control device controls the technical system.
    Type: Application
    Filed: December 28, 2021
    Publication date: May 16, 2024
    Inventors: Daniel Hein, Marc Christian Weber, Holger Schöner, Steffen Udluft, Volkmar Sterzing, Kai Heesche
  • Patent number: 11898501
    Abstract: A method for controlling a gas turbine, having a measurement step, a prediction step which is carried out after the measurement step, and a control step which is carried out after the prediction step. In the measurement step, a state variable of a combustion within a gas turbine is measured. In the prediction step, a future combustion dynamic is predicted using the measured state variable. In the control step, a control signal is output using the prediction of the future combustion dynamic.
    Type: Grant
    Filed: March 18, 2020
    Date of Patent: February 13, 2024
    Assignee: Siemens Energy Global GmbH & Co. KG
    Inventors: Markus Kaiser, Kai Heesche
  • Publication number: 20240045386
    Abstract: In order to reproduce noise components of lossy recorded operating signals of a technical system, a neural network is trained to reproduce a recorded target operating signal and a statistical distribution of a stochastic component of the recorded target operating signal on the basis of a recorded input operating signal. A current input operating signal of the technical system is then supplied to the trained neural network. An output signal having a noise component modelled on the statistical distribution is generated on the basis of the supplied current input operating signal and a noise signal. The output signal is then output as the current target operating signal for controlling the technical system.
    Type: Application
    Filed: November 19, 2021
    Publication date: February 8, 2024
    Inventors: Stefan Depeweg, Kai Heesche
  • Publication number: 20240002159
    Abstract: A process for controlling a conveyor line for general cargo, the conveyor line including a plurality of consecutive conveyor line portions , each of which is driven by a drive. One or more sensors for detecting general cargo are located on at least some of the conveyor line portions. The drives are controlled by means of a computing unit using a machine learning model. The machine learning model accomplishes this by repeatedly receiving input data including a vector of a fixed length, each vector element being associated with a section of the conveyor line and indicating a current proportional occupancy of the respective section by an item of general cargo. Each conveyor line portion is split into a plurality of the sections of identical size. An apparatus or a system for data processing, a computer program, a computer-readable data carrier and a data carrier signal is also provided.
    Type: Application
    Filed: June 23, 2023
    Publication date: January 4, 2024
    Inventors: Michel Tokic, Anja von Beuningen, Martin Bischoff, Niklas Körwer, David Grossenbacher, Kai Heesche
  • Patent number: 11567461
    Abstract: In order to control a technical system using a control model, a transformation function is provided for reducing and/or obfuscating operating data of the technical system so as to obtain transformed operating data. In addition, the control model is generated by a model generator according to a first set of operating data of the technical system. In an access domain separated from the control model, a second set of operating data of the technical system is recorded and transformed by the transformation function into a transformed second set of operating data which is received by a model execution system. The control model is then executed by the model execution system, by supplying the transformed second set of operating data in an access domain separated from the second set of operating data, control data being derived from the transformed second set of operating data.
    Type: Grant
    Filed: July 25, 2017
    Date of Patent: January 31, 2023
    Inventors: Kai Heesche, Daniel Schneegaß
  • Publication number: 20220299984
    Abstract: A machine learning module is provided which is trained to generate from a design data record specifying a design variant of a product, a first performance signal quantifying a predictive performance of the design variant and a predictive uncertainty of the predictive performance. A variety of design data records each specifying a design variant of the product is generated. For a respective design data record, the following steps are performed: a first performance signal and a corresponding predictive uncertainty are generated, depending on the predictive uncertainty, a simulation yielding a second performance signal quantifying a simulated performance of the corresponding design variant is either run or skipped, and a performance value is derived from the second performance signal if the simulation is run or, otherwise, from the first performance signal. Depending on the derived performance values, a performance-optimizing design data record is determined and output to control the production plant.
    Type: Application
    Filed: March 10, 2022
    Publication date: September 22, 2022
    Inventors: Kai Heesche, Stefan Depeweg, Markus Kaiser
  • Publication number: 20220269226
    Abstract: A control device for a technical system, state-specific safety information about an admissibility of a control action signal is read in by a safety module is provided. Furthermore, a state signal indicating a state of the technical system is supplied to a machine learning module and to the safety module. In addition, an output signal of the machine learning module is supplied to the safety module. The output signal is converted into an admissible control action signal by the safety module on the basis of the safety information depending on the state signal. Furthermore, a performance for control of the technical system by the admissible control action signal is ascertained, and the machine learning module is trained to optimize the performance. The control device is then configured by the trained machine learning module.
    Type: Application
    Filed: February 17, 2022
    Publication date: August 25, 2022
    Inventors: Daniel Hein, Marc Christian Weber, Holger Schöner, Steffen Udluft, Volkmar Sterzing, Kai Heesche
  • Publication number: 20220220904
    Abstract: A method for controlling a gas turbine, having a measurement step, a prediction step which is carried out after the measurement step, and a control step which is carried out after the prediction step. In the measurement step, a state variable of a combustion within a gas turbine is measured. In the prediction step, a future combustion dynamic is predicted using the measured state variable. In the control step, a control signal is output using the prediction of the future combustion dynamic.
    Type: Application
    Filed: March 18, 2020
    Publication date: July 14, 2022
    Applicant: Siemens Energy Global GmbH & Co. KG
    Inventors: Markus Kaiser, Kai Heesche
  • Patent number: 11164077
    Abstract: A method of controlling a complex system and a gas turbine being controlled by the method are provided. The method comprises providing training data, which training data represents at least a portion of a state space of the system; setting a generic control objective for the system and a corresponding set point; and exploring the state space, using Reinforcement Learning, for a control policy for the system which maximizes an expected total reward. The expected total reward depends on a randomized deviation of the generic control objective from the corresponding set point.
    Type: Grant
    Filed: November 2, 2017
    Date of Patent: November 2, 2021
    Assignee: SIEMENS AKTIENGESELLSCHAFT
    Inventors: Siegmund Düll, Kai Heesche, Raymond S. Nordlund, Steffen Udluft, Marc Christian Weber
  • Publication number: 20210278810
    Abstract: In order to control a technical system using a control model, a transformation function is provided for reducing and/or obfuscating operating data of the technical system so as to obtain transformed operating data. In addition, the control model is generated by a model generator according to a first set of operating data of the technical system. In an access domain separated from the control model, a second set of operating data of the technical system is recorded and transformed by the transformation function into a transformed second set of operating data which is received by a model execution system. The control model is then executed by the model execution system, by supplying the transformed second set of operating data in an access domain separated from the second set of operating data, control data being derived from the transformed second set of operating data.
    Type: Application
    Filed: July 25, 2017
    Publication date: September 9, 2021
    Inventors: Kai Heesche, Daniel Schneegaß
  • Publication number: 20210256428
    Abstract: A technical system controller is trained using a machine learning method. For this purpose, a chronological sequence of training data is detected for the machine learning method. The training data includes state data, which specifies states of the technical system, and control action data, which specifies control actions of the technical system. A chronological sequence of control action data is extracted specifically from the training data and is checked for a change over time. If a change over time is ascertained, a time window including the change is ascertained, and training data which can be found within the time window is extracted in a manner which is specific to the time window. The controller is then trained by the machine learning method using the extracted training data and is thus configured for controlling the technical system.
    Type: Application
    Filed: June 26, 2019
    Publication date: August 19, 2021
    Inventors: Siegmund Düll, Kai Heesche, Volkmar Sterzing, Marc Christian Weber
  • Publication number: 20200371480
    Abstract: For reducing oscillations in a technical system plurality of different controller settings for the technical system is received. For a respective controller setting signal representing a time series of operational data of the technical system controlled by the respective controller setting is received, the signal is processed, whereby the processing includes a transformation into a frequency domain, and an entropy value of the processed signal is determined. Depending on the determined entropy values a controller setting from the plurality of controller settings is selected, and the selected controller setting is output for configuring the technical system.
    Type: Application
    Filed: November 23, 2017
    Publication date: November 26, 2020
    Inventors: Siegmund Düll, Kai Heesche, Gurdev Singh, Marc Christian Weber
  • Publication number: 20200320378
    Abstract: Provided is a method for the model-based determination of a system status of a dynamic system by means of a model, wherein: a recurrent neural network is provided as the model of the dynamic system; the model is supplied with a time series of potentially recordable measurement values as an input variable, the values comprising recorded and missing measurement values; at least one system status associated with a time point is generated from the model, from which status at least one target value belonging to the respective time point can be determined; sequential system statuses transition into one other by means of a respective status transition; and a correction of at least one system status is carried out on the basis of the time series with the aid of the status transition.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 8, 2020
    Inventors: Stefanie Vogl, Kai Heesche, Hans-Georg Zimmermann
  • Publication number: 20190130263
    Abstract: A method of controlling a complex system and a gas turbine being controlled by the method are provided. The method comprises providing training data, which training data represents at least a portion of a state space of the system; setting a generic control objective for the system and a corresponding set point; and exploring the state space, using Reinforcement Learning, for a control policy for the system which maximizes an expected total reward. The expected total reward depends on a randomized deviation of the generic control objective from the corresponding set point.
    Type: Application
    Filed: November 2, 2017
    Publication date: May 2, 2019
    Inventors: Siegmund Düll, Kai Heesche, Raymond S. Nordlund, Steffen Udluft, Marc Christian Weber
  • Patent number: 10133981
    Abstract: Disclosed is a method for the computer-assisted modeling of a technical system. One or more output vectors are modeled dependent on one or more input vectors by the learning process of a neural network on the basis of training data of known input vectors and output vectors. Each output vector comprises one or more operating variables of the technical system, and each input vector comprises one or more input variables that influence the operating variable(s). The neural network is a feedforward network with an input layer, a plurality of hidden layers, and an output layer. The output layer comprises a plurality of output clusters, each of which consists of one or more output neurons, the plurality of output clusters corresponding to the plurality of hidden layers. Each output cluster describes the same output vector and is connected to another hidden layer.
    Type: Grant
    Filed: July 24, 2012
    Date of Patent: November 20, 2018
    Assignee: SIEMENS AKTIENGESELLSCHAFT
    Inventors: Jochen Cleve, Ralph Grothmann, Kai Heesche, Christoph Tietz, Hans-Georg Zimmermann