Patents by Inventor Steffen Udluft

Steffen Udluft has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20130282635
    Abstract: A method for computer-assisted modeling of a technical system is disclosed. At multiple different operating points, the technical system is described by a first state vector with first state variable(s) and by a second state vector with second state variable(s). A neural network comprising a special form of a feed-forward network is used for the computer-assisted modeling of said system. The feed-forward network includes at least one bridging connector that connects a neural layer with an output layer, thereby bridging at least one hidden layer, which allows the training of networks with multiple hidden layers in a simple manner with known learning methods, e.g., the gradient descent method. The method may be used for modeling a gas turbine system, in which a neural network trained using the method may be used to estimate or predict nitrogen oxide or carbon monoxide emissions or parameters relating to combustion chamber vibrations.
    Type: Application
    Filed: November 16, 2011
    Publication date: October 24, 2013
    Inventors: Siegmund Düll, Alexander Hans, Steffen Udluft
  • Patent number: 8566264
    Abstract: A method for the computer-assisted control and/or regulation of a technical system is provided. The method is used to efficiently reduce a high-dimensional state space describing the technical system to a smaller dimension. The reduction of the state space is performed using an artificial recurrent neuronal network. In addition, the reduction of the state space enables conventional learning methods, which are only designed for small dimensions of state spaces, to be applied to complex technical systems with an initially large state space, wherein the conventional learning methods are performed in the reduced state space. The method can be used with any technical system, especially gas turbines.
    Type: Grant
    Filed: December 19, 2007
    Date of Patent: October 22, 2013
    Assignee: Siemens Aktiengesellschaft
    Inventors: Anton Maximilian Schäfer, Steffen Udluft
  • Patent number: 8554707
    Abstract: A method for the computer-assisted control and/or regulation of a technical system is provided. The method includes two steps, namely modeling the dynamic behavior of the technical system with a recurrent neural network using training data, the recurrent neural network includes states and actions determined using a simulation model at different times and learning an action selection rule by the recurrent neural network to a further neural network. The method can be used with any technical system in order to control the system in an optimum computer-assisted manner. For example, the method can be used in the control of a gas turbine.
    Type: Grant
    Filed: December 19, 2007
    Date of Patent: October 8, 2013
    Assignee: Siemens Aktiengesellschaft
    Inventors: Anton Maximilian Schäfer, Steffen Udluft, Hans-Georg Zimmermann
  • Publication number: 20130204812
    Abstract: A method for computer-aided closed and/or open-loop control of a technical system is provided. A first value of an output quantity is predicted on a data-based model at a current point in time. A second value of the output quantity is determined from an analytical model. The state of the technical system at the current point is assigned a confidence score in the correctness of prediction of the data-based model. A third value of the output quantity is determined from the first and second value as a function of the confidence score for controlling the technical system. A suitable value for the output quantity can be derived from the analytical model even for regions of the technical system in which the quality of prediction of the data-based model is low because of a small set of training data. The technical systems can be turbines, such as gas turbines.
    Type: Application
    Filed: April 12, 2010
    Publication date: August 8, 2013
    Inventors: Volkmar Sterzing, Steffen Udluft, Jatinder Singh, Hans-Gerd Brummel, Glenn E. Sancewich
  • Patent number: 8494980
    Abstract: A method for the computer-assisted exploration of states of a technical system is provided. The states of the technical system are run by carrying out an action in a respective state of the technical system, the action leading to a new state. A safety function and a feedback rule are used to ensure that a large volume of data of states and actions is run during exploration and that at the same time no inadmissible actions occur which could lead directly or indirectly to the technical system being damaged or to a defective operating state. The method allows a large number of states and actions relating to the technical system to be collected and may be used for any technical system, especially the exploration of states in a gas turbine. The method may be used both in the real operation and during simulation of the operation of a technical system.
    Type: Grant
    Filed: September 29, 2008
    Date of Patent: July 23, 2013
    Assignee: Siemens Aktiengesellschaft
    Inventors: Alexander Hans, Daniel Schneegaβ, Anton Maximilian Schäfer, Volkmar Sterzing, Steffen Udluft
  • Patent number: 8447706
    Abstract: A method for a computer-aided control of a technical system is provided. The method involves use of a cooperative learning method and artificial neural networks. In this context, feed-forward networks are linked to one another such that the architecture as a whole meets an optimality criterion. The network approximates the rewards observed to the expected rewards as an appraiser. In this way, exclusively observations which have actually been made are used in optimum fashion to determine a quality function. In the network, the optimum action in respect of the quality function is modeled by a neural network, the neural network supplying the optimum action selection rule for the given control problem. The method is specifically used to control a gas turbine.
    Type: Grant
    Filed: August 26, 2008
    Date of Patent: May 21, 2013
    Assignee: Siemens Aktiengesellschaft
    Inventors: Daniel Schneegaβ, Steffen Udluft
  • Patent number: 8380646
    Abstract: A method of computer-assisted learning of control and/or feedback control of a technical system is provided. A statistical uncertainty of training data used during learning is suitably taken into account when learning control of the technical system. The statistical uncertainty of a quality function, which models an optimal operation of the technical system, is determined by uncertainty propagation and is incorporated during learning of an action-selecting rule. The uncertainty propagation uses a covariance matrix in which non-diagonal elements are ignored. The method can be used for learning control or feedback control of any desired technical systems. In a variant, the method is used for control or feedback control of an operation of a gas turbine. In another variant, the method is used for control or feedback control of a wind power plant.
    Type: Grant
    Filed: September 3, 2010
    Date of Patent: February 19, 2013
    Assignee: Siemens Aktiengesellschaft
    Inventors: Alexander Hans, Steffen Udluft
  • Publication number: 20130013543
    Abstract: A method for the computer-aided control of a technical system is provided. A recurrent neuronal network is used for modeling the dynamic behaviour of the technical system, the input layer of which contains states of the technical system and actions carried out on the technical system, which are supplied to a recurrent hidden layer. The output layer of the recurrent neuronal network is represented by an evaluation signal which reproduces the dynamics of technical system. The hidden states generated using the recurrent neural network are used to control the technical system on the basis of a learning and/or optimization method.
    Type: Application
    Filed: February 15, 2011
    Publication date: January 10, 2013
    Inventors: Siegmund Düll, Volkmar Sterzing, Steffen Udluft
  • Patent number: 8260441
    Abstract: A method for computer-supported control and/or regulation of a technical system is provided. In the method a reinforcing learning method and an artificial neuronal network are used. In a preferred embodiment, parallel feed-forward networks are connected together such that the global architecture meets an optimal criterion. The network thus approximates the observed benefits as predictor for the expected benefits. In this manner, actual observations are used in an optimal manner to determine a quality function. The quality function obtained intrinsically from the network provides the optimal action selection rule for the given control problem. The method may be applied to any technical system for regulation or control. A preferred field of application is the regulation or control of turbines, in particular a gas turbine.
    Type: Grant
    Filed: April 4, 2008
    Date of Patent: September 4, 2012
    Assignee: Siemens Aktiengesellschaft
    Inventors: Daniel Scheegaβ, Steffen Udluft
  • Patent number: 8250014
    Abstract: A method for the computer-aided learning of a control of a technical system is provided. An operation of the technical system is characterized by states which the technical system can assume during operation. Actions are executed during the operation and convert a relevant state into a subsequent state. The method is characterized in that, when learning the control, suitable consideration is given to the statistical uncertainty of the training data. This is achieved in that the statistical uncertainty of a quality function which models an optimal operation of the technical system is specified by an uncertainty propagation and is incorporated into an action selection rule when learning. By a correspondingly selectable certainty parameter, the learning method can be adapted to different application scenarios which vary in statistical requirements. The method can be used for learning the control of an operation of a turbine, in particular a gas turbine.
    Type: Grant
    Filed: April 21, 2009
    Date of Patent: August 21, 2012
    Assignee: Siemens Aktiengesellshaft
    Inventors: Daniel Schneegaβ, Steffen Udluft
  • Patent number: 8160978
    Abstract: A method for computer-aided control of any technical system is provided. The method includes two steps, the learning of the dynamic with historical data based on a recurrent neural network and a subsequent learning of an optimal regulation by coupling the recurrent neural network to a further neural network. The recurrent neural network has a hidden layer comprising a first and a second hidden state at a respective time point. The first hidden state is coupled to the second hidden state using a matrix to be learned. This allows a bottleneck structure to be created, in that the dimension of the first hidden state is smaller than the dimension of the second hidden state or vice versa. The autonomous dynamic is taken into account during the learning of the network, thereby improving the approximation capacity of the network. The technical system includes a gas turbine.
    Type: Grant
    Filed: April 21, 2009
    Date of Patent: April 17, 2012
    Assignee: Siemens Aktiengesellschaft
    Inventors: Anton Maximilian Schäfer, Volkmar Sterzing, Steffen Udluft
  • Patent number: 8099181
    Abstract: A method for the computer-aided regulation and/or control of a technical system is provided. In the method, first a simulation model of the technical system is created, to which subsequently a plurality of learning and/or optimization methods are applied. Based on the results of these methods, the method best suited for the technical system is selected. The selected learning and/or optimization method is then used to regulate the technical system. Based on the simulation model, the method can thus be used to train an initial controller, which can be used as an intelligent controller, and is not modified during further regulation of the technical system.
    Type: Grant
    Filed: December 19, 2007
    Date of Patent: January 17, 2012
    Assignee: Siemens Aktiengesellschaft
    Inventors: Volkmar Sterzing, Steffen Udluft
  • Publication number: 20110059427
    Abstract: A method of computer-assisted learning of control and/or feedback control of a technical system is provided. A statistical uncertainty of training data used during learning is suitably taken into account when learning control of the technical system. The statistical uncertainty of a quality function, which models an optimal operation of the technical system, is determined by uncertainty propagation and is incorporated during learning of an action-selecting rule. The uncertainty propagation uses a covariance matrix in which non-diagonal elements are ignored. The method can be used for learning control or feedback control of any desired technical systems. In a variant, the method is used for control or feedback control of an operation of a gas turbine. In another variant, the method is used for control or feedback control of a wind power plant.
    Type: Application
    Filed: September 3, 2010
    Publication date: March 10, 2011
    Inventors: Alexander Hans, Steffen Udluft
  • Publication number: 20100257866
    Abstract: A method for computer-supported control and/or regulation of a technical system is provided. In the method a reinforcing learning method and an artificial neuronal network are used. In a preferred embodiment, parallel feed-forward networks are connected together such that the global architecture meets an optimal criterion. The network thus approximates the observed benefits as predictor for the expected benefits. In this manner, actual observations are used in an optimal manner to determine a quality function. The quality function obtained intrinsically from the network provides the optimal action selection rule for the given control problem. The method may be applied to any technical system for regulation or control. A preferred field of application is the regulation or control of turbines, in particular a gas turbine.
    Type: Application
    Filed: April 4, 2008
    Publication date: October 14, 2010
    Inventors: Daniel Schneegass, Steffen Udluft
  • Publication number: 20100241243
    Abstract: A method for the computer-assisted exploration of states of a technical system is provided. The states of the technical system are run by carrying out an action in a respective state of the technical system, the action leading to a new state. A safety function and a feedback rule are used to ensure that a large volume of data of states and actions is run during exploration and that at the same time no inadmissible actions occur which could lead directly or indirectly to the technical system being damaged or to a defective operating state. The method allows a large number of states and actions relating to the technical system to be collected and may be used for any technical system, especially the exploration of states in a gas turbine. The method may be used both in the real operation and during simulation of the operation of a technical system.
    Type: Application
    Filed: September 29, 2008
    Publication date: September 23, 2010
    Inventors: Alexander Hans, Daniel Schneegass, Anton Maximilian Schäfer, Volkmar Sterzing, Steffen Udluft
  • Publication number: 20100205974
    Abstract: A method for a computer-aided control of a technical system is provided. The method involves use of a cooperative learning method and artificial neural networks. In this context, feed-forward networks are linked to one another such that the architecture as a whole meets an optimality criterion. The network approximates the rewards observed to the expected rewards as an appraiser. In this way, exclusively observations which have actually been made are used in optimum fashion to determine a quality function. In the network, the optimum action in respect of the quality function is modeled by a neural network, the neural network supplying the optimum action selection rule for the given control problem. The method is specifically used to control a gas turbine.
    Type: Application
    Filed: August 26, 2008
    Publication date: August 19, 2010
    Inventors: Daniel Schneegass, Steffen Udluft
  • Publication number: 20100094788
    Abstract: A method for the computer-assisted control and/or regulation of a technical system is provided. The method includes two steps, namely learning the dynamics of a technical system using historical data based on a recurrent neuronal network, and the subsequent learning of an optimum regulation by coupling the recurrent neuronal network to another neuronal network. The method can be used with any technical system in order to control the system in an optimum computer-assisted manner. For example, the method can be used in the control of a gas turbine.
    Type: Application
    Filed: December 19, 2007
    Publication date: April 15, 2010
    Inventors: Anton Maximilian Schäfer, Steffen Udluft, Hans-Georg Zimmerman
  • Publication number: 20100070098
    Abstract: A method for the computer-aided regulation and/or control of a technical system is provided. In the method, first a simulation model of the technical system is created, to which subsequently a plurality of learning and/or optimization methods are applied. Based on the results of these methods, the method best suited for the technical system is selected. The selected learning and/or optimization method is then used to regulate the technical system. Based on the simulation model, the method can thus be used to train an initial controller, which can be used as an intelligent controller, and is not modified during further regulation of the technical system.
    Type: Application
    Filed: December 19, 2007
    Publication date: March 18, 2010
    Inventors: Volkmar Sterzing, Steffen Udluft
  • Publication number: 20100049339
    Abstract: A method for the computer-assisted control and/or regulation of a technical system is provided. The method is used to efficiently reduce a high-dimensional state space describing the technical system to a smaller dimension. The reduction of the state space is performed using an artificial recurrent neuronal network. In addition, the reduction of the state space enables conventional learning methods, which are only designed for small dimensions of state spaces, to be applied to complex technical systems with an initially large state space, wherein the conventional learning methods are performed in the reduced state space. The method can be used with any technical system, especially gas turbines.
    Type: Application
    Filed: December 19, 2007
    Publication date: February 25, 2010
    Inventors: Anton Maximilian Schäfer, Steffen Udluft
  • Publication number: 20090271340
    Abstract: A method for the computer-aided learning of a control of a technical system is provided. An operation of the technical system is characterized by states which the technical system can assume during operation. Actions are executed during the operation and convert a relevant state into a subsequent state. The method is characterized in that, when learning the control, suitable consideration is given to the statistical uncertainty of the training data. This is achieved in that the statistical uncertainty of a quality function which models an optimal operation of the technical system is specified by an uncertainty propagation and is incorporated into an action selection rule when learning. By a correspondingly selectable certainty parameter, the learning method can be adapted to different application scenarios which vary in statistical requirements. The method can be used for learning the control of an operation of a turbine, in particular a gas turbine.
    Type: Application
    Filed: April 21, 2009
    Publication date: October 29, 2009
    Inventors: Daniel Schneegass, Steffen Udluft