Abstract: Operating states and control actions specified in first training data sets are taken as a basis for assigning a respective operating state of the machine multiple control actions. This trains a machine learning module to take an operating state and a control action as a basis for predicting a performance of the machine that is accumulated over a state trajectory, which is constructed by determining a particular control action to be applied on the basis of output values of the machine learning module. A performance evaluator is used to determine a performance value. An accumulated performance for each of the alternative control actions associated with a respective current operating state of the machine is predicted. The machine is then actuated using a control action. If the optimizing control action is not executed successfully, another of the alternative control actions is selected.

Abstract: A method for configuration of a controlled drive application of a logistics system. The logistics system includes parallel conveying paths for piece goods. Each conveying path includes sub-conveying paths which are each accelerated or delayed to merge the piece goods on a single output conveying path with defined spacing. A system model of the logistics system is firstly determined by operating data of the logistics system which include sensor values of the logistics system and changes to control variables. A control function is determined, which includes configuration data for the drives, with at least one control action being performed on the precondition of one or more performance features that are to be achieved in the system model, during which control action the operating data is simulated for a plurality of time steps.

Abstract: An operating signal is fed to a first machine learning module to reproduce a behavior signal of a technical system, the behavior signal occurring specifically without the current use of a control action and output the reproduced behavior signal as a first output signal. The first output signal is fed to a second machine learning module to reproduce a resulting behavior signal using a control action signal and output the reproduced behavior signal as a second output signal. Furthermore, an operating signal is fed to a third machine learning module, and a third output signal is fed to the trained second machine learning module. A control action performance ascertained using the second output signal, and the control action performance is used to train the third machine learning module to optimize the control action performance. By training the third machine learning module, a control device controls the technical system.

Abstract: To configure a control agent, predefined training data are read in, which specify state datasets, action datasets and resulting performance values of the technical system. Using the training data, a data-based dynamic model is trained to reproduce a resulting performance value using a state dataset and an action dataset. An action evaluation process is also trained to reproduce the action dataset using a state dataset and an action dataset after an information reduction has been carried out, wherein a reproduction error is determined. To train the control agent, training data are supplied, the trained action evaluation process and the control agent. Performance values output by the trained dynamic model are fed into a predefined performance function. Reproduction errors are fed as performance-reducing influencing variables into the performance function. The control agent is trained to output an action dataset optimising the performance function on the basis of a state dataset.

Abstract: A computer-implemented method for reducing friction within a machine tool is provided, including: a) reading a plurality of surrogate models for approximating friction compensation within a given machine tool, b) reading a friction compensation parameter set, c) determining a friction compensation result value for each surrogate model using the compensation parameter set, d) determining a weighted average friction compensation value of the friction compensation result values using the respective weighting factor, e) deducing a quality indicator for the friction compensation parameter set based on the weighted average friction compensation value, f) outputting the friction compensation parameter set, if the quality indicator fulfils a given quality criterion, or repeating b) to e) until the quality indicator fulfills the given quality criterion, g) applying the outputted friction compensation parameter set to the machine tool for reducing friction within the machine tool.

Abstract: A method for controlling a machine, a performance evaluator and an action evaluator are provided. The performance evaluator ascertains the performance of the machine using a control signal while the action evaluator ascertains a deviation from a specified control sequence. Weighting values are generated in order to weight the performance with respect to the deviation. The weighting values and a plurality of states signals are fed into the control agent, and a respective resulting output signal of the control agent is fed into the performance evaluator and the action evaluator as a control signal. In accordance with the respective weighting value, a performance ascertained by the performance evaluator is weighted using a target function with respect to a deviation ascertained by the action evaluator. The control agent is thus trained to output a control signal which optimizes the target function using a state signal and a weighting value.

Abstract: To control a technical system, training data are read in, a training dataset, including in each case a state dataset, an action dataset and a resulting performance value of the technical system. Using the training data, a first machine learning module is trained to reproduce a resulting performance value on the basis of a state dataset and an action dataset. State datasets are also supplied to different deterministic control agents and resulting output data are fed into the trained first machine learning module as action data sets. Depending on performance values output by the trained first machine learning module, several control agents are then selected. The technical system is controlled in each case by the selected control agents, wherein further state datasets, action datasets and performance values are captured and added to the training data. Using the training data, the method steps are repeated.

Abstract: A method for predicting a remaining time of a signal phase includes capturing traffic data and a signal phase specification distinguishing different signal phases of a traffic signal generator. The traffic data is fed as input data to an artificial neural network including first and second sub-networks and a combination network for combining output data of the two sub-networks. The artificial neural network is trained to reproduce a time still remaining until a phase change of the traffic signal generator based on the traffic data. Outputting of the output data of the first and second sub-networks is controlled in a manner complementary to one another according to the signal phase specification. Lastly, the output data of the combination network or the prediction data derived therefrom are transmitted to a transport device or to a road user as a prediction of the time remaining for influencing traffic.

Abstract: Method and device for controlling a machine in accordance with to multiple control objectives in which machine control is based on automated learning of subordinate control skills, wherein the device provides multiple subordinate control skills which are each assigned to a different one of the multiple control objectives, the device provides multiple learning processes that are reinforcement learning processes that are each assigned to a different one of the multiple control objectives and are configured to optimize the corresponding subordinate control skill based on input data received from the machine, and where the device is configured to determine a superordinate control skill based on the subordinate control skills and to control the machine based on the superordinate control skill.

Abstract: A computer-implemented method for determining at least one remaining time value, to be determined, for a system is provided, having the following steps: a. providing at least one known input data record containing a multiplicity of input elements for at least one determined time; b. providing at least one associated known remaining time value for the at least one input data record; c. determining the at least one remaining time value to be determined by applying an error function to the at least one input data record and the at least one associated remaining time value; and d. providing an output data record containing the at least one determined remaining time value and an associated reliability value. The invention furthermore targets a corresponding determination unit and computer program product.

Abstract: An operating signal is fed to a first machine learning module to reproduce a behavior signal of a technical system, the behavior signal occurring specifically without the current use of a control action and output the reproduced behavior signal as a first output signal. The first output signal is fed to a second machine learning module to reproduce a resulting behavior signal using a control action signal and output the reproduced behavior signal as a second output signal. Furthermore, an operating signal is fed to a third machine learning module, and a third output signal is fed to the trained second machine learning module. A control action performance ascertained using the second output signal, and the control action performance is used to train the third machine learning module to optimize the control action performance. By training the third machine learning module, a control device controls the technical system.

Abstract: In order to configure a control device, a predefined default configuration data set is read in. Furthermore, a deviation from the default configuration data set as well as a control performance are determined for each of a large number of generated test configuration data sets. In addition, a Pareto optimization is performed for the large number of test configuration data sets, wherein the deviation as well as the control performance are used as Pareto objective criteria. A configuration data set resulting from the Pareto optimization is then selected to configure the control device.

Abstract: Training data sets which are obtained by controlling the machine by different control systems are read in, the training data sets each including a state data set and an action data set. Furthermore, a performance evaluator is provided and determines, for a control agent, a performance for controlling the machine by the control agent. A control-system-specific control agent for the different control systems is respectively trained to reproduce an action data set on the basis of a state data set. In addition, a respective environment is delimited on the basis of a distance dimension in a parameter space of the control-system-specific control agents. Test control agents, for each of which a performance value is determined by the performance evaluator, are then generated within the environments. Depending on the determined performance values, a performance-optimizing control agent is finally selected from the test control agents and is used to control the machine.

Abstract: To configure a control agent, predefined training data are read in, which specify state datasets, action datasets and resulting performance values of the technical system. Using the training data, a data-based dynamic model is trained to reproduce a resulting performance value using a state dataset and an action dataset. An action evaluation process is also trained to reproduce the action dataset using a state dataset and an action dataset after an information reduction has been carried out, wherein a reproduction error is determined. To train the control agent, training data are supplied, the trained action evaluation process and the control agent. Performance values output by the trained dynamic model are fed into a predefined performance function. Reproduction errors are fed as performance-reducing influencing variables into the performance function. The control agent is trained to output an action dataset optimising the performance function on the basis of a state dataset.

Abstract: Provided is a method for the computer-assisted control of a technical system, in particular in a plant for generating energy, to achieve a predetermined technical behavior of the technical system, wherein an operating data set for controlling the system is provided. A system model for describing the mode of operation of the technical system is provided, wherein on the basis of the operating data set and on the basis of the system model, an optimization data set is determined by an optimization method. Based on the optimization data set, relevant parameters of the technical system that allow a more advantageous control of the technical system than other parameters of the technical system are selected using a selection method, wherein with the selected relevant parameters, a control method for the technical system is determined, wherein the technical system is controlled with the aid of the control method.

Abstract: A computer-implemented method for reducing friction within a machine tool is provided, including: a) reading a plurality of surrogate models for approximating friction compensation within a given machine tool, b) reading a friction compensation parameter set, c) determining a friction compensation result value for each surrogate model using the compensation parameter set, d) determining a weighted average friction compensation value of the friction compensation result values using the respective weighting factor, e) deducing a quality indicator for the friction compensation parameter set based on the weighted average friction compensation value, f) outputting the friction compensation parameter set, if the quality indicator fulfils a given quality criterion, or repeating b) to e) until the quality indicator fulfills the given quality criterion, g) applying the outputted friction compensation parameter set to the machine tool for reducing friction within the machine tool.

Abstract: A computer-implemented method for configuring a system model and a computer-implemented method for configuring a sensor model. There is also described a computer-implemented method for determining future switching behavior of a system unit, with the following steps: a) receiving the configured system model; b) receiving the configured sensor model, c) the configured sensor model being a probability distribution regarding how the sensor unit will behave in the specific time period; d) establishing at least one random sample of behavior of a sensor unit by sampling from the probability distribution; and e) determining the future switching behavior of the system unit and/or at least one associated statistical value on the basis of the established random sample by means of the trained system model. There is also described a corresponding computer program product.

Abstract: A method for predicting a remaining time of a signal phase includes capturing traffic data and a signal phase specification distinguishing different signal phases of a traffic signal generator. The traffic data is fed as input data to an artificial neural network including first and second sub-networks and a combination network for combining output data of the two sub-networks. The artificial neural network is trained to reproduce a time still remaining until a phase change of the traffic signal generator based on the traffic data. Outputting of the output data of the first and second sub-networks is controlled in a manner complementary to one another according to the signal phase specification. Lastly, the output data of the combination network or the prediction data derived therefrom are transmitted to a transport device or to a road user as a prediction of the time remaining for influencing traffic.

Abstract: Provided is an apparatus and method for cooperative controlling wind turbines of a wind farm, wherein the wind farm includes at least one pair of turbines aligned along a common axis approximately parallel to a current wind direction and having an upstream turbine and a downstream turbine. The method includes the steps of: a) providing a data driven model trained with a machine learning method and stored in a database, b) determining a decision parameter for controlling at least one of the upstream turbine and the downstream turbine by feeding the data driven model with the current power production of the upstream turbine which returns a prediction value indicating whether the downstream turbine will be affected by wake, and/or the temporal evolvement of the current power production of the upstream turbine; c) based on the decision parameter, determining control parameters for the upstream turbine and/or the downstream turbine.

Abstract: A computer-implemented method for determining at least one remaining time value, to be determined, for a system is provided, having the following steps: a. providing at least one known input data record containing a multiplicity of input elements for at least one determined time; b. providing at least one associated known remaining time value for the at least one input data record; c. determining the at least one remaining time value to be determined by applying an error function to the at least one input data record and the at least one associated remaining time value; and d. providing an output data record containing the at least one determined remaining time value and an associated reliability value. The invention furthermore targets a corresponding determination unit and computer program product.