Abstract: A computer-implemented method for predicting a behavior of agents in a dynamic system with a multiplicity of interacting agents depending on the latent state thereof. For a plurality of components and for a plurality of time points up to a prediction time point, a value of a first moment of a first distribution, which models the latent state of the agents, is determined for each component. A value of a second moment of the first distribution is determined. An expected value for a first moment of a second distribution at the prediction time point is determined for each component depending on the value of the first moment of the first distribution at the prediction time point and depending on the value of the second moment of the first distribution at the prediction time point. The second distribution models the behavior of the agents depending on the latent state thereof.

Abstract: A computer-implemented method for enabling control or monitoring of a computer-controlled entity operating in an environment by predicting a future state of the computer-controlled entity and/or its environment using sensor data which is indicative of a current state of the computer-controlled entity and/or its environment. The method includes using a first neural network for approximating a drift component of a stochastic differential equation and a second neural network for approximating a diffusion component of the stochastic differential equation, and discretizing the stochastic differential equation into time steps, and obtaining time-evolving mean and covariance functions based on the discretization and determining a probability distribution of a second state of the computer-controlled entity and/or its environment therefrom.

Abstract: A method for determining an uncertainty associated with trajectory predictions of a vehicle.

Abstract: A computer-implemented method for generating a control command for an autonomous vehicle. The method includes: capturing sensor data by at least one sensor of the vehicle; generating an input text from the sensor data; interpreting the input text using a machine learning algorithm; and generating a control command for the vehicle from the interpreted input text.

Abstract: A method for controlling a robot device. The method includes: ascertaining potential trajectories of an object in the surrounding area of the robot device by ascertaining in each case one or more potential trajectories using one or more machine learning models and, for each of them, a weighting factor assigned thereto; ascertaining weighted similarity values by ascertaining a weighted similarity value for each of the potential trajectories, including: ascertaining a similarity value that represents a similarity between the potential trajectory and a set of proposed trajectories according to at least one similarity metric, and ascertaining the weighted similarity value by weighting the similarity value according to the weighting factor assigned to the potential trajectory; adapting the set of proposed trajectories to ascertain an adapted set of proposed trajectories that results in a reduced sum of the plurality of weighted similarity values.

Abstract: Generation of a road map, in particular appropriate for use in automated driving (AD) of a vehicle. A method comprises a step of receiving image input data. The image input data includes acquired image data representing at least one area which is drivable by a vehicle. The method includes a step of generating a road map based on the received image input data. The generating of the road map is performed by a trained visual foundation model for road map generation, in particular appropriate for use in AD. The generated road map includes a road layout within the at least one area drivable by a vehicle along with locally allocated contextual information in view of applicable traffic regulations.

Abstract: A state-space model which includes one or more neural networks. The state-space model is configured to stochastically model a technical system by modelling uncertainties both in latent states of the technical system and in weights of the one or more neural networks. Thereby, the state-space model may be able to capture both aleatoric uncertainty (inherent unpredictability in observations) and epistemic uncertainty (uncertainty in the model's parameters or weights. During the training and during subsequent use for model-predictive control, moment matching across neural network layers is used, which may ensure that the model's predictions are consistent and close to real system behavior.

Abstract: A computer-implemented method of training a model for making time-series predictions of a computer-controlled system. The model uses a stochastic differential equation (SDE) comprising a drift component and a diffusion component. The drift component has a predefined part representing domain knowledge, that is received as an input to the training; and a trainable part. When training the model, values of the set of SDE variables at a current time point are predicted based on their values at a previous time point, and based on this, the model is refined. In order to predict the values of the set of SDE variables, the predefined part of the drift component is evaluated to get a first drift, and the first drift is combined with a second drift obtained by evaluating the trainable part of the drift component.

Abstract: A computer-implemented method for predicting a behavior of agents in a dynamic system with a multiplicity of interacting agents depending on the latent state thereof. For a plurality of components and for a plurality of time points up to a prediction time point, a value of a first moment of a first distribution, which models the latent state of the agents, is determined for each component. A value of a second moment of the first distribution is determined. An expected value for a first moment of a second distribution at the prediction time point is determined for each component depending on the value of the first moment of the first distribution at the prediction time point and depending on the value of the second moment of the first distribution at the prediction time point. The second distribution models the behavior of the agents depending on the latent state thereof.

Abstract: A method for training the neural drift network and the neural diffusion network of a neural stochastic differential equation. The method includes drawing a training trajectory from training sensor data, and, starting from the training data point which the training trajectory includes for a starting instant, determining the data-point mean and the data-point covariance at the prediction instant for each prediction instant of the sequence of prediction instants using the neural networks. The method also includes determining a dependency of the probability that the data-point distributions of the prediction instants—which are given by the ascertained data-point means and the ascertained data-point covariances—will supply the training data points at the prediction instants, on the weights of the neural drift network and of the neural diffusion network, and adapting the neural drift network and the neural diffusion network to increase the probability.

Abstract: A computer-implemented method of training a model for making time-series predictions of a computer-controlled system. The model uses a stochastic differential equation (SDE) comprising a drift component and a diffusion component. The drift component has a predefined part representing domain knowledge, that is received as an input to the training; and a trainable part. When training the model, values of the set of SDE variables at a current time point are predicted based on their values at a previous time point, and based on this, the model is refined. In order to predict the values of the set of SDE variables, the predefined part of the drift component is evaluated to get a first drift, and the first drift is combined with a second drift obtained by evaluating the trainable part of the drift component.

Abstract: A computer-implemented method for enabling control or monitoring of a computer-controlled entity operating in an environment by predicting a future state of the computer-controlled entity and/or its environment using sensor data which is indicative of a current state of the computer-controlled entity and/or its environment. The method includes using a first neural network for approximating a drift component of a stochastic differential equation and a second neural network for approximating a diffusion component of the stochastic differential equation, and discretizing the stochastic differential equation into time steps, and obtaining time-evolving mean and covariance functions based on the discretization and determining a probability distribution of a second state of the computer-controlled entity and/or its environment therefrom.

Abstract: A method for processing sensor data. The method includes receiving input sensor data, determining, starting from the input sensor data as initial state, a plurality of end states, including determining, for each end state, a sequence of states, wherein determining the sequence of states comprises, for each state of the sequence beginning with the initial state until the end state, a first Bayesian neural network determining a sample of a drift term in response to inputting the respective state, a second Bayesian neural network determining a sample of a diffusion term in response to inputting the respective state and determining a subsequent state by sampling a stochastic differential equation including the sample of the drift term as drift term and the sample of the diffusion term as diffusion term. An end state probability distribution is determined, and a processing result is determined from the end state probability distribution.