Abstract: A method is for training a neural network for determining features of objects for object tracking. The method includes generating a training dataset with a plurality of training data elements. Each training data element has a first set of sensor data relating to a first state of an environment with a set of a plurality of objects and a second set of sensor data relating to a second state of the environment. In the second state, the positions of the objects have at least partially changed compared to the first state. The method also includes determining features of the objects by feeding the first set of sensor data to the neural network and determining features of the objects by feeding the second set of sensor data to the neural network. A loss is determined depending on the generated features, and the neural network is trained to reduce the loss.

Abstract: A computer-implemented method for classification of at least one object in an environment of a vehicle. The method includes: collecting first data from a first sensor within a first data collecting frame; collecting second data from at least a second sensor within a second data collecting frame; determining a first object representation using the first data; determining a second object representation using the second data; updating the first and/or second object representation depending on an arrival of third data from the at least second sensor collected in a third data collecting frame after the first data collecting frame; fusing the first and second representation to determine an updated representation of the object based on the received data; applying the updated representation for training the data-driven model as input data for a data-driven model to obtain output data containing an information about a classification of the detected object.

Abstract: A method for the chronological correction of multimodal data includes: receiving a first data set from a reference sensor with measurements at different measurement timepoints, receiving a second data set of a second sensor with measurements at different measurement timepoints, each not exactly matching those of the reference sensor, reading the first and the second data sets by a neural network and identifying a respective plurality of feature vectors for the first and second data set at the respective measurement timepoints, merging and comparing the respective feature vectors, which refer to corresponding, not exactly matching measurement timepoints, by the neural network so that parameters of a chronological correction are identified, and identifying a chronological offset between the respective measurement timepoints of the reference sensor and the second sensor, and/or a corrected data set from the second sensor based on the measurement timepoints of the reference sensor.

Abstract: A method is for training an object detector configured to detect objects in sensor data of a sensor. The method includes providing first sensor data of the sensor, providing an object representation assigned to the first sensor data, and transmitting the object representation to a sensor model. The method further includes imaging object representations onto the first sensor data of the sensor with the sensor model, assigning the object representation to second sensor data with the sensor model, and training the object detector based on the second sensor data.

Abstract: Learning extraction of movement information from sensor data includes providing a time series of frames of sensor data recorded by physical observation of an object, providing a time series of object boundary boxes each encompassing the object in sensor data frames, supplying the object boundary box at a time t, as well as a history of sensor data from the sensor data time series, and/or a history of object boundary boxes from the time series of object boundary boxes, prior to time t to a trainable machine learning model which predicts an object boundary box for a time t+k, comparing the predicted object boundary box with a comparison box obtained from the time series of object boundary boxes for the time t+k, evaluating a deviation between the predicted object boundary box and the comparison box using a predetermined cost function, and optimizing parameters which characterize the behavior of the model.

Abstract: A method for controlling a robot device includes (i) receiving, from each sensor of a plurality of sensors, a respective sensor data set from the sensor, (ii) determining, for each object of a set of objects containing at least one object, for each of a plurality of different combinations of the sensor data sets, a position prediction for the object by way of sensor data fusion of the sensor data sets according to the combination of the sensor data sets, (iii) determining, for each object of the set of objects, for each pair of a plurality of pairs of combinations, a distance between the position predictions determined for the object according to the combinations of the pair, (iv) feeding the determined distances to a neural network trained to determine confidence information for the position predictions from distances between position predictions for the pairs of combinations, and (v) controlling the robot device using one or a plurality of the position predictions taking into account the confidence informat

Abstract: A method for monitoring surroundings of a first sensor system. The method includes: providing a temporal sequence of data of the first sensor system for monitoring the surroundings; generating an input tensor including the temporal sequence of data of the first sensor system, for a trained neural network; the neural network being configured and trained to identify, on the basis of the input tensor, at least one subregion of the surroundings, in order to improve the monitoring of the surroundings with the aid of a second sensor system; generating a control signal for the second sensor system with the aid of an output signal of the trained neural network, in order to improve the monitoring of the surroundings in the at least one subregion.

Abstract: A radar-based environmental detection system for motor vehicles. The system includes at least one radar sensor for providing location data regarding objects in the environment of the motor vehicle, and including a neural network for converting the location data into an environmental model which represents spatio-temporal object data of the objects. The neural network is conditioned to give priority to outputting environmental models in which at least one predetermined physical relationship between the location data and the object data is satisfied.

Abstract: A method for the chronological correction of multimodal data includes: receiving a first data set from a reference sensor with measurements at different measurement timepoints, receiving a second data set of a second sensor with measurements at different measurement timepoints, each not exactly matching those of the reference sensor, reading the first and the second data sets by a neural network and identifying a respective plurality of feature vectors for the first and second data set at the respective measurement timepoints, merging and comparing the respective feature vectors, which refer to corresponding, not exactly matching measurement timepoints, by the neural network so that parameters of a chronological correction are identified, and identifying a chronological offset between the respective measurement timepoints of the reference sensor and the second sensor, and/or a corrected data set from the second sensor based on the measurement timepoints of the reference sensor.

Abstract: Learning extraction of movement information from sensor data includes providing a time series of frames of sensor data recorded by physical observation of an object, providing a time series of object boundary boxes each encompassing the object in sensor data frames, supplying the object boundary box at a time t, as well as a history of sensor data from the sensor data time series, and/or a history of object boundary boxes from the time series of object boundary boxes, prior to time t to a trainable machine learning model which predicts an object boundary box for a time t+k, comparing the predicted object boundary box with a comparison box obtained from the time series of object boundary boxes for the time t+k, evaluating a deviation between the predicted object boundary box and the comparison box using a predetermined cost function, and optimizing parameters which characterize the behavior of the model.

Abstract: A method for monitoring surroundings of a first sensor system. The method includes: providing a temporal sequence of data of the first sensor system for monitoring the surroundings; generating an input tensor including the temporal sequence of data of the first sensor system, for a trained neural network; the neural network being configured and trained to identify, on the basis of the input tensor, at least one subregion of the surroundings, in order to improve the monitoring of the surroundings with the aid of a second sensor system; generating a control signal for the second sensor system with the aid of an output signal of the trained neural network, in order to improve the monitoring of the surroundings in the at least one subregion.

Abstract: A method is for training an object detector configured to detect objects in sensor data of a sensor. The method includes providing first sensor data of the sensor, providing an object representation assigned to the first sensor data, and transmitting the object representation to a sensor model. The method further includes imaging object representations onto the first sensor data of the sensor with the sensor model, assigning the object representation to second sensor data with the sensor model, and training the object detector based on the second sensor data.

Abstract: A method for the detection of an object in an environment of a vehicle as a function of sensor signals of a sensor for acquiring the environment of the vehicle. The method includes: processing the sensor signals using a region proposal network to obtain at least one object hypothesis per anchor, the object hypothesis including an object probability and a bounding box; selecting the best object hypothesis on the basis of a quality model, the quality model being a function of the anchor and the bounding box of the object hypothesis; identifying redundant object hypotheses relative to the selected object hypothesis, the redundant object hypotheses being identified as a function of the anchors of the redundant object hypotheses, using a target function assigned to the region proposal network; and fusing the selected object hypothesis with the identified redundant object hypotheses for the object detection.

Abstract: A method for creating a training dataset, a validation dataset, and/or a test dataset for an AI module from measurement data includes dividing the measurement data into divided portions based on time periods, applying a mathematical function to the divided portions of the measurement data in order to obtain signatures representing the divided portions, determining a measure of a frequency of occurrence of a respective signature of the obtained signatures, and creating the training dataset, the validation dataset, and/or the test dataset from the measurement data based on the determined measure of the frequency.

Abstract: A method for the detection of an object in an environment of a vehicle as a function of sensor signals of a sensor for acquiring the environment of the vehicle. The method includes: processing the sensor signals using a region proposal network to obtain at least one object hypothesis per anchor, the object hypothesis including an object probability and a bounding box; selecting the best object hypothesis on the basis of a quality model, the quality model being a function of the anchor and the bounding box of the object hypothesis; identifying redundant object hypotheses relative to the selected object hypothesis, the redundant object hypotheses being identified as a function of the anchors of the redundant object hypotheses, using a target function assigned to the region proposal network; and fusing the selected object hypothesis with the identified redundant object hypotheses for the object detection.

Abstract: A device and method for triggering an automatic response of a motor vehicle to an imminent accident situation by using data in a processing unit to create a traffic situation model of the existing traffic situation, analyzing a traffic situation and ascertaining response options, determining sequences to be expected beyond the primary accident incorporating subsequent movements of the road users and objects involved leading to secondary accidents or further subsequent accidents or potentially arising further hazardous situations, computing a probability distribution and/or an extent of injuries to persons and/or damage to objects of the road users and objects involved as a function of the response options, selecting that response option that is expected to have the smallest total degree of probability or the smallest extent of injury to persons and/or damage to objects overall for all road users and objects, and outputting control signals to initiate the selected response option.