Abstract: A method creates a training data set for optical railway detection with integrated obstacle detection. The method includes the following steps of: providing first images of railways for rail vehicles, each first image having a representation of a railway; providing second images of objects, each second image containing a representation of at least one object; combining the first and second images; and generating third images containing the combined first and second images. Each third image contains a representation of a railway with at least one object, and a number of the third images forming the training data set for the optical railway detection with integrated obstacle detection.