Abstract: Systems and methods for rails and obstacles detection based on forward-looking electrooptical imaging, novel system architecture and novel scene analysis and image processing are disclosed. The processing solution utilizes a deep learning semantic scene segmentation approach based on a rails and switches states detection neural network that determines the railway path of the train in the forward-looking imagery, and an objects and obstacles detection and tracking neural network that analyzes the vicinity of the determined railway path and detects impending obstacles.