Abstract: Disclosed is a technique for a railway disaster monitoring system for monitoring a foreign matter on a railway, which includes a camera and an image processing unit that receives a railway image captured by the camera. The image processing unit includes a segmented image acquisition unit that obtains a plurality of segmented images including a rail from the railway image received from the camera and scales the segmented images to obtain segmented image blocks of a predetermined size, and a segmented image determination unit which includes deep neural network (DNN) discriminators trained with deep learning neural networks and inputs the segmented image blocks to the DNN discriminators to determine whether the railway is in a normal state in which there is no foreign matter on the railway except a train passing by. Using the segmented images, a foreign matter on a railway can be rapidly and easily determined using a deep learning neural network even with a small number of resources.