Abstract: The remote video surveillance server comprises a certain number of channel interface units directed to field terminals for receiving the video, audio and alarm signals in the surveillance site from said field terminals in the remote end and transmitting the audio and control information from the view stations to said field terminals respectively, an information process kernel composed of a computer and a software and connected to said channel interface unit directed to field terminal by a computer bus, and a certain number of view station interface units connected to said information process kernel by said computer bus. As well as the signal transmission between different type channels, the point-to-multipoint or multipoint-to-point video surveillance can be realized.