Abstract: The present invention presents a smart dual-view video surveillance system, which carries a smart live-view video and a dedicated recording-view video from each camera to the video recorder. The smart live-view video only carries video data for the visible displayed pixels in its displaying video window and is dedicated for live-view monitoring. The dedicated recording-view video carries the complete video data and is dedicated to video recording and playback.