Abstract: Provided are an ultrasound image detection system and a method thereof based on artificial intelligence (AI) automatic labeling of anatomical structures, including: a receiving module, an image recognition module having an object detection model, an image processing module and a display module, wherein the image recognition module utilizes the object detection model to perform object detection on the image to be recognized, which is received by the receiving module, and then obtains a plurality of object recognition images with object detection results. Then, the image processing module detects missed anatomical structures according to the object detection results of the plurality of object recognition images, thereby outputting an object detection image. Additionally, the display module displays the object detection image. Therefore, the anatomical structures in the ultrasound image can be automatically and instantly recognized by AI so as to provide accurate judgment basis for medical personnel.