Abstract: Provided is a training dataset generating system including: a communicator to receive a two-dimensional (2D) image obtained by photographing a target object; and a controller configured to generate, based on the 2D image and based on three-dimensional (3D) data for the target object, a training dataset comprising a synthetic image and comprising labeling information, wherein the controller is configured to generate the training data set by: generating, based on the 3D data, a rendered image, generating the synthetic image, based on the 2D image and the rendered image, through deep learning training, extracting, based on at least one of the 3D data or the rendered image, the labeling information for the target object, and generating the training dataset.