Abstract: A knowledge distillation method based on a regression task according to an embodiment of the present disclosure includes training a first deep neural network model that is a teacher model including a first encoder and a first decoder, constructing a second deep neural network model that is a student model including a second encoder and a second decoder according to a preset constraint of a target system and initializing parameters of the second deep neural network model, performing a first knowledge distillation operation on the second encoder of the second deep neural network model based on the trained first deep neural network model, and performing a second knowledge distillation operation on the second encoder and the second decoder of the second deep neural network model based on the trained first deep neural network model.