Abstract: A method for transfer learning includes: obtaining a pre-trained model, and generating a model to be transferred based on the pre-trained model, in which the model to be transferred includes N Transformer layers, and N is a positive integer; obtaining a mini-batch by performing random sampling on a target training set; and training the model to be transferred based on the mini-batch, in which a loss value for each Transformer layer is generated based on an empirical loss value and a noise stability loss value.