Abstract: A method of training a model includes selecting a learning rate for the model, training the model based on the learning rate, determining a derivative of a loss for an objective function for the model with respect to the learning rate based on a result of the training, and based on the derivative of the loss being greater than a predetermined derivative threshold, determining at least one point of interest based on the result of the training, selecting a subsequent learning rate based on the at least one point of interest, training the model based on the subsequent learning rate, and selecting an optimal learning rate based on the training results.