Abstract: Various embodiments of the present invention improve the speed of training classification-based machine learning models by introducing techniques that enable efficient parallelization of such training routines while enhancing the accuracy of each parallel implementation of a training routine. For example, in some embodiments, a classification-based machine learning model is trained via executing N parallel processes each executing a portion of a training routine, where each parallel process is performed using a training set having a uniform distribution of labels associated with the classification-based machine learning model. In this way, each parallel process is more likely to update parameters of the classification-based machine learning model in accordance with a holistic representation of the training data, which in turn improves the overall accuracy of the resulting trained classification-based machine learning models while enabling parallel training of the classification-based machine learning model.