Abstract: Methods and apparatuses are described for predicting compliance of text documents with a ruleset using self-supervised machine learning. A server executes an NLP teacher model on first unlabeled sentences to generate a first compliance pseudo-label for each first unlabeled sentence. The server trains an NLP student model using the first unlabeled sentences and first compliance pseudo-labels, including injecting input noise by aggregating each unlabeled sentence with one or more sentences adjacent to each unlabeled sentence into a sentence block and providing the aggregated sentence blocks as input to train the NLP student model. The server executes the trained NLP student model, using second unlabeled sentences, to generate a second compliance pseudo-label for each second unlabeled sentence. The server determines compliance of the second sentences with one or more rulesets using the second compliance pseudo-labels.