Abstract: A method and system for improving quality of a dataset for which a labeling task is to be completed. A loop is repeated comprising: inferring, for each of the labeler identifiers in the dataset, an estimated proficiency value; inferring a predicted uncertainty value of correctness of the label for at least a subset of the raw data items; and receiving a trusted evaluation value of correctness for one or more labels of the subset of the raw data items for which the predicted uncertainty is inferred. The loop is repeated until the highest predicted uncertainty value in the dataset is below a threshold value.