Abstract: Technology for selecting a correct answer (for example, a correct label for a data set to be used in machine learning algorithms) from among a plurality of candidate answers, where the answers selected relatively infrequently by a plurality of human evaluators are cold from the full plurality of candidate answers to obtain a reduced subset of candidate answers. In this way, further selection of the correct answer (for example, ultimate selection of the correct answer by a human expert) will only need to consider the reduced subset, thereby potentially saving time and effort in the selection of the correct answer.