Abstract: A dynamic classifier for performing binary classification of instance data using oracles that predict accuracy of predictions made by corresponding models. An oracle corresponding to a model is trained to generate a confidence value that represents accuracy of a prediction made by the model. Based on the confidence value and predictions, one of multiple models is selected and its prediction is used as an intermediate prediction. The intermediate prediction may be used in conjunction with another prediction generated using a different algorithm to generate a final prediction. By using the confidence value for each model, a more accurate prediction can be made.