Abstract: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.

Abstract: In some examples, a prototype model that includes a representative subset of data points (e.g., inputs and output classifications) of a machine learning model is analyzed to efficiently interpret the machine learning model's behavior. Performance metrics such as a critic fraction, local explanation scores, and global explanation scores are determined. A local explanation score capture an importance of a feature of a test point to the machine learning model determining a particular class for the test point and is computed by comparing a value of a feature of a test point to values for prototypes of the prototype model. Using a similar approach, global explanation scores may be computed for features by combining local explanation scores for data points. A critic fraction may be computed to quantify a misclassification rate of the prototype model, indicating the interpretability of the model.