Abstract: Systems, methods, and techniques to efficiently and effectively verifying and calibrating a machine learning model. The method can include training a machine learning model by at least processing training data with the machine learning model. The method can further include manipulating a first data set of the training data and applying the manipulated first data set to the machine learning model to thereby determine a first matching rate. In addition, the method can include applying the manipulated first data set to a rule engine to thereby determine a second matching rate and determining a difference between the first matching rate and the second matching rate. The method can further include determining whether the difference is within a predefined threshold range and providing an error indication if the determined difference is outside of the predefined threshold range.

Abstract: Systems, methods, and techniques to efficiently and effectively verifying and calibrating a machine learning model. The method can include training a machine learning model by at least processing training data with the machine learning model. The method can further include manipulating a first data set of the training data and applying the manipulated first data set to the machine learning model to thereby determine a first matching rate. In addition, the method can include applying the manipulated first data set to a rule engine to thereby determine a second matching rate and determining a difference between the first matching rate and the second matching rate. The method can further include determining whether the difference is within a predefined threshold range and providing an error indication if the determined difference is outside of the predefined threshold range.