Abstract: Embodiments are disclosed for a method for machine-learning model accuracy. The method includes generating prediction training data based on training predictions and corresponding probabilities of the training predictions. A classifier of a machine-learning model generates the training predictions. The method also includes training a prediction accuracy model to determine whether the training predictions generated by the machine-learning model are correct. Additionally, the method includes generating predictions in response to corresponding client transactions for the machine-learning model. Further, the method includes determining whether the predictions are accurate using the prediction accuracy model. Also, the method includes providing client predictions corresponding to the client transactions based on the determination.

Abstract: A computer-implemented method for refining dataset to accurately represent output of an artificial intelligence model includes generating a plurality of data points used to interpret a decision of an artificial intelligence model. A subset of data points from the generated plurality of data points satisfying one or more constraints is identified. A linear model is applied on the identified subset of data points satisfying the one or more constraints. One or more insights illustrating the decision of the artificial intelligence model is generated.

Abstract: Embodiments relate to a system, program product, and method for generating an enhanced feature catalog for a predictive model. The embodiments disclosed herein include capturing predictive model design time information including training data lineage metadata to determine the features of the training data, model design time measurements, and model design time metadata. Once the predictive model is built, the training data lineage metadata is used to capture the features that will be maintained within a feature catalog. The model design time measurements and model design time metadata provide further correlation between the predictive model and the features. Runtime metrics on the predictive model create additional correlations between the captured data and metadata with the features in the feature catalog to expeditiously identify the relevant features of the predictive model.

Abstract: A method, system, and computer program product for generating lineage events of machine learning models. The method may include identifying a machine learning model with missing lineage. The method may also include generating a creation event and deployment event for the machine learning model. The method may also include generating a version change event for the machine learning model. Generating the version change event may include identifying one or more predicted data points with a low model confidence; rescoring the one or more predicted data points based on the machine learning model at a second time period; determining that the updated one or more predicted data points are significantly different than the one or more predicted data points; and determining that there is a new version of the machine learning model. The method may also include creating a lineage path for the machine learning model.

Abstract: A computer-implemented method for refining dataset to accurately represent output of an artificial intelligence model includes generating a plurality of data points used to interpret a decision of an artificial intelligence model. A subset of data points from the generated plurality of data points satisfying one or more constraints is identified. A linear model is applied on the identified subset of data points satisfying the one or more constraints. One or more insights illustrating the decision of the artificial intelligence model is generated.

Abstract: Embodiments relate to a system, program product, and method for generating an enhanced feature catalog for a predictive model. The embodiments disclosed herein include capturing predictive model design time information including training data lineage metadata to determine the features of the training data, model design time measurements, and model design time metadata. Once the predictive model is built, the training data lineage metadata is used to capture the features that will be maintained within a feature catalog. The model design time measurements and model design time metadata provide further correlation between the predictive model and the features. Runtime metrics on the predictive model create additional correlations between the captured data and metadata with the features in the feature catalog to expeditiously identify the relevant features of the predictive model.

Abstract: Embodiments are disclosed for a method for machine-learning model accuracy. The method includes generating prediction training data based on training predictions and corresponding probabilities of the training predictions. A classifier of a machine-learning model generates the training predictions. The method also includes training a prediction accuracy model to determine whether the training predictions generated by the machine-learning model are correct. Additionally, the method includes generating predictions in response to corresponding client transactions for the machine-learning model. Further, the method includes determining whether the predictions are accurate using the prediction accuracy model. Also, the method includes providing client predictions corresponding to the client transactions based on the determination.