Abstract: In various embodiments, a process for obtaining a generated dataset with a predetermined bias for evaluating algorithmic fairness of a machine learning model includes receiving an input dataset and generating an anonymized reconstructed dataset based at least on the input dataset. The process includes introducing a predetermined bias into the generated dataset, forming an evaluation dataset based at least on the generated dataset with the predetermined bias, and outputting the evaluation dataset. In various embodiments, a process for training a generative model includes configuring a generative model and receiving training data, where the training data includes a tabular dataset. The process includes using computer processor(s) and the received training data to train the generative model, where the generative model is sampled to generate a dataset with a predetermined bias.

Abstract: In various embodiments, a process for constrained optimization for sequential error-based additive machine learning models (e.g., gradient boosting machines) includes configuring a sequential error-based additive machine learning model, receiving training data, and using one or more hardware processors to train the sequential error-based additive machine learning model using the received training data. The training includes performing optimization iterations to minimize a loss function that includes a fairness constraint, where the fairness constraint is based at least in part on disparities between groups.

Abstract: In various embodiments, a process for obtaining a generated dataset with a predetermined bias for evaluating algorithmic fairness of a machine learning model includes receiving an input dataset and generating an anonymized reconstructed dataset based at least on the input dataset. The process includes introducing a predetermined bias into the generated dataset, forming an evaluation dataset based at least on the generated dataset with the predetermined bias, and outputting the evaluation dataset. In various embodiments, a process for training a generative model includes configuring a generative model and receiving training data, where the training data includes a tabular dataset. The process includes using computer processor(s) and the received training data to train the generative model, where the generative model is sampled to generate a dataset with a predetermined bias.

Abstract: A series of sequential inputs and a prediction output of a machine learning model, to be analyzed for interpreting the prediction output, are received. An input included in the series of sequential inputs is selected to be analyzed for relevance in producing the prediction output. Background data for the selected input of the series of sequential inputs to be analyzed is determined. The background data is used as a replacement for the selected input of the series of sequential inputs to determine a plurality of perturbed prediction outputs of the machine learning model. A relevance metric is determined for the selected input based at least in part on the plurality of perturbed prediction outputs of the machine learning model.

Abstract: In various embodiments, a process for fairness-aware hyperparameter optimization based on bandit-based techniques includes receiving a fairness evaluation metric for evaluating a fairness of a machine learning model to be trained and receiving a performance metric for evaluating performance of the machine learning model to be trained. The process includes automatically evaluating candidate combinations of hyperparameters of the machine learning model based at least in part on multi-objective optimization including scalarization and using the fairness evaluation metric and the performance metric to select a hyperparameter combination to utilize among the candidate combinations of hyperparameters, wherein evaluating the candidate combinations of hyperparameters of the machine learning model includes automatically and dynamically determining a relative weighting between the fairness evaluation metric and the performance metric.