Abstract: A particular hyper-parameter combination (HPC) that was recommended for a first task is included in a collection of candidate HPCs evaluated for a second task. Hyper-parameter analysis iterations are conducted for the second task using the collection. In one of the iterations, the second task is executed using a first iteration-specific set of HPCs, including the particular HPC and one or more other members of the collection. One or more of the HPCs of the first iteration-specific set of HPCs are pruned to generate a second iteration-specific set of HPCs for a subsequent iteration. HPCs are selected for pruning based on a comparison of their results with the results obtained from the particular HPC that was recommended for the first task. A recommended HPC for the second task is identified based on results of the analysis iterations.

Abstract: Hyperparameters for tuning a machine learning system may be optimized using Bayesian optimization with constraints. The hyperparameter optimization may be performed for a received training set and received constraints. Respective probabilistic models for the machine learning system and constraint functions may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing entropy search on the respective models, training the machine learning system using the identified values to determine measures of accuracy and constraint metrics, and updating the respective models using the determined measures.

Abstract: Hyperparameters for tuning a machine learning system may be optimized using Bayesian optimization with constraints. The hyperparameter optimization may be performed for a received training set and received constraints. Respective probabilistic models for the machine learning system and constraint functions may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing entropy search on the respective models, training the machine learning system using the identified values to determine measures of accuracy and constraint metrics, and updating the respective models using the determined measures.

Abstract: A determination is made that an explanatory data set for a common set of predictions generated by a machine learning model for records containing text tokens is to be provided. Respective groups of related tokens are identified from the text attributes of the records, and record-level prediction influence scores are generated for the token groups. An aggregate prediction influence score is generated for at least some of the token groups from the record-level scores, and an explanatory data set based on the aggregate scores is presented.

Abstract: A determination is made that an explanatory data set for a common set of predictions generated by a machine learning model for records containing text tokens is to be provided. Respective groups of related tokens are identified from the text attributes of the records, and record-level prediction influence scores are generated for the token groups. An aggregate prediction influence score is generated for at least some of the token groups from the record-level scores, and an explanatory data set based on the aggregate scores is presented.

Abstract: A system and method for continual learning in a provider network. The method is configured to implement or interface with a system which implements a semi-automated or fully automated architecture of continual machine learning, the semi-automated or fully automated architecture implementing user-configurable model retraining or hyperparameter tuning, which is enabled by a provider network. This functions to adapt a model over time to new information in the training data while also providing a user-friendly, flexible, and customizable continual learning process.

Abstract: Hyperparameters for tuning a machine learning system may be optimized for fairness using Bayesian optimization with constraints for accuracy and bias. Hyperparameter optimization may be performed for a received training set and received accuracy and fairness constraints. Respective probabilistic models for accuracy and bias of the machine learning system may be initialized, then hyperparameter optimization may include iteratively identifying respective values for hyperparameters using analysis of the respective models performed using an acquisition function implementing constrained expected improvement on the respective models, training the machine learning system using the identified values to determine measures of accuracy and bias, and updating the respective models using the determined measures.

Abstract: Systems, methods, and computer-readable media are disclosed for maximizing quantifiable user interaction via modification of adjustable parameters. In one embodiment, an example method may include determining a first output to maximize, where the first output is a function of a first adjustable parameter and a second adjustable parameter, determining first data comprising a first actual value of the first output when the first adjustable parameter is set to a first value and the second adjustable parameter is set to a second value, and determining a first predictive model that generates a first predicted value of the first output. Example methods may include determining, using the first predictive model, a third value for the first adjustable parameter and a fourth value for the second adjustable parameter to maximize the first predicted value, and sending the third value and the fourth value.