Abstract: Techniques for automated machine learning (ML) pipeline exploration and deployment are described. An automated ML pipeline generation system allows users to easily construct optimized ML pipelines by providing a dataset, identifying a target column in the dataset, and providing an exploration budget. Multiple candidate ML pipelines can be identified and evaluated through an exploration process, and a best ML pipeline can be provided to the requesting user or deployed for production inference. Users can configure, monitor, and adapt the exploration at multiple points in time throughout.

Abstract: Techniques for feature engineering pipeline generation for machine learning using decoupled dataset analysis and interpretation are described. A feature engineering engine obtains a dataset and utilizes a number of analyzers to generate data facts associated with the columnar values of the dataset. The data facts are consolidated together as a set of data statements that are used by multiple interpretation engines that implement different strategies for treating the data in order to generate feature engineering pipeline code.

Abstract: Methods, systems, and computer-readable media for automated problem detection for machine learning models are disclosed. A machine learning analysis system receives data associated with use of a machine learning model. The data was collected by a machine learning inference system and comprises input to the model or a plurality of inferences representing output of the machine learning model. The machine learning analysis system performs analysis of the data associated with the use of the machine learning model. The machine learning analysis system detects one or more problems associated with the use of the machine learning model based at least in part on the analysis. The machine learning analysis system initiates one or more remedial actions associated with the one or more problems associated with the use of the machine learning model.

Abstract: Systems and methods to obtain a text-based representation of a machine learning (ML) graph identifying one or more transforms usable to prepare data for ML training. The systems and methods can determine computer-executable instructions based on the text-based representation of the ML graph, where the computer-executable instructions can include instructions associated with the one or more transforms to prepare data for ML training. Additionally, the systems and methods can process the computer-executable instructions to generate ML training data based on at least the one or more transforms.

Abstract: Methods, systems, and computer-readable media for automated problem detection for machine learning models are disclosed. A machine learning analysis system receives data associated with use of a machine learning model. The data was collected by a machine learning inference system and comprises input to the model or a plurality of inferences representing output of the machine learning model. The machine learning analysis system performs analysis of the data associated with the use of the machine learning model. The machine learning analysis system detects one or more problems associated with the use of the machine learning model based at least in part on the analysis. The machine learning analysis system initiates one or more remedial actions associated with the one or more problems associated with the use of the machine learning model.

Abstract: Techniques for automated machine learning (ML) pipeline exploration and deployment are described. An automated ML pipeline generation system allows users to easily construct optimized ML pipelines by providing a dataset, identifying a target column in the dataset, and providing an exploration budget. Multiple candidate ML pipelines can be identified and evaluated through an exploration process, and a best ML pipeline can be provided to the requesting user or deployed for production inference. Users can configure, monitor, and adapt the exploration at multiple points in time throughout.