Abstract: The system and methods of the disclosed subject matter provide an experimentation framework to allow a user to perform machine learning experiments on tenant data within a multi-tenant database system. The system may provide an experimental interface to allow modification of machine learning algorithms, machine learning parameters, and tenant data fields. The user may be prohibited from viewing any of the tenant data or may be permitted to view only a portion of the tenant data. Upon generating an experimental model using the experimental interface, the user may view results comparing the performance of the experimental model with a current production model.

Abstract: Methods and systems are provided to determine suitable hyperparameters for a machine learning model and/or feature engineering process. A suitable machine learning model and associated hyperparameters are determined by analyzing a dataset. Suitable hyperparameter values for compatible machine learning models having one or more hyperparameters in common and a compatible dataset schema are identified. Hyperparameters may be ranked according to each of their respective influences on a model performance metrics, and hyperparameter values identified as having greater influence may be more aggressively searched.

Abstract: A method of training a predictive model to predict a likely field value for one or more user selected fields within an application. The method comprises providing a user interface for user selection of the one or more user selected fields within the application; analyzing a pre-existing, user provided data set of objects; training, based on the analysis, the predictive model; determining, for each user selected field based on the analysis, a confidence function for the predictive model that identifies the percentage of cases predicted correctly at different applied confidence levels, the percentage of cases predicted incorrectly at different applied confidence levels, and the percentage of cases in which the prediction model could not provide a prediction at different applied confidence levels; and providing a user interface for user review of the confidence functions for user selection of confidence threshold levels to be used with the predictive model.

Abstract: A method of training a predictive model to predict a likely field value for one or more user selected fields within an application. The method comprises providing a user interface for user selection of the one or more user selected fields within the application; analyzing a pre-existing, user provided data set of objects; training, based on the analysis, the predictive model; determining, for each user selected field based on the analysis, a confidence function for the predictive model that identifies the percentage of cases predicted correctly at different applied confidence levels, the percentage of cases predicted incorrectly at different applied confidence levels, and the percentage of cases in which the prediction model could not provide a prediction at different applied confidence levels; and providing a user interface for user review of the confidence functions for user selection of confidence threshold levels to be used with the predictive model.

Abstract: The system and methods of the disclosed subject matter provide an experimentation framework to allow a user to perform machine learning experiments on tenant data within a multi-tenant database system. The system may provide an experimental interface to allow modification of machine learning algorithms, machine learning parameters, and tenant data fields. The user may be prohibited from viewing any of the tenant data or may be permitted to view only a portion of the tenant data. Upon generating an experimental model using the experimental interface, the user may view results comparing the performance of the experimental model with a current production model.

Abstract: Methods and systems are provided to determine suitable hyperparameters for a machine learning model and/or feature engineering process. A suitable machine learning model and associated hyperparameters are determined by analyzing a dataset. Suitable hyperparameter values for compatible machine learning models having one or more hyperparameters in common and a compatible dataset schema are identified. Hyperparameters may be ranked according to each of their respective influences on a model performance metrics, and hyperparameter values identified as having greater influence may be more aggressively searched.