Abstract: Systems and methods are directed to providing multilevel chained testing. A modeling manager receives a request for data associated with an experience having multiple levels of testing, whereby each lower level of testing has a set of one or more variants chained to a variant of a higher level. Based on the request, the model manager determines which variant of the multiple levels of testing to provide to a user. The determining comprises detecting a lowest segment the user is a member of, whereby each segment level corresponds to a level of testing, and selecting a variant from a corresponding set of one or more variants of the lowest sub-segment, a chained variant of a parent segment, or a control value. The modeling manager transmits a response to an experience component that includes the selected variant, and the experience component causes presentation of the experience with the selected variant.

Abstract: Systems and methods are directed to providing multilevel chained testing. A modeling manager receives a request for data associated with an experience having multiple levels of testing, whereby each lower level of testing has a set of one or more variants chained to a variant of a higher level. Based on the request, the model manager determines which variant of the multiple levels of testing to provide to a user. The determining comprises detecting a lowest segment the user is a member of, whereby each segment level corresponds to a level of testing, and selecting a variant from a corresponding set of one or more variants of the lowest sub-segment, a chained variant of a parent segment, or a control value. The modeling manager transmits a response to an experience component that includes the selected variant, and the experience component causes presentation of the experience with the selected variant.

Abstract: Methods, systems, and computer programs are presented for implementing an artificial-intelligence modeling utility system. One method includes receiving, by a modeling manager, a schema from an experience module that implements features of an online service. The modeling manager manages a plurality of machine-learning (ML) models, provides a user interface (UI) based on the schema for entering experiment parameter values, and configures one or more ML models for the experiment. The experiment is initialized, and during the experiment, the modeling manager receives a request from the experience module for data associated with the experiment and selects one of the configured ML models for providing a response to the request. The response is obtained from the selected ML model based on input provided to the ML model based on the request, and the modeling manager sends the response to the experience. Further, results of the experiment are presented.