Abstract: Systems and methods for dynamically defining smart measurement points are disclosed. A first experiment configured to provide one of a base element or a variant element is defined and the first experiment is associated with a first page. The first experiment includes a first dynamically defined qualifying measurement point. A plurality of records each comprising one or more variables indicative of an interaction between one of the plurality of user systems and the computing device are generated and a search query including the first dynamically defined qualifying measurement point is received. Each record received is searched. For each record containing the first dynamically defined qualifying measurement point, an associated one of the plurality of user devices is qualified for the at least one experiment and, for each remaining record, the associated one of the plurality of user devices is excluded for the at least one experiment.

Abstract: Systems and methods for providing a shared control group are disclosed. A request for a page is received and each user device is assigned to a shared control pool or one of a plurality of experiments. The shared control pool includes a first percentage of user devices and each of the experiments includes an experimental percentage. For each user device in the shared control pool, a base version of each element is transmitted; for each user device in a first experiment, a first variant element is transmitted; and for each user device assigned to a second experiment a second variant element is transmitted. A record indicative of interactions that occur after transmission is received and the interactions of a first subset of the shared control pool is compared with the devices assigned to the first experiment and a second subset is compared to the devices assigned to the second experiment.

Abstract: Systems and methods for dynamically defining smart measurement points are disclosed. A first experiment configured to provide one of a base element or a variant element is defined and the first experiment is associated with a first page. The first experiment includes a first dynamically defined qualifying measurement point. A plurality of records each comprising one or more variables indicative of an interaction between one of the plurality of user systems and the computing device are generated and a search query including the first dynamically defined qualifying measurement point is received. Each record received is searched. For each record containing the first dynamically defined qualifying measurement point, an associated one of the plurality of user devices is qualified for the at least one experiment and, for each remaining record, the associated one of the plurality of user devices is excluded for the at least one experiment.

Abstract: Systems and methods for providing a shared control group are disclosed. A request for a page is received and each user device is assigned to a shared control pool or one of a plurality of experiments. The shared control pool includes a first percentage of user devices and each of the experiments includes an experimental percentage. For each user device in the shared control pool, a base version of each element is transmitted; for each user device in a first experiment, a first variant element is transmitted; and for each user device assigned to a second experiment a second variant element is transmitted. A record indicative of interactions that occur after transmission is received and the interactions of a first subset of the shared control pool is compared with the devices assigned to the first experiment and a second subset is compared to the devices assigned to the second experiment.