Abstract: A system to detect and resolve conflicts between different experiments running on a website building system (WBS). The system includes at least one processor, a conflict resolver to check for interactions and conflicts between an experiment and at least one other existing experiment from a set of existing experiments in the WBS, when the experiment is set-up or integrated into the set of existing experiments. The conflict resolver either resolves the interactions and conflicts, or allows the interactions and conflicts to remain. The system also includes an experiment manager running on the at least one processor to manage and coordinate the experiment and the at least one other existing experiment when the experiment is running concurrently with the at least one other existing experiment, after set-up or integration of the experiment.

Abstract: A website building system (WBS) that enables web site designers to build and host websites for their end users. The WBS includes at least one processor and an experiment manager running on the at least one processor to manage multiple concurrent experiments at runtime with the experiments to test at least features, components or system updates for the WBS and where the experiment manager at least selects a target population for an experiment, handles conflict resolution between the experiment and at least one other concurrent experiment, and collects experiment data. The WBS also includes an experiment analyzer to analyze the experiment data during runtime and to update the experiment manager accordingly.

Abstract: A website building system (WBS) that enables web site designers to build and host websites for their end users. The WBS includes at least one processor and an experiment manager running on the at least one processor to manage multiple concurrent experiments at runtime with the experiments to test at least features, components or system updates for the WBS and where the experiment manager at least selects a target population for an experiment, handles conflict resolution between the experiment and at least one other concurrent experiment, and collects experiment data. The WBS also includes an experiment analyzer to analyze the experiment data during runtime and to update the experiment manager accordingly.

Abstract: An experiment management system for an online visual design system including an experiment creator to receive an experiment specification with source material from an external source and to create an experiment definition based on inspection and analysis of the source material; an experiment integrator to integrate the experiment definition as an experiment into the experiment management system; an experiment configurer to configure a variant and population selection criteria for the experiment and an experiment manager to manage the experiment and at least one other experiment during the execution of the experiment at runtime of the online visual design system according to the variant and population selection.

Abstract: An experiment management system for an online visual design system including an experiment creator to receive an experiment specification with source material from an external source and to create an experiment definition based on inspection and analysis of the source material; an experiment integrator to integrate the experiment definition as an experiment into the experiment management system; an experiment configurer to configure a variant and population selection criteria for the experiment and an experiment manager to manage the experiment and at least one other experiment during the execution of the experiment at runtime of the online visual design system according to the variant and population selection.