Abstract: A computerized method for controlled testing, comprising: providing a design specification for event data, the design specification including at least one of an event data source, an event data filter, and an event format; retrieving testing metrics; configuring testing events based on the design specification, by: retrieving testing events from the event data source specified in the design specification; filtering the retrieved testing events based in the design specification; and formatting the filtered testing events based on the design specification; generating analysis data by applying testing metrics to the configured event data; generating output data based on testing rules; and generating a user interface to display the output data.

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations.

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations.

Abstract: A computer-implemented systems and methods for capping outliers during an experiment test is disclosed. The computer implemented system comprises a memory storing instructions and at least one or more processors. The at least one or more processors may be configured to configured to execute the instructions to determine at least two groups of users comprising a plurality of users; obtain metric data related to each of the plurality of users; calculate a first value and a second value based on the metric data; identify an occurrence of a trigger event, using the metric data, the first value, and the second value; distribute the metric data into capped data and uncapped data and determine a threshold for the capped data; calculate a third value for the capped data and the uncapped data; determine if the capped data threshold has changed based on the third value; and implement at least one capping percentile value upon occurrence of the trigger event.

Abstract: Embodiments of the present disclosure include computer-implemented systems and methods for predicting a minimum detectable effect. The system may include at least one processor configured to execute instructions to perform steps. The steps may include sending a first webpage to a first user device and a second webpage to a second user device. The second webpage may include at least one characteristic different than the first website. The steps may include collecting user interaction data from the first and second user devices and determining a current minimum detectable effect of a user experience. The steps may include retrieving a set of historic minimum detectable effect values associated with an earlier period of time and determining a percentile rank of the current minimum detectable effect based on the retrieved set of historic minimum detectable effect values.

Abstract: Computer-implemented systems and methods for predicting an optimal stop point during an experiment test are disclosed. A disclosed computer-implemented system comprises a memory storing instructions and at least one or more processors. The at least one or more processors may be configured to execute the instructions to obtain a total test time, obtain a minimum detectable effect trend data, determine an average minimum detectable effect change, determine a minimum detectable effect cumulative change threshold, determine a plurality of instantaneous minimum detectable effect changes, and determine a plurality of cumulative minimum detectable effect changes.

Abstract: A computerized method for controlled testing, comprising: providing a design specification for event data, the design specification including at least one of an event data source, an event data filter, and an event format; retrieving testing metrics; configuring testing events based on the design specification, by: retrieving testing events from the event data source specified in the design specification; filtering the retrieved testing events based in the design specification; and formatting the filtered testing events based on the design specification; generating analysis data by applying testing metrics to the configured event data; generating output data based on testing rules; and generating a user interface to display the output data.

Abstract: Disclosed herein are systems and methods for a system for distributing user requests. The system may comprise a memory storing instructions and at least one processor configured to execute instructions to perform operations.

Abstract: A request for a simultaneous retail and transfer price optimization is received. The request includes a mutual optimization goal of each of at least two participants of a supply chain. Simultaneous optimization input constraints are selected based upon the mutual optimization goal. The requested simultaneous retail and transfer price optimization is performed using the selected simultaneous optimization input constraints. A set of optimized values of the mutual optimization goal is determined, based upon the simultaneous retail and transfer price optimization, using the selected simultaneous optimization input constraints. Each value of the set of optimized values is associated with one of the at least two participants of the supply chain. Output is generated that identifies the determined set of optimized values of the mutual optimization goal.