Abstract: The disclosed embodiments provide a system for performing A/B testing of service-level metrics. During operation, the system obtains service-level metrics for service calls made during an A/B test, wherein the service-level metrics are aggregated by user identifiers of multiple users. Next, the system matches the service-level metrics to treatment assignments of the users to a treatment group and a control group in the A/B test. The system then applies the A/B test to a first grouping of the service-level metrics for the treatment group and a second grouping of the service-level metrics for the control group. Finally, the system outputs a result of the A/B test for use in assessing an effect of a treatment variant in the A/B test on the service-level metrics.

Abstract: The disclosed embodiments provide a system that uses A/B testing to safely terminate unused experiments. During operation, the system determines a first A/B test that matches one or more criteria for removal from an A/B testing platform. Next, the system initiates a first ramp-down of the first A/B test to observe an effect of a control variant on a performance metric for the first A/B test. When the effect includes a change in the performance metric, the system automatically removes code blocks that use the first A/B test on the A/B testing platform and terminates the first A/B test.

Abstract: The disclosed embodiments provide a system for evaluating targeting conditions for A/B tests. During operation, the system obtains a test configuration containing targeting conditions for an A/B test, wherein the targeting conditions include attributes of one or more segments of users and operators to be applied to the attributes. Next, the system identifies an operator between a first targeting condition that can be evaluated locally and a second targeting condition that requires a remote call to evaluate. The system then evaluates the first targeting condition without evaluating the second targeting condition to produce an output value of the first targeting condition. When application of the operator to the output value produces a Boolean value, the system returns the Boolean value as an evaluation result for a portion of the test configuration represented by the operator, the first targeting condition, and the second targeting condition.

Abstract: Methods and systems are provided for compression and reconstruction of system data. A controller of a memory system includes a compression component for searching for a pattern of an array of system data including a plurality of elements and compressing the array of system data based on the pattern. The array of system data includes neighbor elements corresponding to a first pattern, among the plurality of elements. The compressed system data includes: first information including a first bit indicating a first content; and second information including a first bitmap, each bit of the first bitmap indicating whether a corresponding element is a first element among the neighbor elements of the first pattern.

Abstract: Methods and instruction sets are provided for performing event management in an embedded system such as a memory system including a memory device and a controller. The controller divides a group of objects, among a plurality of groups of objects, into a plurality of subgroups, each subgroup including a plurality of objects. The controller counts a number of times that each of the objects is affected by external event using an event counter, updates a count value of each of the subcounters each time an object in the corresponding subgroup is affected by the external event, updates a count value of a main counter each time one of the subcounters reaches a count value equal to a first threshold value; and performing system action on the group of objects, when the count value of the main counter is equal to a second threshold value.