Abstract: A computer-implemented method to generate a second machine learning model based on a first machine learning model, wherein the second machine learning model is structured for more efficient computation, is provided. The method includes processing an input with a hidden layer of a student machine-learned model to obtain an intermediate output. The method includes providing an encoded message descriptive of the input and the intermediate output for processing with a teacher machine-learned model. The method includes, responsive to providing the encoded message, obtaining a second encoded message descriptive of a second intermediate output of one or more hidden layers of the teacher machine-learned model. The method includes performing a knowledge distillation training process to train the student machine-learned model based on a difference between the intermediate output and the second intermediate output.

Abstract: The disclosed embodiments provide a system for performing network A/B testing. During operation, the system obtains a graph of a social network and calculates a set of equally sized clusters of users in the social network by iteratively switching memberships of the nodes among the equally sized clusters to increase a number of edges in each of the equally sized clusters. Next, the system randomly selects a subset of the equally sized clusters for exposure to a treatment version of a message. The system then performs an A/B test by presenting the treatment version to the selected clusters and tracking a response of the selected clusters to the treatment version.

Abstract: The disclosed embodiments provide a method and system for performing network A/B testing. During operation, the system obtains, for a set of users in a social network, a set of treatment assignments of the users in an A/B test, wherein the treatment assignments indicate exposure of the users to a control version or a treatment version of a message. Next, the system obtains, for each of the users, a fraction of neighbors exposed to the treatment version in the A/B test. The system then applies a statistical model to the treatment assignments and the fraction of neighbors exposed to the treatment version to estimate an average treatment effect (ATE) for the set of users. Finally, the system selects, based on the ATE, a fraction of additional users in the social network for subsequent exposure to the treatment version and presents the treatment version to the fraction of additional users.