Abstract: A method and system for assembling a test having a plurality of slots is disclosed. The method includes executing a test administration script to associate each of the plurality of slots of the test with an item collection from which an item to fill the slot is to be chosen and to determine a lookup table of optimization statistics and a degree of randomization to use in selecting items from the item collection. An interim test score is obtained based on a portion of the test previously assembled. Optimization statistics are applied to control a property of the test based on the interim score while taking into account the degree of randomization.