Abstract: A system and method for automatically determining an amount of review a crowd-sourcing task needs after an initial review has been completed by a processing worker. An evaluation metric is automatically assigned to the work performed by the processing worker to determine the appropriate amount of human review required for a particular task. The evaluation metric may be calculated by accessing and evaluating a plurality of transaction categories related, but not limited to, worker characteristics, document characteristics and processing characteristics. Additionally, the evaluation metric may be used to determine compensation of the processing worker and whether a promotion or demotion is necessary. The system is also capable of balancing individual workloads based upon the evaluation metric.