Abstract: A system, method, and computer program product for producing maps, including a client module for dividing a map production job into smaller tasks; and a worker module for enabling workers to perform said tasks. A test module is provided for enforcing quality standards and includes a qualification module for verifying that a worker is qualified to work on a task, a binary test module for prompting workers to review and pass or fail a submission, a comparative test module for assigning a task to multiple workers and comparing the results, a defacing module for introducing errors into submissions, a client review module for enabling a client to review and pass or fail a submission, and/or an eligibility module for preventing failing workers from contributing to a job.