Abstract: In one aspect, the present disclosure implements a method that determines whether a submitted image satisfies a geographic constraint which includes defining a rule that establishes a geographic restriction on the submitted image, accessing a geo-code associated with the submitted image, determining whether the geo-code indicates that the submitted image was taken at a location that violates the geographic restriction defined in the rule, and if a determination is made that the submitted image was taken at a location that violates the geographic restriction defined in the rule, eliminating the submitted image from being considered a valid entry in the contest.

Abstract: In one aspect, the present disclosure implements a method that identifies an annotator suited to judge one or more images submitted to a contest. In this regard, the method comprises enabling the annotator to generate scoring information in a plurality of prior contests and collecting the scoring information generated by the annotator. The method further includes calculating a metric that quantifies the ability the annotator to judge image quality relative to other annotators using the collected scoring information. If the metric is higher than a threshold amount, the method includes incentivizing the annotator to judge the images submitted to the contest.