Abstract: Embodiments of the present disclosure relate to applications, platforms, architecture, etc. for assessing annotations generated by annotators in the evaluation of generated outputs. In particular one or more of a first ground truth annotation or a second ground truth annotation corresponding to one or more generated outputs may be obtained. The first ground truth annotation may be based at least on a plurality of assessment annotations and the second ground truth annotation may correspond to an expert related to the one or more generated outputs. Further, one or more assessments related to one or more assessment annotations of the plurality of assessment annotations may be determined based at least on one or more of the first ground truth annotation or the second ground truth annotation. In addition, one or more annotator adjustment operations may be performed based at least on the one or more assessments.