Abstract: In some aspects, the described systems and methods provide for validating performance of a model trained on a plurality of annotated pathology images. In validating the trained model, frames may be sampled from one or more pathology images. Each frame may include a distinct portion of a pathology image. Reference annotations on the frames may be received from a plurality of users, each reference annotation describing at least one of a plurality of tissue or cellular characteristic categories or other biological objects for a frame. The frames may be processed using the trained model to generate model predictions, each model prediction describing at least one of the tissue or cellular characteristic categories for a processed frame. Performance of the trained model may be validated based on associating the model predicted annotations with the reference annotations across the one or more pathology images from the plurality of users.