Abstract: Non-limiting embodiments of the present technology are directed to a method and system for generating a training dataset. The method comprises: accessing data associated with a plurality of assessors executing digital tasks of a first type and digital tasks of a second type; generating, a first ranked list of assessors and a second ranked list of assessors based on their past performance; for a given one of the plurality of assessors: generating, a class score for the common class of digital tasks; acquiring a request for executing a digital task of a third type; ranking, the plurality of assessors based on respective class scores, the given one from the plurality of assessors being one of top ranked ones from the plurality of assessors; transmitting the digital task of the third type to the given one; generating the training data for the MLA based on a response from the given one.

Abstract: A method and a system for generating training data for an MLA are provided. The method comprises: retrieving assessor data including data indicative of a plurality of results responsive to the given digital task having been submitted to a set of assessors; determining, for a given result, a number of instances thereof within the plurality of results; determining, a respective value of an aggerate quality metric associated with the given result; identifying a reliable result of the plurality of results as being associated with a maximum value of the aggregate quality metric; determining, based on the reliable result, updated quality scores for each one of the current set of assessors; generating, based on the respective updated quality score, an updated set of assessors; and generating the training data for the MLA including data generated in response to respective ones of the updated set of assessors completing a subsequent digital task.

Abstract: A method and a system for generating training data for an MLA are provided. The method comprises: retrieving assessor data associated with a plurality of assessors, the assessor data including data indicative of a plurality of results responsive to a given digital task having been submitted to the plurality of assessors; based on the plurality of results, determining at least one set of assessors in the plurality of assessors, such that a consistency metric amongst results provided by the at least one set of assessors for the given digital task is maximized, transmitting a subsequent digital task to respective electronic devices associated with the at least one set of assessors; and generating the training data for the computer-executable MLA including data generated in response to respective ones of the at least one set of assessors completing the subsequent digital task.