Abstract: Systems and methods for using virtual currency to compensate workers in a crowd sourced task are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of determining target accuracy in completion of the task by the online workers, computing a number of results to be collected for a unit job of the task based on the target accuracy; and/or setting a wage amount that is offered to a worker for completing a unit job of the task based on the number of results. In response to determining that the worker has completed the unit job, the wage is provided to the online worker in a form of virtual currency.
Type:
Grant
Filed:
June 17, 2010
Date of Patent:
June 1, 2021
Assignee:
CrowdFlower, Inc.
Inventors:
Lukas A. Biewald, Christopher R. Van Pelt
Abstract: Systems and methods of a job distribution platform for aggregating performance data in a worker profile for workers in performing crowd sourced tasks are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of generating and storing performance data when a worker performs one or more tasks distributed online to their respective computing devices by a job distribution platform which crowd sources tasks over a network to remote workers. The tasks can span current jobs and a history of previous jobs distributed to the worker and the job performance data for the worker is collected for current and previous jobs. New jobs can be assigned to a worker selected based on performance data of the worker.
Type:
Grant
Filed:
October 17, 2011
Date of Patent:
January 7, 2014
Assignee:
CrowdFlower, Inc.
Inventors:
Christopher R. Van Pelt, Ryan Cox, Alex Sorokin, Michael Juster
Abstract: Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.
Type:
Grant
Filed:
October 17, 2011
Date of Patent:
October 8, 2013
Assignee:
CrowdFlower, Inc.
Inventors:
David Oleson, Alexander Sorokin, Greg Laughlin, Vaughn Hester, John Le, Christopher R. Van Pelt, Lukas A. Biewald
Abstract: Systems and methods of dynamic optimization for data quality control in crowd sourcing tasks to crowd labor are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for dynamically monitoring results received from workers for a task distributed for evaluation via a job distribution platform, incrementally assigning additional workers to the task using the results and continuously monitoring additional results to assign any additional workers if needed to meet a quality metric for the task.
Type:
Application
Filed:
March 23, 2012
Publication date:
October 18, 2012
Applicant:
CrowdFlower, Inc.
Inventors:
Christopher R. Van Pelt, Ryan Cox, Alexander Sorokin
Abstract: Systems and methods for using virtual currency to compensate workers in a crowd sourced task are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of determining target accuracy in completion of the task by the online workers, computing a number of results to be collected for a unit job of the task based on the target accuracy; and/or setting a wage amount that is offered to a worker for completing a unit job of the task based on the number of results. In response to determining that the worker has completed the unit job, the wage is provided to the online worker in a form of virtual currency.
Type:
Application
Filed:
June 17, 2010
Publication date:
December 22, 2011
Applicant:
CrowdFlower, Inc.
Inventors:
Lukas A. Biewald, Christopher R. Van Pelt
Abstract: Systems and methods of crowd sourcing by distributing a task over a network to multiple workers for completion while providing quality control are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of identifying an attribute of the task, the task including multiple unit jobs, determining target accuracy in completion of the task by the multiple workers, computing a number of results to be collected for a unit job of the task based on the target accuracy, setting a wage amount that is offered to a worker for completing a unit job of the task based on the attribute and the target accuracy, and/or collecting and aggregating statistics of the workers completing the select unit jobs for quality control.
Type:
Application
Filed:
June 17, 2010
Publication date:
December 22, 2011
Applicant:
CrowdFlower, Inc.
Inventors:
Lukas A. Biewald, Christopher R. Van Pelt