Patents Assigned to CrowdFlower, Inc.
  • Patent number: 11023859
    Abstract: Systems and methods for using virtual currency to compensate workers in a crowd sourced task are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of determining target accuracy in completion of the task by the online workers, computing a number of results to be collected for a unit job of the task based on the target accuracy; and/or setting a wage amount that is offered to a worker for completing a unit job of the task based on the number of results. In response to determining that the worker has completed the unit job, the wage is provided to the online worker in a form of virtual currency.
    Type: Grant
    Filed: June 17, 2010
    Date of Patent: June 1, 2021
    Assignee: CrowdFlower, Inc.
    Inventors: Lukas A. Biewald, Christopher R. Van Pelt
  • Publication number: 20140122188
    Abstract: Systems and methods of a job distribution platform for aggregating performance data in a worker profile for workers in performing crowd sourced tasks are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of generating and storing performance data when a worker performs one or more tasks distributed online to their respective computing devices by a job distribution platform which crowd sources tasks over a network to remote workers. The tasks can span current jobs and a history of previous jobs distributed to the worker and the job performance data for the worker is collected for current and previous jobs. New jobs can be assigned to a worker selected based on performance data of the worker. Other types of worker information may also be tracked and generated for multiple workers in various worker pools (channels), for example, psych questions or other more subjective data collected from a worker or contributor in addition to performance.
    Type: Application
    Filed: January 6, 2014
    Publication date: May 1, 2014
    Applicant: CROWDFLOWER, INC.
    Inventors: Christopher R. Van Pelt, Ryan Cox, Alexander Sorokin, Michael Juster
  • Publication number: 20140039985
    Abstract: Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.
    Type: Application
    Filed: October 8, 2013
    Publication date: February 6, 2014
    Applicant: CROWDFLOWER, INC.
    Inventors: David Oleson, Alexander Sorokin, Greg Laughlin, Vaughn Hester, John Le, Christopher R. Van Pelt, Lukas A. Biewald
  • Patent number: 8626545
    Abstract: Systems and methods of a job distribution platform for aggregating performance data in a worker profile for workers in performing crowd sourced tasks are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of generating and storing performance data when a worker performs one or more tasks distributed online to their respective computing devices by a job distribution platform which crowd sources tasks over a network to remote workers. The tasks can span current jobs and a history of previous jobs distributed to the worker and the job performance data for the worker is collected for current and previous jobs. New jobs can be assigned to a worker selected based on performance data of the worker.
    Type: Grant
    Filed: October 17, 2011
    Date of Patent: January 7, 2014
    Assignee: CrowdFlower, Inc.
    Inventors: Christopher R. Van Pelt, Ryan Cox, Alex Sorokin, Michael Juster
  • Patent number: 8554605
    Abstract: Systems and methods for evaluating a worker in performing crowd sourced tasks and providing in-task training are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for selecting a job distributed through a job distribution platform for workers to work on, for use to generate a test task, the job being associated with a known correct result, associating a manipulated result, known to be an incorrect result for the job, with the job to generate the test task, and/or presenting the job with the manipulated result as the test task to a worker for evaluation of work quality of the worker. The job distribution platform crowd sources tasks online to workers to work on via their respective computing devices.
    Type: Grant
    Filed: October 17, 2011
    Date of Patent: October 8, 2013
    Assignee: CrowdFlower, Inc.
    Inventors: David Oleson, Alexander Sorokin, Greg Laughlin, Vaughn Hester, John Le, Christopher R. Van Pelt, Lukas A. Biewald
  • Publication number: 20130231969
    Abstract: Systems and methods of adaptive workflow definition of crowd sourced tasks and quality control mechanisms for multiple business applications are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for generating and distributing tasks to workers to optimize product categorization in an online marketplace, generating and distributing tasks to workers for search engine optimization of a website, and/or generating and distributing tasks to workers for business data verification and enhancement. Results can be aggregated from multiple workers to enhance or improve site information, site organization, or other business information to improve site placement in search results and/or to enhance/improve user experience.
    Type: Application
    Filed: March 1, 2013
    Publication date: September 5, 2013
    Applicant: CROWDFLOWER, INC.
    Inventors: Christopher R. Van Pelt, John Le, Greg Laughlin, David Oleson, Brian Hahn
  • Publication number: 20120265573
    Abstract: Systems and methods of dynamic optimization for data quality control in crowd sourcing tasks to crowd labor are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for dynamically monitoring results received from workers for a task distributed for evaluation via a job distribution platform, incrementally assigning additional workers to the task using the results and continuously monitoring additional results to assign any additional workers if needed to meet a quality metric for the task.
    Type: Application
    Filed: March 23, 2012
    Publication date: October 18, 2012
    Applicant: CrowdFlower, Inc.
    Inventors: Christopher R. Van Pelt, Ryan Cox, Alexander Sorokin
  • Publication number: 20110313801
    Abstract: Systems and methods of crowd sourcing by distributing a task over a network to multiple workers for completion while providing quality control are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of identifying an attribute of the task, the task including multiple unit jobs, determining target accuracy in completion of the task by the multiple workers, computing a number of results to be collected for a unit job of the task based on the target accuracy, setting a wage amount that is offered to a worker for completing a unit job of the task based on the attribute and the target accuracy, and/or collecting and aggregating statistics of the workers completing the select unit jobs for quality control.
    Type: Application
    Filed: June 17, 2010
    Publication date: December 22, 2011
    Applicant: CrowdFlower, Inc.
    Inventors: Lukas A. Biewald, Christopher R. Van Pelt
  • Publication number: 20110313820
    Abstract: Systems and methods for using virtual currency to compensate workers in a crowd sourced task are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, of determining target accuracy in completion of the task by the online workers, computing a number of results to be collected for a unit job of the task based on the target accuracy; and/or setting a wage amount that is offered to a worker for completing a unit job of the task based on the number of results. In response to determining that the worker has completed the unit job, the wage is provided to the online worker in a form of virtual currency.
    Type: Application
    Filed: June 17, 2010
    Publication date: December 22, 2011
    Applicant: CrowdFlower, Inc.
    Inventors: Lukas A. Biewald, Christopher R. Van Pelt