Abstract: One embodiment of the invention, directed to a computer implemented method in a computer system comprising at least one component, includes the step of responsive to detecting a problem in the system, generating a set of crowdsourcing tasks for analyzing a first possible cause of the detected problem. The method further includes the steps of assigning the set of crowdsourcing tasks to one or more selected crowdsourcing experts, and using information derived at least in part from task results provided by one or more crowdsourcing experts to compute a problem completeness (PC) index. Responsive to determining that the first possible cause is not the root cause of the detected problem, the PC Index is used to determine whether to assign one or more additional crowdsourcing tasks to any crowdsourcing experts.

Abstract: One embodiment of the invention, directed to a computer implemented method in a computer system comprising at least one component, includes the step of responsive to detecting a problem in the system, generating a set of crowdsourcing tasks for analyzing a first possible cause of the detected problem. The method further includes the steps of assigning the set of crowdsourcing tasks to one or more selected crowdsourcing experts, and using information derived at least in part from task results provided by one or more crowdsourcing experts to compute a problem completeness (PC) index. Responsive to determining that the first possible cause is not the root cause of the detected problem, the PC Index is used to determine whether to assign one or more additional crowdsourcing tasks to any crowdsourcing experts.