Abstract: Evaluating intent authoring processes, by a processor in a computing environment. A dataset comprising utterances of interactive dialog sessions between agents and clients for a given product or service is received. A classification of at least a portion of the utterances is performed for a target intent according to at least one of a plurality of recommendation algorithms, where the classification is performed by an automatic driver invoking the recommendation algorithm and simulating a manual confirmation of the algorithm's decision by a user. A classifier trained with the utterances recommended and confirmed by the automatic driver is automatically evaluated according to at least one of the plurality of evaluation criteria. A report tracking the evaluation results is generated.

Abstract: Evaluating intent authoring processes, by a processor in a computing environment. Results are received of a simulated intent labeling effort of a dataset comprising utterances of interactive dialog sessions between agents and clients for a given product or service. Figures of merits for respective algorithms used to perform the simulated intent labeling effort are computed. Each of the respective algorithms are evaluated according to the computed figures of merits; and one of the respective algorithms is implemented for labeling intents of a remaining corpus of the synthesized dataset according to parameters evaluated in the computed figures of merits.

Abstract: Evaluating intent authoring processes, by a processor in a computing environment. Results are received of a simulated intent labeling effort of a dataset comprising utterances of interactive dialog sessions between agents and clients for a given product or service. Figures of merits for respective algorithms used to perform the simulated intent labeling effort are computed. Each of the respective algorithms are evaluated according to the computed figures of merits; and one of the respective algorithms is implemented for labeling intents of a remaining corpus of the synthesized dataset according to parameters evaluated in the computed figures of merits.

Abstract: Evaluating intent authoring processes, by a processor in a computing environment. A dataset comprising utterances of interactive dialog sessions between agents and clients for a given product or service is received. A classification of at least a portion of the utterances is performed for a target intent according to at least one of a plurality of recommendation algorithms, where the classification is performed by an automatic driver invoking the recommendation algorithm and simulating a manual confirmation of the algorithm's decision by a user. A classifier trained with the utterances recommended and confirmed by the automatic driver is automatically evaluated according to at least one of the plurality of evaluation criteria. A report tracking the evaluation results is generated.