Abstract: Mechanisms are provided for performing load balancing of question processing in a Question and Answer (QA) system, implemented by the data processing system, having a plurality of QA system pipelines. The mechanisms receive an input question for processing by the QA system and determine a predicted question difficulty of the input question. The mechanisms select a QA system pipeline from the plurality of QA system pipelines based on the predicted question difficulty and route the input question to the selected QA system pipeline for processing. In addition, the mechanisms process the input question with the selected QA system pipeline to generate an answer for the input question.

Abstract: An approach is provided to use natural language processing (NLP) to analyze data logs. In the approach, a data log is analyzed with the data log including a number of entries. The analysis performed includes performance of a sentiment analysis of the entries using natural language processing. The result of the sentiment analysis results is a sentiment score. Entries from the data log are then visually highlighted based on their corresponding sentiment scores.

Abstract: Mechanisms for selecting a pipeline of a question and answer (QA) system to process an input question are provided. An input question is received and analyzed to identify at least one feature of the input question. Clustering of the input question, with one or more previously generated clusters of questions, is performed based on the at least one feature of the input question. Based on results of the clustering, a matching cluster, of the one or more previously generated clusters, is identified with which the input question is associated. A QA system pipeline associated with the matching cluster is identified and the input question is processed using the identified QA system pipeline to generate one or more candidate answers for the input question. Each cluster in the one or more previously generated clusters has an associated QA system pipeline.

Abstract: Mechanisms for selecting questions for a cluster of questions to be used with a question and answer (QA) system are provided. An input question is received and analyzed to identify at least one feature of the input question. Clustering of the input question with one or more other questions in a cluster of questions based on the at least one feature of the input question is performed. Based on results of the clustering, a determination is made as to whether to include or reject the input question as part of the cluster of questions. In response to determining to include the input question as part of the cluster of questions, the cluster of questions is updated to include the input question. The updated cluster of questions is stored in a storage device associated with a data processing system.

Abstract: Mechanisms are provided in a data processing system for utilizing algorithms based on categories in a question answering system. The mechanisms capture a history of performance and correctness metrics for identifying efficiency of respective algorithms for finding answers to questions in respective question categories in a question answering system. The mechanisms determine sets of algorithms to use for respective question categories according to efficiency and correctness analysis. The mechanisms determine a question category of a given input question and execute a set of algorithms corresponding to the question category of the given input question that meet an efficiency threshold to contribute to finding a correct answer for the given input question.