Abstract: Embodiments provide a computer implemented method in a data processing system including a processor and a memory, the memory including instructions that are executed by the processor to cause the processor to implement a system for generating a type system. The method includes: receiving a document corpus; identifying frequently occurring words from the document corpus, disregarding stop words; extracting a conceptual text for each frequently occurring word from a structured information database; performing a cluster analysis on each conceptual text to identify possible entity types; performing a frequency analysis on possible entity types to select at least one entity type; identifying a relation type between entities in the document corpus; and generating the type system including entity types and relation types.

Abstract: A method, system, apparatus, and a computer program product are provided for identifying ground truth annotators by applying statistical analyses to a document corpus and to a plurality of annotator profiles to identify, respectively, corpus complexity attributes for the document corpus and annotator qualification attributes for each candidate annotator which are compared with a matching analysis to identify one or more recommended annotators from the plurality of candidate annotators based on the matching analysis.

Abstract: Systems, methods and computer program products for processing natural language input are provided. Natural language input is processed by one or more processing rules. The processing rules may specify one or more actions to be performed. The processing rules may alternatively or additionally split up the natural language input into a plurality of simpler sub-inputs, each of which may then be processed by one or more processing rules. The processing rules themselves may be generalized, which generalization may be based on user input. In the event that a suitable processing rule cannot be found, a request may be made to a user to provide instructions for processing the natural language input.

Abstract: Embodiments provide a computer implemented method in a data processing system including a processor and a memory, the memory including instructions that are executed by the processor to cause the processor to implement a system for generating a type system. The method includes: receiving a document corpus; identifying frequently occurring words from the document corpus, disregarding stop words; extracting a conceptual text for each frequently occurring word from a structured information database; performing a cluster analysis on each conceptual text to identify possible entity types; performing a frequency analysis on possible entity types to select at least one entity type; identifying a relation type between entities in the document corpus; and generating the type system including entity types and relation types.

Abstract: Systems, methods and computer program products for processing natural language input are provided. Natural language input is processed by one or more processing rules. The processing rules may specify one or more actions to be performed. The processing rules may alternatively or additionally split up the natural language input into a plurality of simpler sub-inputs, each of which may then be processed by one or more processing rules. The processing rules themselves may be generalized, which generalization may be based on user input. In the event that a suitable processing rule cannot be found, a request may be made to a user to provide instructions for processing the natural language input.