Abstract: An approach is provided in which a knowledge manager generates a knowledge structure that includes security annotation tokens and term tokens. Each of the security annotation tokens are stored in a parallel field and align to at least one of the term tokens. The knowledge manager matches security policies corresponding to a search request to one or more of the security annotation tokens and, in turn, generates search results based upon obfuscation of one or more of the term tokens aligned to the matched security annotation tokens.

Abstract: Mechanisms are provided for performing context based synonym filtering for natural language processing. Content is parsed into one or more conceptual units, wherein each conceptual unit comprises a portion of text of the content that is associated with a single concept. For each conceptual unit, a term in the conceptual unit is identified that has a synonym to be utilized during natural language processing of the content. A first measure of relatedness of the term to at least one other term in the conceptual unit is determined. A second measure of relatedness of the synonym of the term to the at least one other term in the conceptual unit is determined. A determination whether or not to utilize the synonym when performing natural language processing on the conceptual unit is made based on the first and second measures of relatedness and natural language processing on the content is performed accordingly.

Abstract: According to an aspect, a question answering computer system determines a set of search terms for a given question. A plurality of passages that each includes at least one search term in the set of search terms is identified in response to a search of a document for search terms in the set of search terms. A passage from the plurality of passages is selected. A context based score of the selected passage that indicates the likelihood that the selected passage contains an answer to the question is generated based on criteria that specify a relationship among the set of search terms, content of the passage, and content of at least one other passage in the plurality of passages.

Abstract: Mechanisms are provided for performing context based synonym filtering for natural language processing. Content is parsed into one or more conceptual units, wherein each conceptual unit comprises a portion of text of the content that is associated with a single concept. For each conceptual unit, a term in the conceptual unit is identified that has a synonym to be utilized during natural language processing of the content. A first measure of relatedness of the term to at least one other term in the conceptual unit is determined. A second measure of relatedness of the synonym of the term to the at least one other term in the conceptual unit is determined. A determination whether or not to utilize the synonym when performing natural language processing on the conceptual unit is made based on the first and second measures of relatedness and natural language processing on the content is performed accordingly.

Abstract: An approach is provided in which a knowledge manager generates term tokens from terms included in an original text stream, and generates annotation tokens with corresponding term location information. In turn, the knowledge manager generates a knowledge structure that indexes the term tokens into original text fields and indexes the annotation tokens into parallel fields that align to the original text fields based upon the term location information.

Abstract: According to an aspect, a question answering computer system determines a set of search terms for a given question. A plurality of passages that each includes at least one search term in the set of search terms is identified in response to a search of a document for search terms in the set of search terms. A passage from the plurality of passages is selected. A context based score of the selected passage that indicates the likelihood that the selected passage contains an answer to the question is generated based on criteria that specify a relationship among the set of search terms, content of the passage, and content of at least one other passage in the plurality of passages.

Abstract: Mechanisms are provided for performing context based synonym filtering for natural language processing. Content is parsed into one or more conceptual units, wherein each conceptual unit comprises a portion of text of the content that is associated with a single concept. For each conceptual unit, a term in the conceptual unit is identified that has a synonym to be utilized during natural language processing of the content. A first measure of relatedness of the term to at least one other term in the conceptual unit is determined. A second measure of relatedness of the synonym of the term to the at least one other term in the conceptual unit is determined. A determination whether or not to utilize the synonym when performing natural language processing on the conceptual unit is made based on the first and second measures of relatedness and natural language processing on the content is performed accordingly.