Abstract: A system and method for identifying relevant search results via an index is provided. A search query is received. A semantic representation of query substructures and a list of key terms is generated for the query. Each key term includes a term in the search query or a term related to the query. An inverted index having key terms each associated with a semantic representation and a link to a source reference is accessed. The inverted index is queried using a subset of key terms. A result set for the subset key terms is identified within the inverted index. Each result is scored and a subset of the result set is identified as retrieval candidates based on the scoring. One or more of the retrieval candidates are selected based on a comparison of the query semantic representation with the semantic representations for the retrieval candidates.

Abstract: A system and method for identifying relevant search results via an index is provided. A search query is received. A semantic representation of query substructures and a list of key terms is generated for the query. Each key term includes a term in the search query or a term related to the query. An inverted index having key terms each associated with a semantic representation and a link to a source reference is accessed. The inverted index is queried using a subset of key terms. A result set for the subset key terms is identified within the inverted index. Each result is scored and a subset of the result set is identified as retrieval candidates based on the scoring. One or more of the retrieval candidates are selected based on a comparison of the query semantic representation with the semantic representations for the retrieval candidates.

Abstract: A system and method for identifying semantically relevant documents is provided. An index having semantic index key terms from one or more documents is maintained. A query is obtained and semantic key terms of the query are identified. Each of the query key terms are associated with information, including use of the word and a grammatical role of the word. Each of the query key terms and variants of the query key terms is looked up in the index based on the information. One or more of the documents in the index are identified as possible relevant candidates based on the look up. A potential match candidate set is generated by filtering the possible relevant candidates. At least one of the documents that match the query is identified by comparing a semantic representation for each non-filtered potential match candidate in the set with a semantic representation for the query.

Abstract: Computer-readable media and a computer system for implementing a natural language search using fact-based structures and for generating such fact-based structures are provided. A fact-based structure is generated using a semantic structure, which represents information, such as text, from a document, such as a web page. Typically, a natural language parser is used to create a semantic structure of the information, and the parser identifies terms, as well as the relationship between the terms. A fact-based structure of a semantic structure allows for a linear structure of these terms and their relationships to be created, while also maintaining identifiers of the terms to convey the dependency of one fact-based structure on another fact-based structure. Additionally, synonyms and hypernyms are identified while generating the fact-based structure to improve the accuracy of the overall search.

Abstract: Systems and methods for semantic search are provided. A corpus of information grouped into passages are indexed by semantic key terms generated from packed knowledge representations that document the semantic relationships of information within those passages. When a search is conducted, a query is similarly transformed into a packed knowledge representation that documents the semantic relationships from which semantic key terms are also generated. An inverted index relating the semantic key terms associated to the passages is searched using the semantic key terms generated from the query. A set of candidate passages is selected and refined by analysis of the semantic key terms and other information. The semantic representations associated with the set of candidate passages are then matched to the semantic representation of the query to determine a search result set.

Abstract: Computer methods, apparatus and articles of manufacture therefor, are disclosed for developing a complex-query pattern that is transformed into a region-matching transducer. A corpus-level transducer and the region matching transducer are combined. The combined transducer is applied to a corpus to identify strings therein that satisfy patterns defined in the corpus-level transducer, including the complex-query pattern, with each identified pattern being recorded in a corpus index. The corpus and the corpus index are made available for receiving a query with the query tag for querying the corpus and applying the query using the corpus index to identify locations in the corpus that satisfy the query.

Abstract: Methods and systems for the generation of computer readable indexes or other ordered lists are provided. A corpus of electronic documents or other electronic information is parsed into postings that include key and reference pairs. An inversion buffer in memory is explicitly or implicitly formatted to receive the postings in a predetermined order by key. Each key is assigned a space in the inversion buffer that is subsequently filled with references associated with the key during an inversion method. In an embodiment, an index file is generated directly from the inversion buffer, or in the case of large inversions, from a plurality of inversion buffer segments.

Abstract: A system and method for providing full-text search integration in XQuery is presented. A built-in search function defined in an XQuery language is implemented, and a full-text search is initiated. The search function includes one or more search terms and a relation logic. Variants for each search term in the search function are identified. Posting lists are obtained for one or more of the variants. Each posting list includes values offset from elements containing the search term associated with the variant to which the posting list corresponds. The relation logic is applied to the offset values of the posting lists. Those elements with offset values that satisfy the relation logic are selected. The elements that satisfy the relation logic are provided as results of the full-text search.

Abstract: Computer methods, apparatus and articles of manufacture therefor, are disclosed for developing a complex-query pattern that is transformed into a region-matching transducer. A corpus-level transducer and the region matching transducer are combined. The combined transducer is applied to a corpus to identify strings therein that satisfy patterns defined in the corpus-level transducer, including the complex-query pattern, with each identified pattern being recorded in a corpus index. The corpus and the corpus index are made available for receiving a query with the query tag for querying the corpus and applying the query using the corpus index to identify locations in the corpus that satisfy the query.

Abstract: A binary object XML repository for storage and retrieval of data in XML documents includes import manager capabilities for converting file formats to XML. Indexing capabilities encode XML document data in a binary data structure for storage within lexicon(s) in the form of tokens and token types, with a token including data elements corresponding to XML syntax. The lexicon(s) also assigns token identifier numbers, which sequence module(s) store in an original sequence. Postings module(s) map the token identifier numbers to the token identifier's position in the original sequence.

Abstract: A system and method for providing full-text search integration in XQuery is presented. A built-in search function defined in an XQuery language is implemented, and a full-text search is initiated. The search function includes one or more search terms and a relation logic. Variants for each search term in the search function are identified. Posting lists are obtained for one or more of the variants. Each posting list includes values offset from elements containing the search term associated with the variant to which the posting list corresponds. The relation logic is applied to the offset values of the posting lists. Those elements with offset values that satisfy the relation logic are selected. The elements that satisfy the relation logic are provided as results of the full-text search.

Abstract: A system for extension of XQuery in a binary object XML repository includes XQuery interpreter capabilities for implementing the XQuery language in the binary object XML repository. A function dispatcher module implements an XQuery call mechanism, with the function being defined by the name of the function, the number of arguments taken by the function, and the datatypes of the arguments. A plug-in function library manager implements the client side of the binary object XML repository plug-in function application program interface, and a dynamically-linked plug-in function library module for implements the server side of the binary object XML repository plug-in function application program interface.

Abstract: Systems and methods for semantic search are provided. A corpus of information grouped into passages are indexed by semantic key terms generated from packed knowledge representations that document the semantic relationships of information within those passages. When a search is conducted, a query is similarly transformed into a packed knowledge representation that documents the semantic relationships from which semantic key terms are also generated. An inverted index relating the semantic key terms associated to the passages is searched using the semantic key terms generated from the query. A set of candidate passages is selected and refined by analysis of the semantic key terms and other information. The semantic representations associated with the set of candidate passages are then matched to the semantic representation of the query to determine a search result set.

Abstract: Computer-readable media and a computer system for implementing a natural language search using fact-based structures and for generating such fact-based structures are provided. A fact-based structure is generated using a semantic structure, which represents information, such as text, from a document, such as a web page. Typically, a natural language parser is used to create a semantic structure of the information, and the parser identifies terms, as well as the relationship between the terms. A fact-based structure of a semantic structure allows for a linear structure of these terms and their relationships to be created, while also maintaining identifiers of the terms to convey the dependency of one fact-based structure on another fact-based structure. Additionally, synonyms and hypernyms are identified while generating the fact-based structure to improve the accuracy of the overall search.

Abstract: A system for full text search integration in XQuery for a binary object XML repository includes XQuery interpreter module(s) for implementing the XQuery language and function dispatcher module(s) for implementing the XQuery function calling mechanism. Search function implementation module(s) implement the component search function and interpret the full-text search query syntax. The search function postings resolution manager module(s) compute the candidate elements for search query resolution, and postings module(s) return all XML nodes that contain a specified token, with a token corresponding to a piece of XML syntax.

Abstract: Methods and systems for the generation of computer readable indexes or other ordered lists are provided. A corpus of electronic documents or other electronic information is parsed into postings that include key and reference pairs. An inversion buffer in memory is explicitly or implicitly formatted to receive the postings in a predetermined order by key. Each key is assigned a space in the inversion buffer that is subsequently filled with references associated with the key during an inversion method. In an embodiment, an index file is generated directly from the inversion buffer, or in the case of large inversions, from a plurality of inversion buffer segments.

Abstract: A system for integrated support in an XML/XQuery database residing within a binary object XML repository (BOXR) for web-based applications includes web browser(s) for sending at least one HTTP request for hxl pages. Hxl pages are defined as web pages containing embedded XQuery expressions, with XQuery being an interactive program used to access data. Server module(s) coordinate operations within a control system including an XML/XQuery database. An hxl processor module provides web application support, and a BOXR XQuery engine processes XQuery queries. An XML repository provides stored representation of XML data.