Abstract: Methods, systems, and media are provided for an optimized search engine index. The optimized index is formed by merging small lower level indexes of fresh documents together into a hierarchical cluster of multiple higher level indexes. The optimized index of fresh documents is formed via a single threaded process, while a fresh index serving platform concurrently serves fresh queries. The hierarchy of higher level indexes is formed by merging lower and/or higher level indexes with similar expiration times together. Therefore, as some indexes expire, the remaining un-expired indexes can be re-used and merged with new incoming indexes. The single threaded process provides fast serving of fresh documents, while also providing time to integrate the fresh indexes into a long term primary search engine index, prior to expiring.

Abstract: Methods, systems, and media are provided for an optimized search engine index. The optimized index is formed by merging small lower level indexes of fresh documents together into a hierarchical cluster of multiple higher level indexes. The optimized index of fresh documents is formed via a single threaded process, while a fresh index serving platform concurrently serves fresh queries. The hierarchy of higher level indexes is formed by merging lower and/or higher level indexes with similar expiration times together. Therefore, as some indexes expire, the remaining un-expired indexes can be re-used and merged with new incoming indexes. The single threaded process provides fast serving of fresh documents, while also providing time to integrate the fresh indexes into a long term primary search engine index, prior to expiring.

Abstract: Systems, methods, and computer storage media for performing a structured search using metadata in a search index. A search index is augmented with meta words that are traditionally not found in the documents indexed. Documents to be indexed in the search index are analyzed to determine if a meta word that has a logical relationship to the document should be associated and then stored in the index along with metadata. In some embodiments the metadata is attribute metadata and document identification metadata. Query operators are then provided to aid in performing a structured search of the search index. In some embodiments s structured search request is received and parsed into nodes which is then utilized to search a search index. In some embodiments, the results of the search index are merged, duplicates removed, and sorted when presented.