Abstract: A method for searching indexed packages, generating indexed packages for the records of data based on a parameter, each indexed package characterized by a package key, generating metadata for the indexed packages, the metadata comprising the package key and a reference to the packaged records of data based on a value of the parameter, storing the indexed packages and querying the records of data based on a query defining a search value of the parameter. Querying the records comprises searching the metadata based on the search value and identifying a package key for the metadata referencing the search value of the parameter, loading, from a file-based cache, an indexed package based on the identified package key, when the indexed package is stored in the cache, and loading, from the data repository which is an archive storage, the indexed package when the indexed package is not stored in the cache.

Abstract: Embodiments provide systems and methods for multi-stage querying of archived data. One embodiment includes a relational database storing package keys for a plurality of archived data packages, each of the plurality of archived data packages corresponding to a different package key, and a filesystem to provide a package data cache. The system further includes query logic for: receiving a search query comprising search criteria, searching package keys using a subset of the search criteria to identify an archived package potentially meeting the search criteria, based on identifying the package, searching package data of the package in the package data cache for records that meet the search criteria and returning record metadata for the record meeting the search criteria.

Abstract: A method for searching indexed packages, generating indexed packages for the records of data based on a parameter, each indexed package characterized by a package key, generating metadata for the indexed packages, the metadata comprising the package key and a reference to the packaged records of data based on a value of the parameter, storing the indexed packages and querying the records of data based on a query defining a search value of the parameter. Querying the records comprises searching the metadata based on the search value and identifying a package key for the metadata referencing the search value of the parameter, loading, from a file-based cache, an indexed package based on the identified package key, when the indexed package is stored in the cache, and loading, from the data repository which is an archive storage, the indexed package when the indexed package is not stored in the cache.

Abstract: Embodiments provide systems and methods for multi-stage querying of archived data. One embodiment includes a relational database storing package keys for a plurality of archived data packages, each of the plurality of archived data packages corresponding to a different package key, and a filesystem to provide a package data cache. The system further includes query logic for: receiving a search query comprising search criteria, searching package keys using a subset of the search criteria to identify an archived package potentially meeting the search criteria, based on identifying the package, searching package data of the package in the package data cache for records that meet the search criteria and returning record metadata for the record meeting the search criteria.