Abstract: Systems and methods for managing file operations over shared content in the presence of two or more heterogeneous file systems. A virtual file system provides data consistency pertaining to asynchronous interactions between the heterogeneous storage systems. Operations of the virtual file system include receiving a file system call from a first storage environment for performing one or more data operations at a second storage environment. After receiving the file system call, the virtual file system issues file system calls to the second storage environment and records a first set of metadata. To determine if and when the one or more data operations at the second storage environment have completed, the virtual file system accesses a second set of metadata from the second storage environment. The two sets of metadata are compared. If there are differences, then the virtual file system performs time delays until the two sets of metadata agree.

Abstract: According to one embodiment, distributing data across a plurality of storage shards can comprise generating a file key for each file of a plurality of files stored in a plurality of physical shards, each physical shard maintained by a node of a plurality of nodes in one or more clusters. The file key can comprise a hash of an enterprise identifier for an entity to which the creator of the file is a member, a hash of a folder identifier for a location in which the file is stored, and a hash of a file identifier uniquely identifying the file. The generated file keys can be sorted into an ordered list and the ordered list can be logically partitioning into a plurality of logical shards. Each logical shard of the plurality of logical shards can then be mapped to one of the plurality of physical shards.

Abstract: According to one embodiment, distributing data across a plurality of storage shards can comprise generating a file key for each file of a plurality of files stored in a plurality of physical shards, each physical shard maintained by a node of a plurality of nodes in one or more clusters. The file key can comprise a hash of an enterprise identifier for an entity to which the creator of the file is a member, a hash of a folder identifier for a location in which the file is stored, and a hash of a file identifier uniquely identifying the file. The generated file keys can be sorted into an ordered list and the ordered list can be logically partitioning into a plurality of logical shards. Each logical shard of the plurality of logical shards can then be mapped to one of the plurality of physical shards.

Abstract: A “hybrid derived cache” stores semi-structured data or unstructured text data in an in-memory mirrored form and columns in another form, such as column-major format. The hybrid derived cache may cache scalar type columns in column-major format. The structure of the in-memory mirrored form of semi-structured data or unstructured text data enables and/or enhances access to perform path-based and/or text based query operations. A hybrid derived cache improves cache containment for executing query operations. The in-memory mirrored form is used to compute queries in a transactionally consistent manner through the use of an invalid vector that used to determine when to retrieve the transactionally consistent persistent form of semi-structured data or unstructured text data in lieu of the in-memory form.

Abstract: According to one embodiment, distributing data across a plurality of storage shards can comprise generating a file key for each file of a plurality of files stored in a plurality of physical shards, each physical shard maintained by a node of a plurality of nodes in one or more clusters. The file key can comprise a hash of an enterprise identifier for an entity to which the creator of the file is a member, a hash of a folder identifier for a location in which the file is stored, and a hash of a file identifier uniquely identifying the file. The generated file keys can be sorted into an ordered list and the ordered list can be logically partitioning into a plurality of logical shards. Each logical shard of the plurality of logical shards can then be mapped to one of the plurality of physical shards.

Abstract: A “hybrid derived cache” stores semi-structured data or unstructured text data in an in-memory mirrored form and columns in another form, such as column-major format. The hybrid derived cache may cache scalar type columns in column-major format. The structure of the in-memory mirrored form of semi-structured data or unstructured text data enables and/or enhances access to perform path-based and/or text based query operations. A hybrid derived cache improves cache containment for executing query operations. The in-memory mirrored form is used to compute queries in a transactionally consistent manner through the use of an invalid vector that used to determine when to retrieve the transactionally consistent persistent form of semi-structured data or unstructured text data in lieu of the in-memory form.

Abstract: Systems and methods for managing file operations over shared content in the presence of two or more heterogeneous file systems. A virtual file system provides data consistency pertaining to asynchronous interactions between the heterogeneous storage systems. Operations of the virtual file system include receiving a file system call from a first storage environment for performing one or more data operations at a second storage environment. After receiving the file system call, the virtual file system issues file system calls to the second storage environment and records a first set of metadata. To determine if and when the one or more data operations at the second storage environment have completed, the virtual file system accesses a second set of metadata from the second storage environment. The two sets of metadata are compared. If there are differences, then the virtual file system performs time delays until the two sets of metadata agree.

Abstract: A method, system, and computer program product for information retrieval and sentiment assessment. The method parses a sentiment-aware query to isolate one or more lexical terms to be included in a lexical retrieval of documents containing the lexical terms. The parsing of the query includes parsing the query to isolate portions of the query to be included in the configuration of a sentiment analysis of the retrieved documents. The documents retrieved based on the lexical terms are processed so as to generate a sentiment assessment, and the sentiment found in the retrieved documents might be correlated to terms that are not present in the lexical terms. The sentiment assessment is presented as a “positive” or “negative” indication, or as a sentiment assessment score. The sentiment portion of the query can specify an area of interest, and/or can specify a user-selected classifier model that is used to process the retrieved documents.

Abstract: A method, system, and computer program product for information retrieval and sentiment assessment. The method parses a sentiment-aware query to isolate one or more lexical terms to be included in a lexical retrieval of documents containing the lexical terms. The parsing of the query includes parsing the query to isolate portions of the query to be included in the configuration of a sentiment analysis of the retrieved documents. The documents retrieved based on the lexical terms are processed so as to generate a sentiment assessment, and the sentiment found in the retrieved documents might be correlated to terms that are not present in the lexical terms. The sentiment assessment is presented as a “positive” or “negative” indication, or as a sentiment assessment score. The sentiment portion of the query can specify an area of interest, and/or can specify a user-selected classifier model that is used to process the retrieved documents.