Abstract: A highly resilient, scalable, high-performance data storage system that stripes its content across peer computers in a data cluster, across data clusters in a cluster group, and across cluster groups in a multi-cluster-group Hyper Storage System. Multiple peers can fail within a data cluster, even beyond the FEC level configured in the cluster, without disrupting the clients. Multiple entire data clusters can fail or be taken out of service without disrupting the clients. Peer failures are detected by the cluster and all missing data is seamlessly regenerated through vertical and/or horizontal resiliency so the great majority of I/O operations complete successfully.

Abstract: A highly resilient, scalable, high-performance data storage system that stripes its content across a cluster of peer computers. Multiple peers can fail (up to the FEC level configured in the cluster) without disrupting the clients. Peer failures are detected by the cluster and all missing data is seamlessly generated so all I/O operations complete successfully.

Abstract: Digital content from a source (e.g., a file or a stream), is striped and encoded in parallel over a cluster of Storage Systems. The encoding ensures that subsequent retrieval of the data succeeds even when some members of the cluster of Storage Systems are lost or when errors in communication result in the loss of some IP packets. Host Map File (HMF) data is produced that describes fully how to retrieve the content, including the encoding parameters, the cluster of Storage Systems and the striping of the encoded data. This HMF data is then inserted as the header of every encoded file on the cluster of Storage Systems. The HMF data is the only way the encoded files can be reassembled into a meaningful whole. The original content is retrieved by requesting its data from the cluster of Storage Systems. In each Storage System, a decoder parses the HMF data and transmits the striped data to the requestor. The decoders cooperate to dynamically detect erasures and to reconstruct the missing data.

Abstract: Roughly described, a tiered storage system has a filesystem that promotes and demotes data among tiers at block granularity. It maintains a logical-to-physical mapping which indicates for each block in a file both the assigned tier and the physical block number within the tier. Methods for performing file- and block-level manipulations are described. In an embodiment, a nominal tier is managed by a native filesystem, and higher tiers are managed by a super filesystem. The super filesystem manages promotion and demotion among the tiers, interfacing with higher tiers directly but interfacing with the nominal tier only through the native filesystem. The native filesystem defines the file namespace in the system, and the logical-to-physical block mapping for blocks in the nominal tier. The super filesystem defines the logical-to-physical mapping for blocks in the higher tiers, but retains the file identification information as defined by the native filesystem.