Abstract: A file storage system may be implemented by coordinating non-exhaustible and exhaustible storage devices. The exhaustible storage devices may be lower grade flash based storage devices. The non-exhaustible storage devices may be storage devices based on magnetic recording mechanisms or higher grade flash storage. The file storage system may store received content items on the exhaustible storage devices. The file storage system may additionally store metadata for the content items and/or the file storage system on the non-exhaustible storage devices. During operation, the file storage system may globally optimize the content items on the exhaustible storage devices such that more heavily accessed items are moved to exhaustible storage devices that have experienced relatively few data operations. The file storage system can move less frequently accessed content items to exhaustible storage devices that have experienced a relatively large number of data operations.

Abstract: A file storage system may be implemented by coordinating non-exhaustible and exhaustible storage devices. The exhaustible storage devices may be lower grade flash based storage devices. The non-exhaustible storage devices may be storage devices based on magnetic recording mechanisms or higher grade flash storage. The file storage system may store received content items on the exhaustible storage devices. The file storage system may additionally store metadata for the content items and/or the file storage system on the non-exhaustible storage devices. During operation, the file storage system may globally optimize the content items on the exhaustible storage devices such that more heavily accessed items are moved to exhaustible storage devices that have experienced relatively few data operations. The file storage system can move less frequently accessed content items to exhaustible storage devices that have experienced a relatively large number of data operations.

Abstract: A file storage system is implemented by coordinating non-exhaustible and exhaustible storage devices. The exhaustible storage devices include lower grade flash based storage devices. The non-exhaustible storage devices are based on magnetic recording mechanisms or higher grade flash storage. The file storage system stores received content items on the exhaustible storage devices, and stores metadata for the content items and/or the file storage system on the non-exhaustible storage devices. During operation, the file storage system globally optimizes the content items on the exhaustible storage devices such that more heavily accessed items are moved to exhaustible storage devices that have experienced relatively few data operations. The file storage system moves less frequently accessed content items to exhaustible storage devices that have experienced a relatively large number of data operations. As such, the operation lifetime of the exhaustible storage devices as a whole can be prolonged.

Abstract: Fault-tolerant storage is provided using a distributed data storage system that receives input data from clients and divides that data into data blocks for storage. The data blocks are processed using a coding scheme that generates redundant level one error correction blocks (L1EC Blocks). The L1EC blocks enable the reconstruction of one or more damaged or inaccessible data blocks, and the L1EC blocks and the data blocks are divided into distribution sets and stored at a plurality of data storage locations. At each data storage location additional level two error correction blocks (L2EC blocks) are generated that provide local data redundancy. Upon detecting a data disruption event, an inaccessible data storage location is identified and the elements that were stored at the inaccessible data storage location are reconstructed.

Abstract: A file storage system may be implemented by coordinating non-exhaustible and exhaustible storage devices. The exhaustible storage devices may be lower grade flash based storage devices. The non-exhaustible storage devices may be storage devices based on magnetic recording mechanisms or higher grade flash storage. The file storage system may store received content items on the exhaustible storage devices. The file storage system may additionally store metadata for the content items and/or the file storage system on the non-exhaustible storage devices. During operation, the file storage system may globally optimize the content items on the exhaustible storage devices such that more heavily accessed items are moved to exhaustible storage devices that have experienced relatively few data operations. The file storage system can move less frequently accessed content items to exhaustible storage devices that have experienced a relatively large number of data operations.

Abstract: Fault-tolerant storage is provided using a distributed data storage system that receives input data from clients and divides that data into data blocks for storage. The data blocks are processed using a coding scheme that generates redundant level one error correction blocks (L1EC Blocks). The L1EC blocks enable the reconstruction of one or more damaged or inaccessible data blocks, and the L1EC blocks and the data blocks are divided into distribution sets and stored at a plurality of data storage locations. At each data storage location additional level two error correction blocks (L2EC blocks) are generated that provide local data redundancy. Upon detecting a data disruption event, an inaccessible data storage location is identified and the elements that were stored at the inaccessible data storage location are reconstructed.

Abstract: Fault-tolerant storage is provided using a distributed data storage system that receives input data from clients and divides that data into data blocks for storage. The data blocks are processed using a coding scheme that generates redundant level one error correction blocks (L1EC Blocks). The L1EC blocks enable the reconstruction of one or more damaged or inaccessible data blocks, so long as sufficient undamaged elements are still accessible. The L1EC blocks and the data blocks are divided into distribution sets and these sets are stored at a plurality of data storage locations. At each data storage location additional level two error correction blocks (L2EC blocks) are generated that provide local data redundancy. The L2EC blocks enable reconstruction of damaged elements at a data storage location without requiring communication with the other data storage locations.

Abstract: Fault-tolerant storage is provided using a distributed data storage system that receives input data from clients and divides that data into data blocks for storage. The data blocks are processed using a coding scheme that generates redundant level one error correction blocks (L1EC Blocks). The L1EC blocks enable the reconstruction of one or more damaged or inaccessible data blocks, so long as sufficient undamaged elements are still accessible. The L1EC blocks and the data blocks are divided into distribution sets and these sets are stored at a plurality of data storage locations. At each data storage location additional level two error correction blocks (L2EC blocks) are generated that provide local data redundancy. The L2EC blocks enable reconstruction of damaged elements at a data storage location without requiring communication with the other data storage locations.