Abstract: Various implementations disclosed herein provide fault-tolerant enterprise object storage system that can store small objects. In various implementations, the fault-tolerant enterprise object storage system writes a small object into an aggregate object that is distributed across a plurality of storage entities. In some implementations, the small object is at least an order of magnitude smaller than the aggregate object, and the small object is within the same order of magnitude of a block unit addressable within each of the storage entities. In some implementations, based on the small object, the storage system updates the parity data associated with the aggregate object in response to writing the small object into the aggregate object. In various implementations, the storage system updates a processed data end offset indicator that indicates that the parity data for the aggregate object includes valid data up to and including the small object.

Abstract: Various implementations disclosed herein enable reading of an erasure-coded file striped across one or more storage entities of an enterprise object storage system. For example, in various implementations, a method of reading an erasure-coded file is performed by an ingest entity of a storage system that includes a cluster of storage entities. The ingest entity includes a non-transitory computer readable storage medium, and one or more processors. In various implementations, the method includes querying the storage entities of the cluster to determine where data segments of an erasure-coded file are located within the cluster. In various implementations, the method includes generating a mapping of the data segments across the storage entities. The mapping indicates a sequence for the data segments within the erasure-coded file. In various implementations, the method includes scheduling read requests for the data segments based on the sequence. The scheduling satisfies a storage utilization threshold.

Abstract: Various implementations disclosed herein provide fault-tolerant enterprise object storage system that can store small objects. In various implementations, the fault-tolerant enterprise object storage system writes a small object into an aggregate object that is distributed across a plurality of storage entities. In some implementations, the small object is at least an order of magnitude smaller than the aggregate object, and the small object is within the same order of magnitude of a block unit addressable within each of the storage entities. In some implementations, based on the small object, the storage system updates the parity data associated with the aggregate object in response to writing the small object into the aggregate object. In various implementations, the storage system updates a processed data end offset indicator that indicates that the parity data for the aggregate object includes valid data up to and including the small object.

Abstract: Various implementations disclosed herein enable reading of an erasure-coded file striped across one or more storage entities of an enterprise object storage system. For example, in various implementations, a method of reading an erasure-coded file is performed by an ingest entity of a storage system that includes a cluster of storage entities. The ingest entity includes a non-transitory computer readable storage medium, and one or more processors. In various implementations, the method includes querying the storage entities of the cluster to determine where data segments of an erasure-coded file are located within the cluster. In various implementations, the method includes generating a mapping of the data segments across the storage entities. The mapping indicates a sequence for the data segments within the erasure-coded file. In various implementations, the method includes scheduling read requests for the data segments based on the sequence. The scheduling satisfies a storage utilization threshold.