Abstract: To effectively implement ILM policies and account for unreliability in a geographically distributed large-scale storage system, “scanners” and “ILM rules appliers” can be deployed on nodes throughout the storage system for large scale ILM implementation. Each scanner is programmed to deterministically self-assign a region of object namespace and scan that region of object namespace. To “scan” a region, a scanner accesses metadata of each object that has an identifier within the scanner's region and inserts the object metadata into one of a set of queues for ILM evaluation. An ILM rules applier dequeues object metadata for evaluation against ILM rules and determines whether an ILM task is to be performed for ILM rule compliance.

Abstract: To effectively implement ILM policies and account for unreliability in a geographically distributed large-scale storage system, “scanners” and “ILM rules appliers” can be deployed on nodes throughout the storage system for large scale ILM implementation. Each scanner is programmed to deterministically self-assign a region of object namespace and scan that region of object namespace. To “scan” a region, a scanner accesses metadata of each object that has an identifier within the scanner's region and inserts the object metadata into one of a set of queues for ILM evaluation. An ILM rules applier dequeues object metadata for evaluation against ILM rules and determines whether an ILM task is to be performed for ILM rule compliance.

Abstract: Technology is disclosed for enabling storage service compatibility. The technology can enable sorting of data stored across partitions, and provide for key splitting, e.g., to respond to data updates and additions.

Abstract: Technology is disclosed for enabling storage service compatibility. The technology can enable sorting of data stored across partitions, and provide for key splitting, e.g., to respond to data updates and additions.

Abstract: Technology is disclosed for maintaining consistency between data and metadata of an object storage system. The object storage system stores a single copy of the data object in the object storage system and creates metadata associated with the data object in a metadata database of the object storage system. The metadata can include a copy number of the data object. The object storage system receives a signal indicating that no copy of the data object can be found or accessed. In response to the signal, the object storage system determines that the copy number of the data objects indicates that there is only one copy of the data object stored in the object storage system.

Abstract: Technology is disclosed for enabling storage service compatibility. The technology. The technology receive a set of data storage events; process and resolve the received data storage events according to an application-specific logic; and return a result set of events after the processing and resolving, wherein the result set of events is a different set of data storage events that is based on the received set of data storage events.