Abstract: Apparatus and methods for use in coordinating distributed computing networks such as distributed storage networks. In an embodiment, a coordination unit establishes connections with managing units of the distributed computing networks. For example, the managing units can initiate the connections via connection messages. The coordination unit further transmits coordination messages to the managing units. The coordination messages can include update information and requests specifying information gathering tasks to be executed by the distributed computing networks. In an example, the coordination unit receives a response to a first coordination message from a first managing unit. The coordination unit transmits a second coordination message to a second managing unit, wherein the second coordination message includes information related to the information gathered by the first distributed computing network in response to the first coordination message.

Abstract: A method includes receiving a request to write a data block to a volume resident on a multi-tenant storage array, wherein the request is associated with a first tenant of the multi-tenant storage array, and determining whether the data block matches an existing data block on the multi-tenant storage array, wherein the existing block corresponds to a second tenant. In response to determining that the decrypted data block matches the existing data block: encrypting the existing data block with a shared volume encryption key; encrypting the shared volume encryption key with a first tenant encryption key and providing the shared volume encryption key encrypted with the first tenant encryption key to the first tenant; and encrypting the shared volume encryption key with a second tenant encryption key and providing the shared volume encryption key encrypted with the second tenant encryption key to the second tenant.

Abstract: Providing Quality of Service (QoS) for replicating datasets including: receiving, by a target data repository from a source data repository, a checkpoint describing one or more updates to one or more datasets stored in the source data repository and the target data repository; adding, by the target data repository, the checkpoint to a first queue for checkpoints directed to one or more volumes in the target data repository, wherein the first queue is included in a plurality of queues for the target data repository; selecting, by the target data repository, one or more queues from the plurality of queues; and servicing an operation from each of the selected one or more queues.

Abstract: An example computer-implemented method of controlling access to a storage system includes using, in response to a request to access a resource of the storage system during a transitional state associated with a transition of the storage system to use a security protocol to control access to the storage system, a guest role to control access to the resource of the storage system when the request does not include a token identifier

Abstract: A method of using boot-time metadata in a storage system is provided. The method includes writing a fragmentation stride to a solid-state storage device of the storage system, the fragmentation stride defining a granularity on which fragmentation of erase blocks of the solid-state storage device occurs. The method includes allocating portions of erase blocks for at least one process in the storage system, in accordance with the fragmentation stride and writing boot up metadata at offsets that are based on the fragmentation stride, in the solid-state storage device.

Abstract: Leveraging distinct storage tiers in a virtual storage system, including: receiving a request to write data to the virtual storage system; selecting, from amongst a plurality of tiers in the virtual storage system, a tier for receiving the data, wherein the plurality of tiers include a write-mostly tier and at least one other tier; and storing, within the selected tier within the virtual storage system, the data.

Abstract: A method for efficiently supporting deletion in a probabilistic data structure, and related computing or storage system are described. A processor, computing system or storage system constructs a table and a summary table for determining whether there is an entry for a value in the table. The summary table has buckets pointed to by address fields of values. Each bucket has a prefix table, a transit table, signature table and a first indicator. The system tracks deletion and addition of items of the table and summary table through the first indicators.

Abstract: Examining a cloud-based storage system using codified states includes generating an enumeration of a plurality of resources of the cloud-based storage system; comparing the enumeration to a codified state for the cloud-based storage system; and identifying, based on the comparison, a difference between the enumeration and the codified state.

Abstract: Methods and systems for transitioning a replica of a file system are described. An illustrative method includes updating a replica file system on a target data repository to be a replica of a source file system as the source file system existed on the source data repository at a point in time, where the replica file system is constructed of block objects at the target data repository that store metadata for individual files and directories of the replica file system and support access to blocks of data associated with the files and directories of the target file system at the target data repository, and where the updating includes updating the block objects of the replica file system to be replicas of block objects of the source file system as the block objects of the source file system existed on the source data repository at the point in time.

Abstract: Storage bandwidth for a storage system process is adjusted responsive to an input output (I/O) write request to write data to a zoned storage device. The storage bandwidth is adjusted by calculating an allocation share for the storage system process requesting to write the data and opening a new zone for the storage system process upon determining that an open zone usage by the storage system process is under the allocation share for the storage system process.

Abstract: A method for execution by one or more computing devices of a storage network includes determining a threshold number of favorably performing storage units of a set of storage units will be available during a time period for testing a storage unit of the set of storage units that is not apart of the threshold number of favorably performing storage units. The method further includes initiating the testing of the storage unit. The method further includes generating a testing report regarding the testing of the storage unit.

Abstract: A method includes compressing data to generate compressed data having a first block size corresponding to a block-size requirement of a client device. The method further includes encrypting the compressed data to generate an encrypted data packet. The method further includes adding, by a processing device, a padding bit pattern to the encrypted data packet to generate a data block for storage, the data block having a second block size determined by a buffer size of a storage array.

Abstract: A method includes obtaining audit records. Each of the audit records indicates a timestamp for a corresponding message, at least one event type code selected from a plurality of event type codes for a corresponding audit event of the corresponding message, and an identifier for a corresponding system entity associated with creation of the corresponding message. A number of audit records are aggregated over a period of time. An audit file is generated to include the number of audit records and integrity information. Storage of the audit file is facilitated by utilizing a name of the audit file.

Abstract: Data resiliency in a cloud-based storage system, including: receiving, for storage within a first tier of cloud storage of the cloud-based storage system, one or more segments of data; generating, for each of one or more shards of data of the one or more segments of data, self-describing information for recoverability of the one or more shards of data; and storing, within a second tier of cloud storage of the cloud-based storage system, both the one or more shards of data and the generated self-describing information for recoverability of the one or more shards of data.

Abstract: A storage system forms an allocation unit for writing into solid-state storage memory. The allocation unit is formed from at least a portion of a first erase block and a first sub block of a partitioned second erase block. The system forms multiple subsequent allocation units. Each subsequent allocation unit is formed from a remaining second sub block of a partitioned erase block and at least a portion of a next erase block. Forming the subsequent allocation units consumes each of multiple erase blocks in a cascading sequence. The system allocates the allocation unit and the subsequent allocation units for writing in the storage system.

Abstract: A method includes determining an information dispersal algorithm width number and determining a number of primary storage slots from a number of storage slots associated with a set of storage units deployed across multiple sites, where the number of primary storage slots is equal to or greater than the information dispersal algorithm width number. The method further includes determining a mapping of primary storage slots to storage units. The method further includes sending configuration information to the set of storage units that includes the mapping. The method further includes storing a set of encoded data slices in the primary storage slots in accordance with the configuration information, where a data segment is error encoded into the set of encoded data slices in accordance with the information dispersal algorithm width number and a decode threshold number, which is a number of encoded data slices are needed to reconstruct the data segment.

Abstract: Preserving identities and policies across replication, including: receiving, at a first storage array, a first data frame comprising data associated a dataset stored at the first storage array and an identifier of a quality of service level associated with the first data frame; generating, at the first storage array, a second data frame comprising a portion of the dataset and the identifier of the quality of service level associated with the first data frame; and transmitting the second data frame to a second storage array.

Abstract: A method for execution by a storage network begins by creating a plurality of vaults in memory addressable by the storage network, where a vault is a virtual memory block associated with a portion of storage network memory, and then determining dispersed storage error encoding parameters for each vault. The method then continues by creating a plurality of vault regions within each vault, wherein a vault region is configured to store a data type of a plurality of data types, where at least one data type of the plurality of data types is associated with a unique access restriction.

Abstract: Restoring a cloud-based storage system to a selected state, including: generating, over a period of time, one or more snapshot states of a cloud-based storage system, wherein each of the one or more snapshot states describes a respective configuration of the cloud-based storage system at a respective point in time within the period of time; providing, to a computing process, one or more selectable states corresponding to the one or more snapshot states of the cloud-based storage system; and transitioning, in response to a selection of a particular snapshot state from among the one or more snapshot states, the configuration of the cloud-based storage system from a current state to the particular snapshot state.

Abstract: In some embodiments, storage path routing in a container system includes: determining, within the container system, a storage operation directed to a storage resource; determining one or more conditions associated with a plurality of network paths to the storage resource, where the plurality of network paths includes a first network path through a storage area network and a second network path through a container system communication network; and routing, based on the one or more conditions, the storage operation to the storage resource using the first network path.