Abstract: Secure cloud-based storage system management that includes: establishing, within a cloud-based services provider and based on one or more user credentials, a cloud-based user session to execute one or more commands on a remote storage system that includes physical storage devices; determining one or more data storage operations corresponding to the physical storage devices to implement the one or more commands on the storage system; and extending, based on using an access token based on the one or more user credentials to securely issue the one or more data storage operations to the remote storage system, the cloud-based user session to the remote storage system.

Abstract: Tiering duplicated objects in a cloud-based object store, including: determining, for a particular data object, a number of copies of the data object to be retained; storing, in a first data tier, at least one copy of the data object; storing, in a second data tier, one or more copies of the data object, wherein a number of copies of the data object that are stored in the second data tier is equal to the number of copies of the data object to be retained minus a number of copies of the data object that are stored in the first data tier; and responsive to receiving a request for the data object, servicing the request from the first data tier.

Abstract: A method for rebuilding data when changing erase block sizes in a storage system is provided. The method includes determining one or more erase blocks to be rebuilt and allocating one or more replacement erase blocks, wherein the one or more erase blocks and the one or more replacement erase blocks have differing erase block sizes. The method includes mapping logical addresses, for the one or more erase blocks, to the one or more replacement erase blocks and rebuilding the one or more erase blocks into the one or more replacement erase blocks, in accordance with the mapping.

Abstract: A pod, the pod including the dataset, a set of managed objects and management operations, a set of access operations to modify or read the dataset, and a plurality of storage systems, where: management operations can modify or query managed objects equivalently through any of the storage systems, access operations to read or modify the dataset operate equivalently through any of the storage systems, each storage system stores a separate copy of the dataset as a proper subset of the datasets stored and advertised for use by the storage system, and operations to modify managed objects or the dataset performed and completed through any one storage system are reflected in subsequent management objects to query the pod or subsequent access operations to read the dataset.

Abstract: A storage system for synchronously replicating a dataset across hardware-based storage systems and cloud-based storage systems, the storage system including specifying a set of managed objects, a set of management operations, and a set of access operations to correspond to the dataset, where management operations can modify or query managed objects equivalently through the hardware-based storage systems and the cloud-based storage systems; access operations to read or modify the dataset operate equivalently through the hardware-based storage systems and the cloud-based storage systems; each hardware-based storage system and each cloud-based storage system stores a separate copy of the dataset as a proper subset of the datasets stored and advertised for use; and operations to modify managed objects or the dataset performed and completed through the hardware-based storage systems and the cloud-based storage systems are reflected in subsequent management objects to query the dataset or subsequent access operatio

Abstract: A method of optimized end-to-end integrity comprises receiving a request to write application data stored in a first kernel buffer to a storage device. The method further comprises determining, by a processing device, that a first cyclic redundancy check (CRC) of the application data failed. The method further comprises copying the application data to a second kernel buffer. The method further comprises performing, by the processing device, a second CRC on the application data stored in the second kernel buffer.

Abstract: A method for diagnosing memory, performed by a storage system, is provided. The method includes writing and reading through a communication channel to and from flash memory of each of a plurality of flash memory devices and a static random-access memory (SRAM) register of each of the plurality of flash memory devices. The method includes analyzing errors in read data from the reading through the communication channel, identifying types of errors among flash memory errors, SRAM register errors, and communication channel errors, based on the analyzing, and indicating at least one error and type of error from the read data.

Abstract: Maintaining data associate with a storage device is described. A method may include receiving, by an application executed by a storage array controller of a host server of a solid-state storage array comprising a plurality of solid-state storage devices, an indication of a change in state of a solid-state storage device of the plurality of solid-state storage devices. In response to receiving the indication, the method may also include retrieving a plurality of tables stored at a volatile memory of the solid-state storage device, the plurality of tables comprising information associated with characteristics of a plurality of data blocks of the solid-state storage device. The method may also include identifying one or more rules associated with the plurality of tables and creating, by the storage array controller, a new plurality of tables based on the one or more rules.

Abstract: A plurality of storage nodes within a single chassis is provided. The plurality of storage nodes is configured to communicate together as a storage cluster. The plurality of storage nodes has a non-volatile solid-state storage for user data storage. The plurality of storage nodes is configured to distribute the user data and metadata associated with the user data throughout the plurality of storage nodes, with erasure coding of the user data. The plurality of storage nodes is configured to recover from failure of two of the plurality of storage nodes by applying the erasure coding to the user data from a remainder of the plurality of storage nodes. The plurality of storage nodes is configured to detect an error and engage in an error recovery via one of a processor of one of the plurality of storage nodes, a processor of the non-volatile solid state storage, or the flash memory.

Abstract: A non-volatile solid-state storage is provided. The non-volatile solid state storage includes a non-volatile random access memory (NVRAM) addressable by a processor external to the non-volatile solid state storage. The NVRAM is configured to store user data and metadata relating to the user data. The non-volatile solid state storage includes a flash memory addressable by the processor. The flash memory is configured to store the user data responsive to the processor directing transfer of the user data from the NVRAM to the flash memory.

Abstract: A method begins by a processing module determining a priority access level of an encoded data slice stored on a memory device. The method continues by determining a memory status for the memory device, wherein the memory status includes a plurality of discrete usability levels with a highest usability level representing a maximum amount of usable memory, a second usability level representing a lower usability level than the highest usability level and a lowest usability level representing an unusable level when the usable memory is below a threshold. The method continues with the processing module determining whether to migrate the encoded data slice from the memory device based on the priority access level and the memory status. The method continues with the processing module identifying another memory device. The method continues with the processing module facilitating migration of the encoded data slice to another memory device.

Abstract: A method of using flash storage devices with different sized erase blocks is provided. The method includes allocating a plurality of erase blocks of heterogeneous erase block sizes to a RAID stripe, to form a tile pattern having the heterogeneous erase block sizes in the RAID stripe. The method includes writing the RAID stripe across the flash storage devices in accordance with the allocating, and stopping the writing the RAID stripe, responsive to contents of the RAID stripe reaching a threshold.

Abstract: A method for authorizing I/O (input/output) commands in a storage cluster is provided. The method includes generating a token responsive to an authority initiating an I/O command, wherein the token is specific to assignment of the authority and a storage node of the storage cluster. The method includes verifying the I/O command using the token, wherein the token includes a signature confirming validity of the token and wherein the token is revocable.

Abstract: A method for execution by a computing device of a storage network begins by obtaining a credential to be added to a local authentication list, where the credential authenticates, during a first time period, at least one of an access request and a requesting device, and where the local authentication list is stored in temporary memory of the computing device and is stored as a plurality of sets of encoded authentication slices in a set of storage units. The method continues by updating the local authentication list stored in the temporary memory to include a representation of the credential. The method continues by encoding the representation to produce a set of encoded authentication slices, where a decode threshold number of encoded authentication slices is needed to recover the representation. The method continues by sending the set of encoded authentication slices to the set of storage units for storage therein.

Abstract: A method of operating a storage system is provided. The method includes detecting differing amounts of storage memory on two or more of a plurality of blades of the storage system and forming a plurality of resiliency groups of blades, based on the differing amounts of storage memory, each resiliency group comprising a subset of the plurality of blades of the storage system supporting data recovery in case of failure of two of the blades of the resiliency group.

Abstract: Storage management within a cloud-based data store, including: receiving one or more data objects for storage; selecting, based at least upon a storage policy and upon one or more characteristics of storage data, one or more storage classes from among a plurality of storage classes of one or more data storage services; and storing the one or more data objects to the selected one or more storage classes of the one or more data storage services.

Abstract: A method begins with a first group of computing devices of a plurality of computing devices of a storage network receiving data objects having a first data type identifier of a plurality of data type identifiers, where the plurality of data type identifiers correspond to a plurality of data types associated with the data objects. The method continues with the first group of computing devices interpreting the data objects having the first data type identifier to sort, based on sorting criteria the data objects into a first processing category and a second processing category. The method continues with the first group of computing devices error encoding the data objects in the second processing category based on short term storage error encoding parameters to produce pluralities of sets of encoded data slices and sending the slices to storage and execution units.

Abstract: A method for proactively rebuilding user data in a plurality of storage nodes of a storage cluster in a single chassis is provided. The method includes distributing user data and metadata throughout the plurality of storage nodes such that the plurality of storage nodes can read the user data, using erasure coding, despite loss of two of the plurality of storage nodes. The method includes determining to rebuild the user data for one of the plurality of storage nodes in the absences of an error condition. The method includes rebuilding the user data for the one of the plurality of storage nodes. A plurality of storage nodes within a single chassis that can proactively rebuild the user data stored within the storage nodes is also provided.

Abstract: A method includes migrating data within an addressing set to a second storage unit of the DSN. The method further includes establishing a virtual storage unit within the DSN regarding the addressing set. While migrating the data within the addressing set, the method further includes processing, by the virtual storage unit, data access requests having a DSN address within the addressing set. When the migrating the data is complete, the method further includes sending a notification to the virtual storage unit that the migration is complete. The method further includes coordinating, between the virtual storage unit and the second storage unit, an update of the second storage unit regarding the data access requests processed by the virtual storage unit.

Abstract: Systems, methods, and computer readable storage mediums for generating an alert on a failure of a storage subsystem to phone home to the cloud in a replication environment. A dataset is replicated from a first storage subsystem to a second storage subsystem. The first and second storage subsystems also phone home log data to the cloud on a periodic basis. In response to detecting a failure of the first storage subsystem to phone home, the cloud generates and sends an alert to the second storage subsystem. In response to receiving this alert, the second storage subsystem starts disaster recovery operations for the dataset.