Abstract: Method and system are provided for recycling container storage objects at a storage controller. The method includes receiving a create operation of a new container by an orchestrator, including information indicating a purpose of the container, and associating a label with the new container, with the label indicating the orchestrator-defined information. The method includes checking labels of soft-deleted container objects for a suitable match with the label of the new container, where soft-deleted container objects are logical objects for deleted containers that are maintained for recycling. The method includes recycling metadata of a matched soft-deleted container object for the new container. The method includes checking received input/output operations for the new container against already stored data of the matched soft-deleted container to recycle data and skip writes where they match.

Abstract: A computer-implemented method for detecting data storage errors includes storing first data in a first block corresponding to a first virtual volume, storing second data in a second block corresponding to a second virtual volume, generating parity information for the first data and the second data, and storing the parity information in non-volatile memory at a location corresponding to the logical block address to produce stored parity information. A system and computer program product corresponding to the above method are also disclosed herein.

Abstract: A method, system, and computer program product for managing a storage system, comprising: analyzing an access request for a first storage block of the set of storage blocks; in response to the access request comprising a read request: in response to the first storage block residing in the cache: processing the read request from the cache; promoting the first storage block within the cache; and destaging the first storage block to the storage device with the first compression ratio; and in response to the first storage block not residing in the cache: processing the read request from the storage device; and copying the first storage block to the cache; in response to the access request comprising a write request: writing the first storage block to the cache; and destaging the first storage block to the storage device using the first compression ratio.

Abstract: A method, system, computer program product and computer program for managing a storage system, the storage system comprising a first storage device, a second storage device, a source storage device, a target storage device, and a cache, the method comprising: receiving a first host access request for a data block on the first storage device; receiving a mapping between the source storage device and the target storage device; and in response to the first host access request and the mapping: accessing a corresponding data block on the second storage device; and updating metadata for the cache.

Abstract: A system for managing a storage array in a storage system may include an analysis component for analyzing a set of compression ratios used for a set of storage blocks written on a first storage device and a second storage device to determine a pattern. The system may include a determination component for determining, responsive to the pattern, a first compression ratio and a second compression ratio; the first compression ratio may be different from the second compression ratio. The system may include a data read/write component for writing a storage block to the first storage device with the first compression ratio and writing the storage block to the second storage device with the second compression ratio.

Abstract: Aspects of the present invention disclose a method, computer program product, and system for stale data recovery using virtual storage metadata. The method includes one or more processors generating a primary virtual storage metadata structure having virtual address areas for a data chunk. Each area includes a plurality of most recent updates of metadata for the data chunk. The metadata of each update includes a sequence number for the update and a pointer to the physical location of the data. The method further includes one or more processors generating an overflow virtual storage metadata structure for multiple virtual address areas. The overflow metadata structure includes updates that have overflowed from the virtual address areas. In addition, wherein an oldest update in a full virtual address area of the primary virtual storage metadata structure includes a link to an overflow location.

Abstract: According to an aspect, a computer-implemented method includes receiving a request to evaluate an update to a computing system and obtaining a current configuration of the computing system. Aspects also include identifying one or more changes that the update will require to the current configuration and obtaining performance data corresponding to the one or more changes from a data repository. Aspects further include calculating a confidence score for the update based on the performance data and providing the computing system with the confidence score.

Abstract: Described are techniques for managing data locations of derived storage objects. The techniques include accessing a primary metadata tree providing a lookup path using a virtual address to locate data for a primary object in physical storage pointed to by a leaf node of the primary metadata tree and providing a sub-tree from a leaf node of the primary metadata tree associated with the primary object, the sub-tree providing lookup paths using virtual addresses for derived objects. Wherein a derived object is a view of the primary object at a specific point in time, with copy leaf nodes of the sub-tree pointing to stored data of the derived objects. The techniques further include maintaining an ancestry graph associated with the sub-tree with the ancestry graph linking derived object identifiers to provide an ancestral chain lookup to identify derived object identifiers of the closest stored physical data of a derived object.

Abstract: A method, computer system, and a computer program product for storing a write data in a storage system that operates using a log-structured filing system is provided. The present invention may include compressing a write data. The present invention may also include identifying a region of a storage system based on a first size of the compressed write data. The present invention may further include the storage system operating using a log-structured filing system. The present invention may also include a different region of the storage system having a different compression ratio. The present invention may further include writing the compressed write data in the identified region of the storage system.

Abstract: Described are techniques for managing data locations of derived storage objects. The techniques include accessing a primary metadata tree providing a lookup path using a virtual address to locate data for a primary object in physical storage pointed to by a leaf node of the primary metadata tree and providing a sub-tree from a leaf node of the primary metadata tree associated with the primary object, the sub-tree providing lookup paths using virtual addresses for derived objects. Wherein a derived object is a view of the primary object at a specific point in time, with copy leaf nodes of the sub-tree pointing to stored data of the derived objects. The techniques further include maintaining an ancestry graph associated with the sub-tree with the ancestry graph linking derived object identifiers to provide an ancestral chain lookup to identify derived object identifiers of the closest stored physical data of a derived object.

Abstract: Disclosed are techniques for defragmentation in deduplication storage systems. Machine language determines using deduplication metadata that at least some of an incoming input/output stream is a duplicate of at least part of a source volume whose physical locations of its stored data are fragmented in backend storage. Subsequently, defragmentation is carried out on the stored data by using the incoming input/output stream to write the data into sequential chunks at new physical locations in the backend storage and updating the source volume location mappings to the new physical locations.

Abstract: Method and system are provided for storage allocation enhancement of microservices. A method carried out at a microservice orchestrator, includes: categorizing a microservice container, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations; and providing the categorization in association with the microservice container input/output operations to a storage system for use in storage allocation of the input/output operations. A method at a storage controller includes: receiving microservice container input/output operations with an associated categorization, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations; and using the associated categorization for optimizing storage allocation for the input/output operations and/or optimizing garbage collection performance.

Abstract: A cache storage system indexing method is provided that indexes a data address in a cache storage system based on a data fingerprint of the cached data, wherein the data fingerprint is generated by a deduplication fingerprint function used for referencing deduplication of data in the cache storage system. A computer-implemented method of data operations to a cache storage system is also provided including: obtaining a data fingerprint for the data of the data operation, either by applying a deduplication fingerprinting function to data of a write operation or by accessing deduplication metadata for a read operation to obtain the data fingerprint generated by using a deduplication fingerprinting function used for deduplication of data in the cache storage system; and using an indexing service to the cache storage system having an address schema based on the data fingerprints of the data.

Abstract: Disclosed are techniques for defragmentation in deduplication storage systems. Machine language determines using deduplication metadata that at least some of an incoming input/output stream is a duplicate of at least part of a source volume whose physical locations of its stored data are fragmented in backend storage. Subsequently, defragmentation is carried out on the stored data by using the incoming input/output stream to write the data into sequential chunks at new physical locations in the backend storage and updating the source volume location mappings to the new physical locations.

Abstract: Method and system are provided for recycling container storage objects at a storage controller. The method includes receiving a create operation of a new container by an orchestrator, including information indicating a purpose of the container, and associating a label with the new container, with the label indicating the orchestrator-defined information. The method includes checking labels of soft-deleted container objects for a suitable match with the label of the new container, where soft-deleted container objects are logical objects for deleted containers that are maintained for recycling. The method includes recycling metadata of a matched soft-deleted container object for the new container. The method includes checking received input/output operations for the new container against already stored data of the matched soft-deleted container to recycle data and skip writes where they match.

Abstract: A set of read operations and a set of write operations for a set of drives in a storage system during a first time window is monitored. A write intensity of a first drive in the set is calculated based on the monitoring. The first drive is classified as a candidate for power reduction based on the write intensity. A write-intensive extent is identified on the first drive based on the monitoring. The write extensive extent is migrated to a second drive in the set of drives, and power to the first drive is reduced.

Abstract: Method and system are provided for storage allocation enhancement of microservices. A method carried out at a microservice orchestrator, includes: identifying distinct phases of a run of a microservice container; categorizing the phases of a run of a microservice container, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations in the phase of the microservice container; and providing the categorization in association with the microservice container input/output operations in the phase to a storage system for use in storage allocation of the input/output operations.

Abstract: A data storage system configured to deduplicate and store sets of data is presented. The system comprises a computer readable storage device configured to store a plurality of sets of data for a plurality of hosts, wherein each sets of data of the plurality of sets of data corresponding to each host of the plurality of hosts is encrypted with one or more different encryption keys, and wherein at least one of the plurality of sets of data contains deduplicated data. The system also comprises a key translator configured to create at least one translation key based, at least in part, on the one or more different encryption keys and the deduplicated data, and wherein the at least one translation key is configured to translate from a first encryption key to a second encryption key of the one or more different encryption keys.

Abstract: A cache storage system indexing method is provided that indexes a data address in a cache storage system based on a data fingerprint of the cached data, wherein the data fingerprint is generated by a deduplication fingerprint function used for referencing deduplication of data in the cache storage system. A computer-implemented method of data operations to a cache storage system is also provided including: obtaining a data fingerprint for the data of the data operation, either by applying a deduplication fingerprinting function to data of a write operation or by accessing deduplication metadata for a read operation to obtain the data fingerprint generated by using a deduplication fingerprinting function used for deduplication of data in the cache storage system; and using an indexing service to the cache storage system having an address schema based on the data fingerprints of the data.

Abstract: An apparatus for dynamically adjusting a journal snapshot window is disclosed. A computer-implemented method and computer program product also perform the functions of the apparatus. According to an embodiment of the present invention, a failure detection module detects a potential failure of at least a portion of a non-volatile storage device. The non-volatile storage device includes a journal for tracking metadata changes for data that is stored on the non-volatile storage device prior to committing the metadata changes to metadata for the non-volatile storage device. A notification receiving module receives an indication of the potential failure of the non-volatile storage device. A snapshot module adjusts a snapshot window for the journal in response to the indication of the potential failure. The snapshot window includes a set of metadata changes in the journal that have not been committed to the metadata of the non-volatile storage device.