Abstract: Provided are a computer program product, system, and method for determining a storage pool in which to store a data object. Event messages are received. Each event message includes metadata on an object updated in a storage pool of a plurality of storage pools, at least two of the storage pools have different reliability ratings. The event messages are added to a message queue. Information is added to a database for the event messages in the message queue including the metadata in the event message. A determination is made of a data classification of a changed data object indicated in the database. The changed data object indicated in the database having the determined data classification is moved to a storage pool having a reliability rating satisfying a reliability rating associated with the data classification of the changed data object.

Abstract: Various embodiments are provided for identifying matching tape volumes for data deduplication in an automated data storage library by a processor. N most similar tape volumes in a tape library may be matched according to a data indication provided in each volume header of the N most similar tape volumes for performing a data deduplication operation on a reduced block of compressed data between the N most similar tape volumes, wherein N is a positive integer.

Abstract: Various embodiments for managing data in a data deduplication repository in a computing storage environment, by a processor device, are provided. In one embodiment, a method comprises issuing an application programming interface (API) command to scan metadata of a subset of entities in a local deduplication repository for identifying candidate data to offload from the local deduplication repository to an object storage, offloading the candidate data to the object storage, and returning a status result using the API command.

Abstract: Various embodiments for managing data in a data deduplication repository in a computing storage environment, by a processor device, are provided. In one embodiment, a method comprises migrating certain deduplication repository data from a host to an object storage by integrating a data offload process with an existing backup management application, for reducing unnecessary deduplication repository data stored on the host.

Abstract: For offloading data to secondary storage, a criteria module checks a migration criteria of a data segment stored in a first data repository. The data segment may be associated with one or more entities. A threshold module determines whether the migration criteria of the data segment satisfies a migration threshold. A migration module migrates the data segment to a second data repository in response to the migration criteria of the data segment satisfying the migration threshold.

Abstract: In a hash-based multi-tenancy in a deduplication system, incorporating, as if part of input data, a tenant identification (ID) into a hash value calculation using a single hash based index table for separating data segments in a multi-tenant deduplication system.

Abstract: A computer-implemented method according to an aspect includes determining a sensitivity level for an instance of data, comparing the sensitivity level to one or more policies, and conditionally performing a backup of the instance of data, based on the comparing.

Abstract: A computer-implemented method according to an aspect includes training a cognitive network, utilizing metadata associated with historic data threats, inputting metadata associated with a current data threat into the trained cognitive network, identifying, by the trained cognitive network, one or more stored instances of data determined to be vulnerable to the current data threat, and adjusting one or more security aspects of the one or more stored instances of data determined to be vulnerable to the current data threat.

Abstract: A computer-implemented method, according to one embodiment, includes: determining whether an error has occurred for each block of storage space in memory by sequentially evaluating each of the blocks of storage space. In response to determining that an error has occurred for a given block, the given block is scanned for an identifier at an end of data stored in the given block, and a trailer appended to the identifier is located. Metadata included in the trailer is further used to identify each additional block which corresponds to a same file as the given block, and a data scrubbing procedure is performed on the given block and each of the additional identified blocks. A result of the scrubbing procedure is also output in response to detecting an error in the given block and/or the additional identified blocks.

Abstract: A computer-implemented method, according to one embodiment, includes: receiving an access request for data in a first block of storage space in memory, and returning the data in the first block of storage space in response to the access request. An identifier at an end of the data in the first block of storage space is also located, and pointers included in a trailer appended to the identifier are used to identify additional blocks of storage space which include data having temporal locality with the data in the first block of storage space. The data in each of the identified additional blocks of storage space is further prepared for use.

Abstract: A method, executed by a computer, includes writing, to a storage device, a first instance of a data sequence and a corresponding first reference count, in response to determining that a subsequent data sequence is identical to the first instance of the data sequence, writing, to the storage device, a metadata reference referencing the subsequent data sequence and incrementing the first reference count, and writing, to a storage device, a second instance of the data sequence and a corresponding second reference count in response to determining that the first reference count is equal to a selected threshold. A computer system and computer program product corresponding to the above method are also disclosed herein.

Abstract: Provided are a computer program product, method, and system for determining data to redact in an object. Event messages for objects are received. Each event message includes at least one facet, each facet for an instance of data in an object resulting from deep data inspection of the object that is used to determine whether the instance of data should be redacted. The event messages are added to a message queue. Information is added to a database for each of the event messages include the at least one facet for an object in the event message. The database is queried to determine an object having a facet for an instance of data that indicates the instance of data is to be redacted. The instance of data is redacted in the determined object having the facet that indicates the instance of data is to be redacted data.

Abstract: Provided are a computer program product, method, and system for determining data to redact in an object. Event messages for objects are received. Each event message includes at least one facet, each facet for an instance of data in an object resulting from deep data inspection of the object that is used to determine whether the instance of data should be redacted. The event messages are added to a message queue. A determination is made of an event message in the message queue for an object having a facet for an instance of data that indicates the instance of data is to be redacted. Redaction is performed on the instance of data in the object in the determined event message having the facet indicating the instance of data is to be redacted data.

Abstract: For maintaining a context stack, a processor monitors a stack size for a stack of a plurality of existing contexts that are not associated to a process of a plurality of processes. Each context is associable and reusable with a plurality of processes and includes a pathway to a data set when not associated to any process of the plurality of processes. The pathway includes a logical volume identifier for the data set, a logical address of the data set within the logical volume, and a logical address of an intervening device. The context defines communications between the process and the data set through the pathway when associated to the process, and each context is returned to the stack when not associated to the process.

Abstract: Provided are a computer program product, system, and method for determining a storage pool in which to store a data object. Event messages are received. Each event message includes metadata on an object updated in a storage pool of a plurality of storage pools, at least two of the storage pools have different reliability ratings. The event messages are added to a message queue. Information is added to a database for the event messages in the message queue including the metadata in the event message. A determination is made of a data classification of a changed data object indicated in the database. The changed data object indicated in the database having the determined data classification is moved to a storage pool having a reliability rating satisfying a reliability rating associated with the data classification of the changed data object.

Abstract: Provided are a computer program product, system, and method for determining a storage pool in which to store a data object. Event messages are received. Each event message includes metadata on an object updated in a storage pool of a plurality of storage pools, at least two of the storage pools have different reliability ratings. The event messages are added to a message queue. A determination is made of a data classification of a changed data object indicated in an event message in the message queue. The changed data object is moved to a storage pool having a reliability rating satisfying a reliability rating associated with the data classification of the changed data object.

Abstract: Embodiments for optimized deduplicated object storage system by one or more processors. An uncompressed and non-deduplicated copy of an object may be stored on a node in a distributed object storage system and one or more compressed and deduplicated copies of the uncompressed and non-deduplicated copy of the object may be distributed on one or more alternative nodes in the distributed object storage system.

Abstract: A computer-implemented method, according to one embodiment, includes: receiving an access request for data in a first block of storage space in memory, and returning the data in the first block of storage space in response to the access request. An identifier at an end of the data in the first block of storage space is also located, and pointers included in a trailer appended to the identifier are used to identify additional blocks of storage space which include data having temporal locality with the data in the first block of storage space. The data in each of the identified additional blocks of storage space is further prepared for use.

Abstract: A computer-implemented method, according to one embodiment, includes: determining whether an error has occurred for each block of storage space in memory by sequentially evaluating each of the blocks of storage space. In response to determining that an error has occurred for a given block, the given block is scanned for an identifier at an end of data stored in the given block, and a trailer appended to the identifier is located. Metadata included in the trailer is further used to identify each additional block which corresponds to a same file as the given block, and a data scrubbing procedure is performed on the given block and each of the additional identified blocks. A result of the scrubbing procedure is also output in response to detecting an error in the given block and/or the additional identified blocks.

Abstract: Provided are a computer program product, system, and method for backing up data from a plurality of source data sets to a backup storage. Event messages are received. Each event message indicates an update to a changed data object in one of the source data sets. The event messages are added to at least one message queue. The event messages are read in the at least one message queue. A record is added to a database for each of the read event messages. Records added to the database include information on changed data objects. The database is queried to determine records for changed data objects that satisfy a backup criteria. The changed data objects in at least one of the source data sets that satisfy the backup criteria are copied to the backup storage.