Abstract: A copy procedure detects qualified data objects in a body of source data, and copies the source data to a target storage unit except for unqualified data objects, which are replaced with a prescribed bit pattern. Following completion of the backup, a record is prepared indicating that all data objects exist in the specified target storage, regardless of whether each data object was replaced with a predetermined bit pattern rather than being physically written to the specified target storage. This process may, be repeated in order to perform data reclamation, effectively removing user files no longer qualifying for backup.

Abstract: A copy procedure detects qualified data objects in a body of source data, and copies the source data to a target storage unit except for unqualified data objects, which are replaced with a prescribed bit pattern. Following completion of the backup, a record is prepared indicating that all data objects exist in the specified target storage, regardless of whether each data object was replaced with a predetermined bit pattern rather than being physically written to the specified target storage. This process may, be repeated in order to perform data reclamation, effectively removing user files no longer qualifying for backup.

Abstract: An apparatus, system, and method are disclosed for policy-based secure destruction of data. The method for policy-based secure destruction of data is provided. In one embodiment, the method includes storing a data destruction policy, wherein the data destruction policy defines at least one predetermined data destruction parameter. The method may also include referencing the data destruction policy to obtain the data destruction parameters in response to a predetermined data operation. In a further embodiment, the method may include executing a data destruction process in accordance with the data destruction parameters.

Abstract: Sequential media reclamation is usually performed after portions of a sequential access volume's data are no longer needed and the unused portion of the volume exceeds a threshold. Improved sequential media reclamation is provided by using a sequential access disk volume (for example, a volume of a virtual tape library (VTL)) embodied as a sparse file. Reclamation of objects stored in the volume is accomplished by nulling out regions of the sparse file that contain the objects that are no longer needed. A replication method is also provided in which information about the objects stored in the sparse file (such as offset and length) is used during replication to enable the correct portions of a target volume (embodied as a sparse file) to be nulled out to match a source volume (also embodied as a sparse file).

Abstract: Provided are a computer program product, method, and system for migration of metadata and storage management of data in a first storage environment to a second storage environment. A migration request is processed to migrate metadata and storage management of data in a first storage environment to a second storage environment. First metadata for the first storage environment is copied to the second storage environment to incorporate with second metadata. The first metadata incorporated into the second metadata is modified to indicate first server information used by a second server to communicate with a first server to access the migrated data from the first storage media. The migration request is completed in response to incorporating the first metadata into the second metadata, wherein the first data objects remain in the first storage media after completing the migration request.

Abstract: A method and system for use in electronic data retention are provided. The method includes receiving, via electronic communication, a request indication indicating a request to delete, shred, purge, or remove a record from a data retention system; generating a determination, by a processor in response to instructions stored on a non-transitory storage medium, indicating that the record is associated with a hold indicator that is not based on a retention period; and sending, via electronic communication, a denial of the request in response to the determination indicating that the record is associated with a hold indicator that is not based on a retention period.

Abstract: Provided are a computer program product, method, and system for migration of metadata and storage management of data in a first storage environment to a second storage environment. A migration request is processed to migrate metadata and storage management of data in a first storage environment to a second storage environment. First metadata for the first storage environment is copied to the second storage environment to incorporate with second metadata. The first metadata incorporated into the second metadata is modified to indicate first server information used by a second server to communicate with a first server to access the migrated data from the first storage media. The migration request is completed in response to incorporating the first metadata into the second metadata, wherein the first data objects remain in the first storage media after completing the migration request.

Abstract: Provided is a method, system and program for storing data for later retrieval and for transfer within a storage hierarchy. A data storage subsystem stores both individual user files and also managed files, each managed file comprising an aggregation of multiple user files. After receiving user files from a client station, the subsystem stores user files in a retrieval storage pool to facilitate file retrieval. Criteria are subsequently applied to the user files stored in the retrieval storage pool to delete low or lower priority files from the retrieval storage pool. In addition, user files are aggregated in managed files for transfer to another location within the storage hierarchy.

Abstract: Provided is a method, system and program for storing data for later retrieval and for transfer within a storage hierarchy. A data storage subsystem stores both individual user files and also managed files, each managed file comprising an aggregation of multiple user files. After receiving user files from a client station, the subsystem stores user files in a retrieval storage pool to facilitate file retrieval. Criteria are subsequently applied to the user files stored in the retrieval storage pool to delete low or lower priority files from the retrieval storage pool. In addition, user files are aggregated in managed files for transfer to another location within the storage hierarchy.

Abstract: Provided are a computer program product, method, and system for migration of metadata and storage management of data in a first storage environment to a second storage environment. A migration request is processed to migrate metadata and storage management of data in a first storage environment to a second storage environment, wherein the first storage environment has a first storage server, a first storage media, and first metadata describing first data objects stored in the first storage media, and wherein the second storage environment has a second storage server, a second storage media, and second metadata for second data objects stored in the second storage media. The first metadata is copied to the second storage environment to incorporate with the second metadata. The first metadata incorporated into the second metadata is modified to indicate first server information used by the second server to communicate with the first server to access the migrated data from the first storage media.

Abstract: Provided are a method, system, and program for receiving a request to remove a record. A determination is made as to whether a state associated with the record includes at least one hold state and whether the state associated with the record includes at least a retention period that has not expired. The request to remove the record is denied in response to determining that the state associated with the record includes at least one of at least one hold state and one retention period that has not expired.

Abstract: Provided are a method, system, and program for managing storage objects. Storage object information is provided for each storage object, wherein the storage object information indicates at least one of a plurality of groups associated with the storage object, and wherein each storage object is capable of being associated with a plurality of groups and different group types. Group information is provided for each group indicating a group identifier, storage objects associated with the group, and a group type.

Abstract: Systems, methods, and computer products for separating file data streams for improved progressive incremental processing are provided. The method comprises identifying data in a file, prior to transmission of the data in a data stream to a second system, such that the second system can distinguish first data from second data in the file. The method further comprises processing the first and second data to determine whether the first or second data has changed, and transmitting the first data to the second system in response to determining the first data has changed, so that the first data is stored in a data storage medium in association with third and fourth data previously stored without replacing the third data and fourth data, wherein the third and fourth data comprise older versions of the first and second data, respectively.

Abstract: Provided are a method, system, and article of manufacture wherein one client node is selected from a plurality of client nodes. A determination is made that an object corresponding to a client node has to be stored. A determination is made as to whether the object has already been stored in the server node by the one selected client node. The object is stored at the server node, in response to determining that the object has not already been stored in the server node by the one selected client node.

Abstract: Provided are a computer program product, method, and system for migration of metadata and storage management of data in a first storage environment to a second storage environment. A migration request is processed to migrate metadata and storage management of data in a first storage environment to a second storage environment, wherein the first storage environment has a first storage server, a first storage media, and first metadata describing first data objects stored in the first storage media, and wherein the second storage environment has a second storage server, a second storage media, and second metadata for second data objects stored in the second storage media. The first metadata is copied to the second storage environment to incorporate with the second metadata. The first metadata incorporated into the second metadata is modified to indicate first server information used by the second server to communicate with the first server to access the migrated data from the first storage media.

Abstract: Provided are techniques for space recovery with storage management coupled with a deduplicating storage system. A notification is received that one or more data objects have been logically deleted by deleting metadata about the one or more data objects, wherein the notification provides storage locations within one or more logical storage volumes corresponding to the deleted one or more data objects, wherein each of the one or more data objects are divided into one or more extents. In response to determining that a sparse file represents the one or more logical storage volumes, physical space is deallocated by nulling out space in the sparse file corresponding to each of the one or more extents.

Abstract: Provided are a method, system, and article of manufacture, wherein a data structure corresponding to a set of client nodes selected from a plurality of client nodes is generated. Objects from the selected set of client nodes are stored in the data structure. A determination is made that an object corresponding to a client node of the selected set of client nodes has to be stored. An additional determination is made as to whether the object has already been stored in the data structure by any client node of the selected set of client nodes. The object is stored in the data structure, in response to determining that the object has not already been stored in the data structure by any client node of the selected set of client nodes.

Abstract: Provided are techniques for space recovery with storage management coupled with a deduplicating storage system. A notification is received that one or more data objects have been logically deleted by deleting metadata about the one or more data objects, wherein the notification provides storage locations within one or more logical storage volumes corresponding to the deleted one or more data objects, wherein each of the one or more data objects are divided into one or more extents. In response to determining that a sparse file represents the one or more logical storage volumes, physical space is deallocated by nulling out space in the sparse file corresponding to each of the one or more extents.

Abstract: Provided are a method, system, and article of manufacture, wherein a data structure corresponding to a set of client nodes selected from a plurality of client nodes is generated. Objects from the selected set of client nodes are stored in the data structure. A determination is made that an object corresponding to a client node of the selected set of client nodes has to be stored. An additional determination is made as to whether the object has already been stored in the data structure by any client node of the selected set of client nodes. The object is stored in the data structure, in response to determining that the object has not already been stored in the data structure by any client node of the selected set of client nodes.

Abstract: Provided are a method, system, and article of manufacture wherein one client node is selected from a plurality of client nodes. A determination is made that an object corresponding to a client node has to be stored. A determination is made as to whether the object has already been stored in the server node by the one selected client node. The object is stored at the server node, in response to determining that the object has not already been stored in the server node by the one selected client node.