Abstract: Provided are a method, system, and article of manufacture, wherein a data structure corresponding to a set of client nodes selected from a plurality of client nodes is generated. Objects from the selected set of client nodes are stored in the data structure. A determination is made that an object corresponding to a client node of the selected set of client nodes has to be stored. An additional determination is made as to whether the object has already been stored in the data structure by any client node of the selected set of client nodes. The object is stored in the data structure, in response to determining that the object has not already been stored in the data structure by any client node of the selected set of client nodes.

Abstract: Techniques are provided for allocating storage space to a storage pool. A request for storage space for the storage pool is received. A list of locations associated with the storage pool is obtained, wherein the locations are capable of spanning multiple file systems or multiple directories within a single file system. One or more allocation techniques are applied to select one or more locations at which storage space is to be allocated. The storage space is allocated at the selected one or more locations.

Abstract: Provided are a method, system, and article of manufacture for managing encryption for volumes in storage pools. At least one storage pool is defined in a database, wherein storage pools are defined to include a plurality of data volumes, wherein each volume is included in at least one storage media. An encryption status is indicated for storage pools indicating whether encryption is enabled for the storage pool. An encryption key is provided for volumes included in storage pools for which encryption is indicated as enabled. The encryption keys for volumes included in the storage pools for which encryption is enabled are stored. The database associates the encryption keys with the volumes and the volumes with the storage pools.

Abstract: An apparatus, system, and method are disclosed for concurrent storage pool migration and backup. An association module associates at least one copy pool with a second storage pool. A migration module concurrently migrates at least one data file from a first storage pool to the second storage pool and copies the at least one data file to each copy pool associated with the second copy pool that does not already store an instance of the at least one data file. In one embodiment, the migration module further concurrently migrates each data file that the second storage pool cannot receive to a third storage pool.

Abstract: An apparatus, system, and method are disclosed for concurrent storage to an active data file storage pool, copy pool, and next pool. A copy module copies one or more data files from a client to a storage pool that is configured to store active data files. In addition, the copy module may concurrently copy the data files to a copy pool that is configured to backup the storage pool and stores active and inactive data files. The copy module further concurrently copies the data files to a next pool that is configured to offload one or more data files from the storage pool and may store active and inactive data files. In one embodiment, a migration module migrates one or more inactive data files from the storage pool to the next pool by deleting the inactive data files from the storage pool.

Abstract: A copy procedure detects qualified data objects in a body of source data, and copies the source data to a target storage unit except for unqualified data objects, which are replaced with a prescribed bit pattern. Following completion of the backup, a record is prepared indicating that all data objects exist in the specified target storage, regardless of whether each data object was replaced with a predetermined bit pattern rather than being physically written to the specified target storage. This process may be repeated in order to perform data reclamation, effectively removing user files no longer qualifying for backup.

Abstract: Provided are a method, system, and program for managing retention of stored objects. A modification request is received with respect to a stored object. A determination is made as to whether a retention protection mechanism is set and a storage policy associated with the stored object is processed to determine whether the stored object has expired according to the storage policy in response to determining that the retention protection mechanism is set. The modification request is allowed to proceed in response to determining that the stored object has expired.

Abstract: An apparatus, system, and method are disclosed for collocating data. A mode module sets a collocation mode of a storage pool. The collocation mode specifies the granularity of the data to be collocated. In one embodiment, an assignment module assigns a source of data to a collocation group. A collocation module collocates the source's data to a minimum number of storage pool volumes based on the collocation mode of the storage pool and collocation group assignment of the source.

Abstract: A copy procedure detects qualified data objects in a body of source data, and copies the source data to a target storage unit except for unqualified data objects, which are replaced with a prescribed bit pattern. Following completion of the backup, a record is prepared indicating that all data objects exist in the specified target storage, regardless of whether each data object was replaced with a predetermined bit pattern rather than being physically written to the specified target storage. This process may be repeated in order to perform data reclamation, effectively removing user files no longer qualifying for backup.

Abstract: A method for generating file copies with minimal mounting and positioning of storage volumes involves receiving a request to generate file copies specifying file selection criteria, identifying matching files meeting the selection criteria, locating the matching files on their storage volumes, and copying the files to a copy set. Determination of file copying order is optimized by placing greater emphasis on relative storage locations of matching files than on the order in which their copies are requested. Once a storage volume is mounted, all files stored on that volume are matched against the pending requests including future requests and if found to be the subject of a request, are copied from the mounted volume in optimal position-sensitive order. Copying from secondary storage is deferred until all copying from primary storage is complete.

Abstract: Provided are a system, method, and program for grouping backup objects stored in backup storage. A backup group is created and a plurality of backup objects are added as members of the backup group in separate backup transactions. The backup objects added to the backup group are stored to backup storage.

Abstract: Provided are a method, system, and program for managing storage objects. Storage object information is provided for each storage object, wherein the storage object information indicates at least one of a plurality of groups associated with the storage object, and wherein each storage object is capable of being associated with a plurality of groups and different group types. Group information is provided for each group indicating a group identifier, storage objects associated with the group, and a group type.

Abstract: A system, apparatus, and process creates a table of contents (TOC), including one or more table of contents (TOC) entries, to manage data in a hierarchical storage management system. Each TOC entry contains metadata describing the contents and attributes of a data object within an image, which is an aggregation of multiple data objects into a single object for storage management purposes. The TOC is stored in a storage hierarchy, such as magnetic disk, for fast access of and efficient operation on the aggregated TOC entries. The system, apparatus, and process also provide for aggregating the TOC entries from one or more TOCs into a TOC set in the storage management server database. The TOC set may be manipulated and queried in order to find a particular data object or image referenced by a TOC entry.

Abstract: Provided are a system, method, and program for grouping backup objects stored in backup storage. A backup group is created and a plurality of backup objects are added as members of the backup group in separate backup transactions. The backup objects added to the backup group are stored to backup storage.

Abstract: A copy procedure detects qualified data objects in a body of source data, and copies the source data to a target storage unit except for unqualified data objects, which are replaced with a prescribed bit pattern. Following completion of the backup, a record is prepared indicating that all data objects exist in the specified target storage, regardless of whether each data object was replaced with a predetermined bit pattern rather than being physically written to the specified target storage. This process may be repeated in order to perform data reclamation, effectively removing user files no longer qualifying for backup.

Abstract: In a multiprocessing system, hierarchically superior configuration managers maintain profiles of operating characteristics to which subordinate managed units selectively subscribe. If the profiles or operating characteristics change, the configuration managers propagate the changes to all managed units. Each configuration manager stores a record of operating characteristics and multiple server profiles, each profile specifying one or more operating characteristics. A subscription list identifies one or more managed units, each associated with one or more server profiles. Each managed unit acts according to its current operating characteristics, stored locally at the managed unit. If the managed unit receives a profile subscription request from a system administrator, the managed unit sends a subscription message to the configuration manager to subscribe to that input profile.

Abstract: Storage space allocation is performed in a data storage subsystem, where the amount of storage space to be allocated is determined adaptively in consideration of past data storage requests. First, a request is received from one of the client stations for the subsystem to store a first data item. In response to the request, the subsystem determines whether a storage size estimate for data storage transactions of the first client has been established. If so, the storage size estimate is retrieved. Otherwise, if no storage size estimate has been established, a default storage size estimate is established for data storage transactions of the first client. The estimated amount of storage space is then allocated in the data storage subsystem. After receiving the first data item from the first client station, it is stored in the storage subsystem where it occupies an actual amount of storage space. The estimated and actual amounts of storage space are compared.

Abstract: In a multiprocessing system, a configuration manager maintains various reference parameters that are selectively copied by subordinate managed units to form local operating parameters, which subsequently govern operation of these managed units. A comparative technique is employed to track reference parameter updates, and synchronize each local operating parameter counterpart accordingly. At the configuration manager, reference parameters include reference profiles and reference characteristics. Each reference profile specifies one or more of the reference characteristics. At each managed unit, the operating parameters include subcribed-to profiles and operating characteristics; both are initially copied from the configuration manager's reference profiles/characteristics. Each local operating profile specifies one or more of the operating characteristics. Each managed unit operates according to its locally maintained operating characteristics.

Abstract: A data processing system using a client-server configuration provides a method and apparatus for generating and managing multiple copies of client data files. A server coupled to a plurality of client systems organizes sets of storage volumes into storage pools. Primary copies of the client data files are stored in primary storage pools while additional back-up copies of the client data files are copied to secondary storage pools, called copy storage pools. A server database maintains directory information about the original client data file and reference information about the location of the multiple file copies within the server. A storage manager provides a control center within the server, directing and coordinating the transfer of files between the various storage pools, and updating the server database with directory and reference location information.

Abstract: Digital data objects containing unused space are reconfigured to facilitate more efficient compression of the data objects. First, a determination is made whether the data object contains regions of unused storage space. Such space may represent deleted files, corrupted data, expired data, etc. If regions of unused storage space exist, they are replaced with a predetermined bit pattern. This bit pattern is specifically chosen so that, if provided as input to a predetermined digital data compression process, it would be compressed with a predetermined predicted compression efficiency. For example, the bit pattern may comprise a repeating sequence of binary zeros, which is optimally compressed by most known compression processes. After reconfiguration of the data object, the data object may be provided as input to the compression process and compressed.