Abstract: An apparatus, system, and method are disclosed for concurrent storage to an active data file storage pool, copy pool, and next pool. A copy module copies one or more data files from a client to a storage pool that is configured to store active data files. In addition, the copy module may concurrently copy the data files to a copy pool that is configured to backup the storage pool and stores active and inactive data files. The copy module further concurrently copies the data files to a next pool that is configured to offload one or more data files from the storage pool and may store active and inactive data files. In one embodiment, a migration module migrates one or more inactive data files from the storage pool to the next pool by deleting the inactive data files from the storage pool.

Abstract: Provided is a method for managing retention of stored objects, comprising: receiving a modification request with respect to an attribute or archive policy for an object; determining whether an attribute modification protection flag or setting is set in response to the modification request requesting to modify the attribute for the object; allowing the modification of the attribute object in response to determining that the attribute modification protection flag or setting is not set; determining whether a protection retention mechanism or setting is set in response to the modification request requesting to modify the archive policy for the object; and allowing the modification of the archive policy for the object in response to determining that the protection retention mechanism or setting is not set.

Abstract: Systems, methods, and computer products for separating file data streams for improved progressive incremental processing are provided. The method comprises identifying data in a file, prior to transmission of the data in a data stream to a second system, such that the second system can distinguish first data from second data in the file. The method further comprises processing the first and second data to determine whether the first or second data has changed, and transmitting the first data to the second system in response to determining the first data has changed, so that the first data is stored in a data storage medium in association with third and fourth data previously stored without replacing the third data and fourth data, wherein the third and fourth data comprise older versions of the first and second data, respectively.

Abstract: Provided are techniques for accessing information. A partial key index is created, wherein the partial key index includes one or more partial key index (PKI) entries, wherein each PKI entry identifies a portion of a metadata object, wherein the metadata object includes metadata entries, each of which corresponds to an associated data object. The partial key index is used to locate one or more PKI entries, wherein each of the one or more PKI entries corresponds to one or more data objects in one of the one or more composite objects. Each of the one or more PKI entries is used to retrieve location information of metadata in a metadata object for each of the one or more composite objects. The metadata from each metadata object is loaded into a database using the location information.

Abstract: Provided are a method, system, and program for receiving a request to remove a record. A determination is made as to whether a state associated with the record includes at least one hold state and whether the state associated with the record includes at least a retention period that has not expired. The request to remove the record is denied in response to determining that the state associated with the record includes at least one of at least one hold state and one retention period that has not expired.

Abstract: Provided are a method, system, and program for receiving a request to remove a record. A determination is made as to whether a state associated with the record includes at least one hold state and whether the state associated with the record includes at least a retention period that has not expired. The request to remove the record is denied in response to determining that the state associated with the record includes at least one of at least one hold state and one retention period that has not expired.

Abstract: Provided is a method for transferring data among a logical layer, physical layer, and storage device. The logical layer allocates a buffer to use to write data to a storage device. The physical layer manages access to the storage device. The logical layer determines an offset into the buffer based on a length of a physical header written by the physical layer and writes data to the buffer from the determined offset. The physical layer writes physical header information, wherein the physical header information does not extend past the offset in the buffer. The physical layer transfers content from the buffer to the storage device.

Abstract: An article of manufacture and system are provided for allocating storage space to a storage pool. A request for storage space for the storage pool is received. A list of locations associated with the storage pool is obtained, wherein the locations are capable of spanning multiple file systems or multiple directories within a single file system. One or more allocation techniques are applied to select one or more locations at which storage space is to be allocated. The storage space is allocated at the selected one or more locations.

Abstract: A system, apparatus, and process creates a table of contents (TOC), including one or more table of contents (TOC) entries, to manage data in a hierarchical storage management system. Each TOC entry contains metadata describing the contents and attributes of a data object within an image, which is an aggregation of multiple data objects into a single object for storage management purposes. The TOC is stored in a storage hierarchy, such as magnetic disk, for fast access of and efficient operation on the aggregated TOC entries. The system, apparatus, and process also provide for aggregating the TOC entries from one or more TOCs into a TOC set in the storage management server database. The TOC set may be manipulated and queried in order to find a particular data object or image referenced by a TOC entry.

Abstract: Provided is a method, system and program for storing data for later retrieval and for transfer within a storage hierarchy. A data storage subsystem stores both individual user files and also managed files, each managed file comprising an aggregation of multiple user files. After receiving user files from a client station, the subsystem stores user files in a retrieval storage pool to facilitate file retrieval. Criteria are subsequently applied to the user files stored in the retrieval storage pool to delete low or lower priority files from the retrieval storage pool. In addition, user files are aggregated in managed files for transfer to another location within the storage hierarchy.

Abstract: Provided is a method, system and program for storing data for later retrieval and for transfer within a storage hierarchy. A data storage subsystem stores both individual user files and also managed files, each managed file comprising an aggregation of multiple user files. After receiving user files from a client station, the subsystem stores user files in a retrieval storage pool to facilitate file retrieval. Criteria are subsequently applied to the user files stored in the retrieval storage pool to delete low or lower priority files from the retrieval storage pool. In addition, user files are aggregated in managed files for transfer to another location within the storage hierarchy.

Abstract: An apparatus, system, and method are disclosed for collocating data. A mode module sets a collocation mode of a storage pool. The collocation mode specifies the granularity of the data to be collocated. In one embodiment, an assignment module assigns a source of data to a collocation group. A collocation module collocates the source's data to a minimum number of storage pool volumes based on the collocation mode of the storage pool and collocation group assignment of the source.

Abstract: Sequential media reclamation is usually performed after portions of a sequential access volume's data are no longer needed and the unused portion of the volume exceeds a threshold. Improved sequential media reclamation is provided by using a sequential access disk volume (for example, a volume of a virtual tape library (VTL)) embodied as a sparse file. Reclamation of objects stored in the volume is accomplished by nulling out regions of the sparse file that contain the objects that are no longer needed. A replication method is also provided in which information about the objects stored in the sparse file (such as offset and length) is used during replication to enable the correct portions of a target volume (embodied as a sparse file) to be nulled out to match a source volume (also embodied as a sparse file).

Abstract: Provided are a method, system, and article of manufacture, wherein a data structure corresponding to a set of client nodes selected from a plurality of client nodes is generated. Objects from the selected set of client nodes are stored in the data structure. A determination is made that an object corresponding to a client node of the selected set of client nodes has to be stored. An additional determination is made as to whether the object has already been stored in the data structure by any client node of the selected set of client nodes. The object is stored in the data structure, in response to determining that the object has not already been stored in the data structure by any client node of the selected set of client nodes.

Abstract: A system and method for enforcing change control in operations performed by operational management products (OMPs) are provided. The system and method automate the checking of a request-for-change (RFC) state by an OMP when the OMP is installed in an environment where a change management database (CMDB) has been installed and certain resources or operations have been placed under strict change control. The OMPs of the illustrative embodiments require an RFC identifier to be specified when a change operation of the OMP is invoked. The RFC identifier is used by the OMP to access a service management system so that the OMP may determine if the RFC identifier is valid, IT resources are in the correct state, and the change is scheduled to be performed at the current time. If these checks are passed, then the change operation associated with the RFC is permitted to occur.

Abstract: Provided is a method, system and program for storing data for later retrieval and for transfer within a storage hierarchy. A data storage subsystem stores both individual user files and also managed files, each managed file comprising an aggregation of multiple user files. After receiving user files from a client station, the subsystem stores user files in a retrieval storage pool to facilitate file retrieval. Criteria are subsequently applied to the user files stored in the retrieval storage pool to delete low or lower priority files from the retrieval storage pool. In addition, user files are aggregated in managed files for transfer to another location within the storage hierarchy.

Abstract: A system, apparatus, and process creates a table of contents (TOC), including one or more table of contents (TOC) entries, to manage data in a hierarchical storage management system. Each TOC entry contains metadata describing the contents and attributes of a data object within an image, which is an aggregation of multiple data objects into a single object for storage management purposes. The TOC is stored in a storage hierarchy, such as magnetic disk, for fast access of and efficient operation on the aggregated TOC entries. The system, apparatus, and process also provide for aggregating the TOC entries from one or more TOCs into a TOC set in the storage management server database. The TOC set may be manipulated and queried in order to find a particular data object or image referenced by a TOC entry.

Abstract: A method and system are disclosed for transparent backup to a hierarchical storage system. A data management application requests a backup operation, communicating the request using the Network Data Management Protocol with a tape server and a data server. The tape server generates a unique identifier for the data set. In addition, the tape server transfers the data set from the data server to the hierarchical storage system and sends the identifier to the data management application in response to the request. The identifier identifies the data set within the hierarchical storage system. In a certain embodiment, the tape server stores and manages the data set in locations transparent to the data management application. The tape server and data management application may be logically distinct. The data management application may access the data set through the tape server using the identifier.

Abstract: Provided are a method, system, and article of manufacture wherein a set of communication paths between a plurality of data movers and a plurality of storage devices is maintained. A request to transfer data from a source storage device to a target storage device is received, wherein the source storage device and the target storage device are included in the plurality of storage devices. At least one data mover from the plurality of data movers is selected based on the set of communication paths, wherein the selected at least one data mover can transfer the data from the source storage device to the target storage device.

Abstract: An apparatus, system, and method are disclosed for policy-based secure destruction of data. The method for policy-based secure destruction of data is provided. In one embodiment, the method includes storing a data destruction policy, wherein the data destruction policy defines at least one predetermined data destruction parameter. The method may also include referencing the data destruction policy to obtain the data destruction parameters in response to a predetermined data operation. In a further embodiment, the method may include executing a data destruction process in accordance with the data destruction parameters.