Abstract: Data written in the primary logical volume of the first storage device are transmitted to the third storage device via the second storage device, the data being written in the same location as the primary logical volume within the secondary logical volume in the third storage device; when transmission of the data stops among the first to the third storage devices, the respective second storage device and the third storage device manage locations in the secondary logical volume where the data held thereby are to be written; and, when transmission of the data resumes among the first to the third storage devices, the locations in the secondary logical volume managed by the respective second and the third storage devices are aggregated, the data to be written in the respective aggregated location in the secondary logical volume being transmitted from the first storage device to the third storage device via the second storage device.

Abstract: An apparatus, system, and method are disclosed for restoring cluster server data at a volume level. A setup module opens at least one source volume of a cluster server for a volume-level restore, flushes each buffer for the at least one source volume, closes the at least one source volume, disables file system checks for the cluster disks, saves disk signatures of the cluster disks, and disables device-level checks for the cluster disks. A copy module copies data with a volume-level restore from the at least one snapshot volume to the at least one source volume. A reset module rewrites the saved disk signatures to the cluster disks, re-enables the device-level checks for the cluster disks, and resets at least one volume attribute on the at least one source volume.

Abstract: A system and method for checkpoint tuning in a computer environment comprising a processor coupled to a statistical database and at least one database or table manager and data log files. The data log files store data relating to the operations of the database or table manager. The processor executes a module that captures data comprising the number of operations, the time taken by the checkpoint process, folded journal entries, long running transactions, and the ratio of WRITE:READ operations. The processor then stores the captured data and processes the collected data, generating statistics therefrom. The statistical data is stored in the statistical database. The system selects checkpoint intervals based on the data statistics; and implements the checkpoint intervals.

Abstract: A data storage system includes a storage device divided into a plurality of blocks for storing data for a plurality of volumes, and a processor to execute instructions for maintaining a block map corresponding to the data stored on the storage device. The storage system may be part of a storage system network. The block map stores reference data indicating which of the volumes reference which blocks on the storage device, and which blocks on the storage device are unallocated. The reference data may include, for groups of one or more blocks, a first value identifying the oldest volume in which the group of blocks was allocated and a second value identifying the newest volume in which the group of blocks was allocated. The volumes may include one or more snapshots.

Abstract: Data and metadata are generated in a computational device, wherein the generated data is stored in a first physical storage device coupled to the computational device, and wherein the generated metadata is stored transiently in the computational device. The data and the metadata are replicated to a second physical storage device. The replicated data and the replicated metadata in the second physical storage device are used to recover from a failure of at least one of the computational device and the first physical storage device.

Abstract: A method, system, apparatus, and computer-readable medium are provided for taking snapshots of a storage volume. According to aspects of one method, each snapshot is represented as a unique sequence number. Every fresh write access to a volume in a new snapshot lifetime is allocated a new section in the disk, called a provision, which is labeled with the sequence number. Read-modify-write operations are performed on a sub-provision level at the granularity of a chunk. Because each provision contains chunks with valid data and chunks with invalid data, a bitmap is utilized to identify the valid and invalid chunks with each provision. Provisions corresponding to different snapshots are arranged in a linked list. Branches from the linked list can be created for storing writable snapshots. Provisions may also be deleted and rolled back by manipulating the contents of the linked lists.

Abstract: System and method for refreshing databases. A refresh mechanism may allow a data warehouse to remain available to users while the data is being refreshed. Embodiments may be used to perform low impact off-host data loading for databases including, but not limited to, data warehouses and to reduce the data loading window. A checkpoint of the production database may be generated. A database clone may be generated from the checkpoint. In one embodiment, the generated database clone includes references to data in the production database and not the data itself, and is thus storage space-efficient. Data may be loaded to the database clone. The checkpoint may then be switched to be the entry point to the production database after the loading is complete.

Abstract: According to the invention, a managing server, using a snapshot-appended information table which stores management information for identifying snapshots of a virtual server, a setting change table which stores setting change information on the virtual server, and a policy table which stores policies to be met by the virtual server, acquires the setting change information from the setting change table, selects the setting change information items from the acquired setting change information matching policies stored in the policy table, acquires management information on the snapshots of the virtual server from the snapshot-appended information table, identifies a snapshot of the virtual server with reference to the acquired management information, changes the identified snapshot of the virtual server based on the selected setting change information items, and rolls back the virtual server according to the changed snapshot.

Abstract: Provided are a computer system and its data control method that enable safe backup of data and reduction in the capacity of data to be backed up. A control processor refers to a differential and, if a differential bit is “0,” encrypts data of an online VOL with an encryption circuit by using key information, and transfers the encrypted data to a second storage system. If the differential bit is “1,” the control processor performs redundancy elimination processing to journal data, thereafter compresses the journal data with a compression circuit, encrypts the compressed journal data with an encryption circuit according to the key information, and transfers the journal data that was encrypted after compression to the second storage system.

Abstract: Date-warehouse systems are populated using an enhanced Extraction-Load-Transform (ETL) process and system by employing three ideas: Out-of-order-fill ETL, relative-ordering index (ROI), and dependent queries. Out-of-order-fill ETL allows a data warehouse to accept the loading of data files in any order, and does not require the loading of any previous backup data files in order to provide some functionality to end users under the view that some functionality or data access is better than none at all. Dependent queries are processes that use defined data structures for use in constructing, extracting, and validating each record to be written in said data-warehouse system in order to ensure that referential integrity is maintained and that no orphaned data is pushed into the data warehouse. Finally, ROI is a process wherein a value is determined, based on the constraints of the source data, which indicates the relative newness of the data.

Abstract: A method and system for allowing a rollback within a multi-object system infrastructure are provided. In embodiments, a rollback to a state of a software business object is effected. A sync point manager maintains, for example, a list of sync points and their respective associated identifiers and relationship data. When under sync point protection, i.e., a sync point is set, each subsequent object, when created, is requested to prepare a buffer associated with the specific sync point, so that if an error occurs, a request to rollback to the state associated with the sync point is effectable. Multiple sync points may be kept track of by the sync point manager. In further embodiments, the sync points may be associated with a variety of different types of objects.

Abstract: Managing backup data comprises accessing a snapshot of a data set, wherein the data set includes at least one object and the snapshot includes a replica of the data set, and adding to an index associated with the snapshot, with respect to each of one or more objects included in the snapshot, index data indicating at least where the object is located within the snapshot.

Abstract: A storage system, such as a file server, creates persistent consistency point images (PCPI) or “snapshots” that are point-in-time representations of the storage system. The storage system uses persistent consistency point images to backup or mirror data. Using data already found in the data block maps associated with these PCPI, the amount of space used by a set of these consistency points can be determined.

Abstract: A system and method for using a snapshot as a data source is described. In some cases, the system stores a snapshot and an associated data structure or index to storage media to create a secondary copy of a volume of data. In some cases, the associated index includes application specific data about a file system or other application that created the data to identify the location of the data. The associated index may include three entries, and may be used to facilitate the recovery of data via the snapshot. The snapshot may be used by ancillary applications to perform various functions, such as content indexing, data classification, deduplication, e-discovery, and other functions.

Abstract: In some embodiments, the invention involves a system and method for instant re-imaging of a computing device using a sparse storage partition of dynamically variable size to hold re-imaging data. An embodiment uses a solid state storage device to hold the binary image, or re-imaging personality. An embodiment uses copy on write methodology to maintain the re-imaging personality. An embodiment allows the primary, or active, personality to cannibalize storage used for a re-imaging personality when additional storage is required. The state of a computing device may be switched to allow or prohibit re-imaging, or to prohibit cannibalization of storage. Other embodiments are described and claimed.

Abstract: Various embodiments include one or more of systems, methods, software, and data structures that allow dual access to concurrent data in a database management system including uncommitted updated data. Some embodiments include a dual snapshot of data in a multi-version concurrency control style database, but the embodiments described herein are equally applicable to virtually any other type of database and database management system.

Abstract: This application describes techniques for creating a second snapshot of a first snapshot of a set of data, modifying the first snapshot, and reverting the modifications to the first snapshot. For example, portions of one or more transaction logs may be played into a database to put the database in a particular state a particular point in time. The second snapshot may then be used to revert to a prior state of the database such that additional transaction logs may be played into the database. These techniques enable the ability to put the database into multiple states as the database existed at multiple points in time. Therefore, data can be recovered from the database as the data existed at different points in time. Moreover, individual data objects in the database can be accessed and analyzed as the individual data objects existed at different points in time.

Abstract: In general, in one aspect, the invention relates to a method for taking a snapshot of a service instance, including transitioning the service instance to a new state, determining whether to take the snapshot based on the new state, obtaining a property composition of the service instance, and taking the snapshot using the property composition, if the snapshot is to be taken.

Abstract: A method, article of manufacture, and apparatus for tracking a plurality of objects being stored are disclosed. In an embodiment, this comprises computing the hash value of the name of each object being stored, concatenating the hashed values into a hint, and storing the hint in an index. The size of the hash values is determined by dividing the number of objects into the space available for storing the concatenation, and the range of the hash values may be determined by choosing a prime number smaller than the number that can be represented by the space available for storing the concatenation. Either the hint or the longest pathname containing the objects can be stored, and this may be selected based on the application.

Abstract: When updating the data in each generation's logical units, the snapshot processing unit writes the update data in accordance with the update as forward differential data 221 to the base volume, and saves the old data that existed in the base volume before that update data was written as backward differential data in the backward differential data pool, and, when each generation's logical unit backward differential data is updated, deletes the forward differential data belonging the production LUs and the snapshots that together with those production LUs form the forward differential group. As a result of this, the amount of metadata necessary for executing a host command is able to be reduced in production LUs utilizing snapshots using the forward differential method.

Abstract: In one embodiment, a user or client device is connected to a distributed file system comprised of one or more physical nodes. The data on each of the physical nodes store metadata about files and directories within the file system. Some of the embodiments permit a user to take a snapshot of data stored on the file system. The snapshot may include a single file, a single directory, a plurality of files within a directory, a plurality of directories, a path on the file system that includes nested files and subdirectories, or more than one path on the file system that each includes nested files and directories. According to one embodiment, the system stores and updates metadata, including a governance list, for each of the files and directories. The governance list provides a representation of the snapshots which govern a file or directory and its descendants.

Abstract: A method for operating a computer data storage system is disclosed. The system operates an active file system on a first volume of a plurality of volumes of storage devices connected to one or more servers, each volume being a plurality of storage devices. Snapshots of the active file system are stored on one or more destination volumes. A mirroring operation is initiated on a selected server of the one or more servers. A scanner executes on the selected server, the scanner identifying a latest snapshot on each of the one or more destination volumes, the scanner. Data blocks which are newer than a latest snapshot stored at each destination volume are sent to each destination volume.

Abstract: Techniques are presented for snapshotting. Blocks associated with a storage volume are frozen from volatile access upon receipt of a snapshot request. Continued volatile access to the frozen blocks is permitted by transparently mapping each frozen block to an available block within the volume that is not associated with the snapshot. Volatile access continues on the available blocks.

Abstract: Systems and methods are disclosed for providing a federated backup involving the coordination and synchronization of backup and restore operations among a plurality of hosts to ensure data consistency. A master node (backup host) acts as the initiator, coordinator, controller, and possibly as primary console for the entire backup and restore operation. All other worker application hosts and/or worker backup hosts operate as worker nodes and perform various backup and restore steps as directed by the master node. Centralized error handling aborts or recovers the entire backup operation in the event of failure on any one node. In addition, a logical view of the data is provided such that the backup can be managed as one entity, while backing up the data of each node. The backup workload may also be distributed to any other dedicated worker backup hosts (nodes) in order to minimize the impact to the production environment.

Abstract: During the normal operation state of a computer system 1000, the data stored in a primary storage system 200P is copied to an intermediate storage system 200I via synchronous copying and the data stored in the intermediate storage system 200I is copied to a secondary storage system 200R via asynchronous copying. During the reverse operation state, however, the data stored in the secondary storage system 200R is copied to the intermediate storage system 200I via asynchronous copying and the data stored in the intermediate storage system 200I is copied to the primary storage system 200P via synchronous copying. In this way, practical remote copying can be carried out in a computer system in which three or more storage devices are installed at different locations and connected serially.

Abstract: A method and system for generating a snapshot of one or more logical disks storing file-system data associated with a file system are disclosed. In one embodiment, the file system is quiesced upon a receipt of a command to generate the snapshot of the logical disks, where the snapshot is a copy of the logical disks at a point in time. Then, a disk usage of the logical disks at the point in time is determined. Further, a sharing bitmap associated with the snapshot is generated based on the disk usage, where the sharing bitmap is configured to indicate sharing of the file-system data with the logical disks and a predecessor snapshot immediately preceding the snapshot. Moreover, the file system is unquiesced.

Abstract: Various embodiments include one or more of systems, methods, software, and data structures that allow dual access to concurrent data in a database management system including uncommitted updated data. Some embodiments include a dual snapshot of data in a multi-version concurrency control style database, but the embodiments described herein are equally applicable to virtually any other type of database and database management system.

Abstract: A device and method for connection to a host and transferring data between the host and data storage assembly. The device is preferably a storage system which initializes a logical unit (LUN) in the storage assembly. A persistent memory stores a data representation of clean areas in the LUN. The storage system receives data to be written from the host to a destination area in the LUN, and determines if the destination area in the LUN is a clean area or a dirty area as indicated in the persistent memory. The storage system effects a snapshot copy of data from the destination area in the LUN to an archive storage device of the storage assembly only if the destination area is not entirely a clean area. Bandwidth is likewise reduced in LUN copy and reconstruction operations.

Abstract: In one embodiment, a user or client device is connected to a distributed file system comprised of one or more physical nodes. The data on each of the physical nodes store metadata about files and directories within the file system. Some of the embodiments permit a user to take a snapshot of data stored on the file system. The snapshot may include a single file, a single directory, a plurality of files within a directory, a plurality of directories, a path on the file system that includes nested files and subdirectories, or more than one path on the file system that each includes nested files and directories. In an embodiment, a snapshot tracking data structure is maintained for efficient creation and deletion of the snapshot.

Abstract: A process such as a snapshot creation application process freezes a file system upon initiating a process to create a snapshot of a file system or a part thereof. Upon freezing the file system, the snapshot application process causes a second process to make a change to the file system. If the change is successfully made before the snapshot creation application process tries to thaw the file system, the second process sends a signal back to the snapshot application. Upon receiving a signal from the second process, the snapshot creation application process outputs a warning to a user that the snapshot is inconsistent. The snapshot application also causes a third process to automatically thaw the file system, if a certain period of time has passed and the third process has not received a signal from the snapshot application process indicating the snapshot has been successfully created.

Abstract: A method for inserting a validated time-image on a primary CDP subsystem in a continuous data protection and replication (CDP/R) subsystem. In one embodiment, the method includes processing data of RI1 at a secondary system in accordance with a recovery process, wherein RI1 is a first image of a replication of a data object. First data is generated in response to processing the data of RI1 in accordance with the recovery process, wherein the first data relates to processing the data of RI1 in accordance with the recovery process. Once the first data is generated, a copy of the first data is transmitted to a primary system that stores the data object.

Abstract: A write ordering style asynchronous replication service utilizes a loosely-accurate global clock in a data backup and recovery storage environment. The storage environment includes a set of source storage systems illustratively embodied as source replication nodes that cooperate to maintain a consistency group that may span multiple geographical sites. The storage environment also includes one or more target storage systems illustratively embodied as target replication nodes configured to service the consistency group. The write ordering style service utilizes the loosely-accurate global clock to provide consistent replication of a storage space of the consistency group.

Abstract: Systems and methods for information storage replication are presented. In one embodiment, a namespace conversion process is performed. Node information regarding a file systems operation change is received. A changed node to pathname object conversion process is performed. An unchanged node to pathname object conversion process is performed. In one exemplary implementation, the changed node to pathname object conversion process and the unchanged node to pathname object conversion process utilize data structures that return the object indications and parent node indications. An object indication is inserted in a pathname.

Abstract: In one embodiment, at least one snapshot thread manages a point in time snapshot of a file system stored within the space allocated to the file system. The snapshot thread tracks, for at least one block of the plurality of blocks of the file system, a separate entry in a snapshot map specifying if each at least one block is newly allocated following the creation of the point in time snapshot and specifying an addressed location of a snapshot copy of the at least one block if copied. Separately, a file system handling thread tracks a mapping of an allocation state of each of said plurality of blocks of the file system.

Abstract: A disk drive system and method capable of dynamically allocating data is provided. The disk drive system may include a RAID subsystem having a pool of storage, for example a page pool of storage that maintains a free list of RAIDs, or a matrix of disk storage blocks that maintain a null list of RAIDs, and a disk manager having at least one disk storage system controller. The RAID subsystem and disk manager dynamically allocate data across the pool of storage and a plurality of disk drives based on RAID-to-disk mapping. The RAID subsystem and disk manager determine whether additional disk drives are required, and a notification is sent if the additional disk drives are required. Dynamic data allocation and data progression allow a user to acquire a disk drive later in time when it is needed. Dynamic data allocation also allows efficient data storage of snapshots/point-in-time copies of virtual volume pool of storage, instant data replay and data instant fusion for data backup, recovery etc.

Abstract: A system includes a first site having a first server and a first storage system, a second site including a second server and a second storage system, and a third site coupled to the first and second sites, the third site having gold images. A method of migrating a virtual server image comprises storing a first gold image at the first site; storing a second gold image at the second site; creating a first snapshot volume at the first site based on the first gold image; sending the first gold image ID, update data of the first gold image, and address information for the update data, from the first site to the second site; creating a second snapshot volume at the second site based on the second gold image corresponding to the first gold image ID; allocating storage for storing the update data at the second site with reference to the address information; and storing the update data in the allocated storage.

Abstract: The present invention provides a centralized management mode backup disaster recovery system, which comprises: a control console (104) for performing centralized control on a data container (105), a backup process module (103), storage medium (101), and a standby machine (102) through respective control operations; a production server (108) responsible for controlling and managing data circulation between the production server and the storage medium in unit of data blocks; a backup process module (103) for backing up data to storage space allocated for the production server (180) by the storage medium (101) through an mirror technique and a synchronous or asynchronous technique or any other backup methods; the storage medium (101) for storing data and allocating a logic unit (200) to the production server (108) for data storage; the standby machine (102) for storing system data of the production server (108) and completing automatic running and setting of the standby machine (102) through the control console

Abstract: Approaches to efficiently creating a checkpoint of the process are described. In one approach, a method of performing a checkpoint operation on a process involves detecting a change in the contents of a memory page associated with the process. This change occurred after a preceding checkpoint operation. The method also involves modifying a data structure, at a location corresponding to the contents of that memory page.

Abstract: A storage system including: a disk device including an original volume and a plurality of snapshot generations; and a storage control unit which includes a processor unit. The processor unit receives write data to a storage area of the original volume, and determines whether data stored in the storage area of the original volume is already copied to the snapshot volume or not; if the data stored in the storage area of original volume is not already copied to snapshot volume, the processor unit copies the data from original volume to the snapshot volume, when a use capacity of the snapshot volume is larger than threshold amount by the copy, the processor unit indicates a specified snapshot generation, the processor unit migrates data of the specified snapshot generation from the snapshot volume to tape device; the processor unit deletes information of the specified snapshot generation in the snapshot volume.

Abstract: A disaster recovery system and a method therefor, having: a function for receiving write requests from a host computer to write log information indicating the contents of a database process executed for a database buffer on a main site, database data updated on the database buffer and status information indicating the position of log information used for disaster recovery; a function for transferring the received write request for log information to a recovery site by a synchronous remote copy process; and a function for transferring the received write request for database data to the recovery site by an asynchronous remote copy process. While remote copy can be executed at a long distance without data loss, the deterioration of the performance of a database process on a main site can be suppressed.

Abstract: The correspondence relationship between local paths in local namespaces for snapshots FS0-SNAP0, FS1-SNAP0, and FS2-SNAP0 of file systems FS0, FS1, and FS2 and global paths in a global namespace for those snapshots is defined so that the directory configuration in the global namespace of the snapshots FS0-SNAP0, FS1-SNAP0, and FS2-SNAP0 becomes the same as the directory configuration in the global namespace of the file systems FS0, FS1, and FS2.

Abstract: A snapshot management device and snapshot management method whereby a snapshot is obtained on a regular basis, the amount of difference between two obtained snapshots is detected and, when the detected difference amount is smaller than a threshold value, of the two snapshots, the snapshot obtained earlier than the other is deleted, thereby contributing to the improved convenience.

Abstract: In one embodiment, a user or client device is connected to a distributed file system comprised of one or more physical nodes. The data on each of the physical nodes store metadata about files and directories within the file system. Some of the embodiments permit a user to take a snapshot of data stored on the file system. The snapshot may include a single file, a single directory, a plurality of files within a directory, a plurality of directories, a path on the file system that includes nested files and subdirectories, or more than one path on the file system that each includes nested files and directories. In one embodiment, previous versions of a file or directory are stored only in response to a request to modify the file or directory. The system creates and updates a snapshot tracking data structure which provides information regarding each file or directory governed by the snapshot that was modified or deleted after the snapshot was taken.

Abstract: A backup computer storage system that protects and/or recovers data on a primary computer storage system is disclosed. The backup computer system may be used to backup databases, files, and/or applications. The backup system may be used to backup an image of the primary computer system. The backup system may also be used to backup one or more databases. The backup system may replicate an image of data that is on a primary computer system. The backup system may also be used to restore data from the backup system to the primary computer system. The backup system may restore data to a database while non-affected portions of the database are available and can be used. The backup system may record all transactions in real time without overwriting any previously stored backup data. The backup system may maintain historical and/or chronological information related to the backed up data.

Abstract: In accordance with one embodiment of the present invention, a method for efficiently inventorying a plurality of items of media contained in a library is provided. The method includes reading a barcode located on an item of media that contains contents and determining whether the barcode is known. Optionally, the method may also determine if the know item of media was previously offline. If it is determined that the barcode is known, the media is identified as known. However, if it is determined that the barcode is not known, a detailed inventory of the contents of the item of media is performed. In one embodiment, if it is determined that the barcode is not known, a user is notified that a new item of media has been identified.

Abstract: A system and method for generating persistent consistency point images (PCPIs) is provided. A first set of statistics is obtained for a plurality of data containers. The PCPIs are generated for each of the plurality of data containers after the first set of statistics is obtained. A second set of statistics is obtained for the plurality of data containers after the PCPIs are generated. It is determined that modifying operations were performed to a data container while generating the PCPIs if the first and the second set of statistics are not equal, and it is determined that no modifying operations were performed to the data container while generating the PCPIs if the first and the second set of statistics are equal. The PCPIs are stored on a storage device in response to determining that no modifying operations were performed to the data container while generating the PCPIs.

Abstract: For a data processing system having memory for storing a database, a method, a system and a computer program product for directing the data processing system to process a record to be inserted into the database is disclosed. The database includes a plurality of base tables.

Abstract: System-directed checkpointing is enabled in otherwise standard computers through relatively straightforward augmentations to the computer's memory controller hub.

Abstract: The invention relates to a method of determining if a block was modified in a file system by comparing the versions of the base snapshot, the delta snapshot, and the space map block entry (b, e). In another aspect, the invention relates to a method of searching for blocks modified in a tree structured file system. The invention relates to methods and systems of snapshot management of a file system in a data storage system. To represent the snapshots, the invention maintains pointers to the root block pointer of each snapshot. When the active file system is modified, this invention avoids overwriting any blocks used by previous snapshots by allocating new blocks for the modified blocks. When the invention needs to put an established block in a new location, it must update a parent block to point to the new location. The update to the parent block may then require allocating a new block for the new parent block and so forth. Parts of the file system not modified since a snapshot remain in place.

Abstract: A system is provided to improve storage server performance. The system comprises a receiving component of a storage server to receive a partner server's file system metadata while the partner server operates in a normal mode. The partner server's file system metadata is stored in the storage servers metadata cache and is used to mount the partner server's file system when the first server transitions into a takeover mode of operation.