Abstract: A technique for restoring file systems by applying full and incremental backups together while streaming them from multiple devices provides a faster system restore from a full backup where incremental backups must also be applied. A first storage device streams the full backup while at least one second storage device streams at least one incremental backup. As files are detected in the incremental backup, they are written instead of the corresponding file in the full backup. Incremental backups can be pre-merged to reduce their number to one less than a number of storage devices available to stream the backups, so that the full backup can be streamed along with the pre-merged incremental backup(s) to restore the file system.

Abstract: Techniques for extracting information from a database are provided. A database such as the Web is searched for occurrences of tuples of information. The occurrences of the tuples of information that were found in the database are analyzed to identify a pattern in which the tuples of information were stored. Additional tuples of information can then be extracted from the database utilizing the pattern. This process can be repeated with the additional tuples of information, if desired.

Abstract: Systems and methods integrate disparate backup devices with a unified interface. In certain examples, a management console manages data from various backup devices, while retaining such data in its native format. The management console can display a hierarchical view the client devices and/or their data and can further provide utilities for processing the various data formats. A data structure including fields for storing both metadata common to the client device data and value-added metadata can be used to mine or process the data of the disparate client devices. The unified single platform and interface reduces the need for multiple data management products and/or customized data utilities for each individual client device and provides a single pane of glass view into data management operations. Integrating the various types of storage formats and media allows a user to retain existing storage infrastructures and further facilitates scaling to meet long-term management needs.

Abstract: In a state where the migration source NAS apparatus is continuously operated, a migration processing program confirms the update date and time of files stored in the migration source NAS apparatus, and migrates only the files that were not updated from a specific time to the start date and time of migration processing. Or, the migration processing program migrates the files stored in the migration source NAS apparatus sequentially from the oldest file. The migration performance is calculated based on the capacity and migration time of the migrated files, and the time required for migrating the non-migrated files is calculated based on the size and migration performance of the non-migrated files.

Abstract: Copy pair monitoring is provided for a storage system having plural host computers, at least one storage subsystem, and a management computer. The storage subsystem including volumes storing data requested by the host computer, the management computer being accessible to the host computer and the storage subsystem. The copy pair monitoring includes obtaining every piece of copy pair definition information that is stored in the host computer, removing duplicate copy pair definition information from the whole copy pair definition information obtained, and collecting the copy pair status based on the obtained copy pair definition information from which duplicate copy pair definition information has been removed. Each host computer is assigned a priority level, and, when more than one host computer includes the same copy pair, the host computer with the lowest priority obtains the copy pair information to reduce the load on the higher priority host computers.

Abstract: In one embodiment of the present invention, a method and system are provided to control access to the non-volatile log (NVlog) of a storage server. By controlling access to the NVLog of a storage server the relative disk write bandwidth available to different client write requests can be controlled. The incoming write request can be categorized, and, during times of heavy load, only be permitted to use NVLog space as permitted based on the categorization of each write request. In one embodiment, the present invention includes receiving a write request from a client at a storage server, and determining whether the received write request can be presently logged in a NVlog based on a category of the write request.

Abstract: Systems and methods for performing hierarchical storage operations on electronic data in a computer network are provided. In one embodiment, the present invention may store electronic data from a network device to a network attached storage (NAS) device pursuant to certain storage criteria. The data stored on the NAS may be migrated to a secondary storage and a stub file having a pointer pointing to the secondary storage may be put at the location the data was previously stored on the NAS. The stub file may redirect the network device to the secondary storage if a read request for the data is received from the network device.

Abstract: A system, method, and computer program product are provided for allowing access to backup data resulting from performance of one or more recovery point backup operations and one or more full backup operations. This is accomplished by associating recovery point backup operations with full backup operations and allowing access to backup data resulting from performance of the recovery point backup operations and the full backup operations. In this way, logs corresponding to the backup operations may be associated with a backup path, such that the logs may be accessed during a restore operation. Furthermore, the recovery point operations may be configured to provide a user defined granularity for data recovery. To this end, in various embodiments, backup data may be stored at a granularity defined by a user and recovered based on a user selection of a recovery point.

Abstract: Techniques for selecting between source and target deduplication include analyzing resource information related to resources available for deduplication, analyzing backup metadata of a backup job containing formation related to backup of data from the source to the target, and selecting between deduplication on the source or the target based on the analyzed resource information and the backup metadata.

Abstract: A method and system of validating a differential update to a computer system. One method includes comparing a list of files in a new computer system image with a list of files in a former computer system image to construct a manifest list of files comprising a subset of the new computer system images and the former computer system images. The method further includes associating information with the manifest list to facilitate determining whether a differential update comprising differences between the new computer system image and the former computer system image is valid. The method also includes comparing a list of files in a computer system to receive the differential update against the manifest list of files and using the associated information to determine if the differential update is valid for the computer system.

Abstract: A file system boundary emulation system emulates a virtual boundary of a filesystem within an existing file system for data management at a fileset granularity, within the framework of a wide area filesystem federation. The system dynamically assigns a fileset ID to the file that belongs to that fileset. The system comprises a fileset defined by the virtual boundary of the file. The virtual boundary is less than and contained within the file system. The fileset identifies the file via the file ID and the fileset ID. The system maps the file ID to the fileset ID. The filesets are dynamically created and removed based on administrative instructions. Filesets are used for fine grained data management and namespace control in a filesystem federation.

Abstract: A local host computer system creates a full backup image and one or more incremental backup images. The local host computer system transmits data from the full backup image and the one or more incremental backup images to a remote host computer system. The remote host computer system receives the data from the full backup image and the one or more incremental backup images from the local host computer system, and creates a synthetic backup image using the data from the full backup image and the one or more incremental backup images. In some embodiments, complete copies of the full backup image and the one or more incremental backup images may be transmitted to the remote host computer system. In other embodiments only the portions of the incremental backup images that are actually needed to create the synthetic backup image may be transmitted to the remote host computer system, and unneeded portions may not be transmitted.

Abstract: A computer-implemented method for using single-instance-storage information to reclaim storage space occupied by archived data elements may include: 1) receiving a request to archive a data element on a computing device, 2) determining that a prior instance of the data element has been archived by an archiving system, 3) determining that the archived instance of the data element has been backed up by a backup system, and then, upon determining that the archived instance of the data element has been backed up, 4) reclaiming storage space on the computing device by removing the data element from the computing device. Corresponding systems and computer-readable media are also disclosed.

Abstract: A technique for implementing policy-aware backup and restore capability in a tiered storage system. If a data set's contents are backed up from the tiered storage system to a backup storage system, metadata for the data set may also be backed up. Prior to the data set being restored from the backup storage system to the tiered storage system, the backed up metadata is restored and processed to determine a tier among the tiered storage pools to which the data set will be restored.

Abstract: Method and apparatus for simultaneous comparison of multiple backup sets maintained in a computer system are described. A plurality of backup sets of data maintained in a computer system including a hierarchy of objects is managed. In some examples, a graphical user interface (GUI) is displayed on a display coupled to the computer, the GUI having views configured show a first group of backup sets from the plurality of backup sets. Individual objects of a selected backup set in the first group of backup sets are pinned in a pinned view of the views in response to a first command. A second group of backup sets from the plurality of backup sets is shown in the views in response to a second command by sliding individual objects of at least one backup set in the plurality of backup sets across at least one unpinned view of the views with respect to the individual objects of the selected backup set in the pinned view.

Abstract: Various embodiments are provided for facilitation of data retention using logical objects. Following an operation creating a redundant copy of the data performed on a scheduled interval, a logical object containing a number of managed file versions, represented by a number of member objects for a recovery point, is created. The logical object is assigned a policy of a data retention policy construct associated with the recovery point. The logical object is adapted for reassignment between policies of the data retention policy construct associated with various recovery points. During the reassignment, the plurality of member objects representing the plurality of managed file versions are logically retained instead of performing a data copy operation to associate the plurality of managed file versions with another recovery point.

Abstract: A data prefetching technique uses predefined prefetching criteria and prefetching models to identify and retrieve prefetched data. A prefetching model that defines data to be prefetched via a network may be stored. It may be determined whether prefetching initiation criteria have been satisfied. Data for prefetching may be identified based on the prefetching model when the prefetching initiation criteria have been satisfied. The identified data may be prefetched, via the network, based on the prefetching model.

Abstract: A data synchronization method (for a redundant data storage arrangement in which there are at least a primary storage entity and mirroring first and second remote storage entities in communication therewith, respectively, writes to the first and second remote storage entities being tracked via respective first and second sidefiles, the first and second storage entities having different levels of write-currency relative to each other) may include: comparing the first sidefile with the second sidefile; and updating writes stored at the second remote storage entity based upon the comparison of the first and second sidefiles.

Abstract: A method and apparatus for providing a catalog to optimize stream-based restoration is described. In one embodiment, a method for providing a catalog to optimize stream-based restoration includes processing a catalog that indicates at least one location of at least one data block on backup media, wherein the at least one data block are associated with at least one backup for at least one object and accessing at least one data block using the catalog to create a data stream for restoring the at least one object.

Abstract: Provided is a copy pair monitoring method which is for a storage system having at least one host computer, at least one storage subsystem, and a management computer, the storage subsystem including volumes storing data requested by the host computer to be written, the management computer being accessible to the host computer and the storage subsystem. The copy pair monitoring method is characterized by including the steps of: obtaining every piece of copy pair definition information that is stored in the host computer; removing duplicate copy pair definition information from the whole copy pair definition information obtained; and collecting the copy pair status based on the obtained copy pair definition information from which duplicate copy pair definition information has been removed.

Abstract: Aspects of the present invention provide a solution for implementing disaster recovery for an application. A subscription backup site for the application is selected from among a plurality of sites. The site that is selected will have a virtual space that is able to accommodate the workload requirements for the application. The application is deflated on the site in such as way as to operate in a dormant state. In the dormant state, the application has a small fraction of its required resources allocated to it. Thereafter, when disaster recovery is needed, the application can be inflated on the subscription backup site by allocating resources to enable the application to execute on the subscription backup site.

Abstract: A computer implemented method for providing enhanced customer support is provided. The method comprises a replication server selecting a plurality of first entries in a source lightweight directory access protocol (LDAP) data store based on at least one attribute of the selected entries matching a predefined criteria, wherein a structure of the first entries is defined by a first schema. The method also comprises the replication server copying a plurality of attributes of each of the selected entries into a target lightweight directory access protocol data store, wherein the target lightweight directory access protocol data store contains a plurality of second entries, wherein a structure of the second entries is defined by a second schema, wherein the first schema is different from the second schema, and wherein the plurality of attributes copied do not include all of the attributes defined by the first schema.

Abstract: A file server stores the storage management information and migration policy information. The storage management information includes the information that indicates a storage attribute for each storage apparatus. The migration policy information includes a plurality of information sets. Each of the information sets includes the information that indicates a condition of a file attribute and the information that indicates a condition of a storage attribute of a storage apparatus that is a migration destination. The file server specifies a migration target file, specifies a storage apparatus that conforms to the storage attribute condition that is indicated by the information set that includes the information that indicates a condition of a file attribute that conforms to of a file attribute of a target file based on the storage management information, and migrates a target file from a storage apparatus that has stored the target file to the storage apparatus that has been specified.

Abstract: A server auditing process that stores only a single up-to-date data record along with the differences relative to previous changes in the record that allow the user to move “backward in time” to recreate previous values. The auditing feature introduces a baseline database table and a difference database table for each existing database table. The baseline table stores the most recent auditing data and the differences table complements the baseline table by storing pairs in the form of attribute name and previous value. By applying difference rows to baseline data, the user is able to recreate the data as it existed at any given timestamp and at a minimal storage cost. The architecture minimizes the impact of auditing on system performance by employing an asynchronous priority queue so that task processing is deferred until the system has adequate resources and other work is not affected.

Abstract: Methods, apparatus and computer programs are provided for data replication, such as for replicating a database or updating a cache. Source database change transactions are captured and batched together for efficient data transfer. On receipt at a target replica system, the batch of transactions within a message is separated and separate apply transactions corresponding to the source transactions are performed in parallel. A ‘transaction processed’ table is updated to reflect apply processing for each apply transaction. This table provides a confirmation of the status of each transaction that can be used during recovery processing to prevent re-apply of an apply transaction. The table can also be used to determine when it is safe to delete an incoming message from persistent storage on the target system, and to facilitate one-phase commit processing.

Abstract: Systems and methods of managing virtual storage resources are disclosed. An exemplary method includes analyzing parameters of a plurality of backup jobs over time to model backup lifecycle. The method also includes estimating size of available storage capacity over time based on the modeled backup lifecycle. The method also includes identifying storage options using the available storage capacity on an ongoing basis for future backup jobs.

Abstract: A method for enhancing computer data backup is disclosed. The method includes storing identifications and corresponding functionalities for a plurality of storage devices in a database. A storage device that is in data communication with a computer that is to be backed up is selected. An identification of the storage device selected for use in the backup is determined. If functionalities for the selected storage device are contained in the database, then at least one of the functionalities for the selected storage device is used to enhance a data backup to the selected storage device if functionalities for the selected storage device are stored in the database. If functionalities for the selected storage device are not contained in the database, then the selected storage device can be queried in an attempt to match it to one of the storage devices contained in the database, so that functionalities for the storage device contained within the database can be used to enhance data backup.

Abstract: Image-based data restoration restores an entire image of a volume or selective files. A restore engine receives a request to restore data from a backup image that includes a plurality of data blocks and metadata describing attributes of the data blocks. In response to the request, the restore engine determines a restore mode. If it is determined to be a logical restore mode, the restore engine restores a file by retrieving the metadata associated with the file and the data blocks that are pointed to by the metadata. If it is determined to be an image restore mode, the restore engine restores an entire image of the volume by using the data blocks in the backup image without using the metadata.

Abstract: A backup program, method and system is disclosed that monitors changes to a file in a storage, checks whether backup settings related to the file already exist and requests and applies backup settings related to the file in response to the file being changed if they do not. The backup settings are applied to control operation of a backup system to make one or more backup copies of the file. The backup settings may be electively saved to be applied automatically in the event of future changes to the file without requesting the settings. One or more lists may be used to identify (e.g. include or exclude) files for backup. Files may be identified by different categories including file name, file type, or file type group associated with a particular application. A typical backup system may save backup copies to a storage area network, e.g. controlled by a backup server.

Abstract: Described are techniques and mechanisms for media data storage management. Briefly stated, a media control component monitors the usage patterns of media files on a local device. Any media files whose usage pattern falls below a given threshold is identified as a trim candidate. The media control component trims those trim candidates by eliminating data (content) from the media files. The data is eliminated from the latter portion of the media file so that the trimmed media file will continue to render properly when initially launched. If the trimmed media file is launched, the media control component retrieves the eliminated data from a content server on which is stored a library of media files.

Abstract: Systems for backing up the data of an IT system by utilizing server or storage virtualization technology to create and move logical IT infrastructures dynamically. A virtualized IT system provides a server resource pool and a storage resource pool composed from multiple physical devices either within a datacenter or a globally located plurality of datacenters. The virtual server and the storage volume provisioned from those pools will be paired to form the virtual infrastructure. In other words, the virtual infrastructure becomes a logical IT environment build with the required computing and storage resources needed in order to execute specific applications. The virtual infrastructure can also be migrated within/among datacenter sites.

Abstract: A method and system for obtaining past information in a generic manner. For a certain time point, obtaining a copy of the process object, including its structure and data from recorded changes. When setting up the process object, an action rule is associated with the process object to automate that any change in the data content and/or structure is recorded with an associated time of the change. In response to a request for past information, steps are taken to acquire past data, acquire past change data, and create a temporary object to simulate the object that would have existed at the specific time requested.

Abstract: A mechanism using special properties on data containers of a snapshot backup allows the snapshot backup used for a tape backup to be excluded from the policy enforcement. In addition, reconciliation of a local (client-side) backup repository and server repository bypass the snapshot backup to ensure its validity for the backup duration. If the snapshot backup is to be retained, the data container may be brought back under the domain of policy management. The policy clause may stipulate that a snapshot cannot be recycled while it is being used for a tape backup, allowing tape backups to be prioritized over subsequent snapshot backups.

Abstract: In a state where the migration source NAS apparatus is continuously operated, a migration processing program confirms the update date and time of files stored in the migration source NAS apparatus, and migrates only the files that were not updated from a specific time to the start date and time of migration processing. Or, the migration processing program migrates the files stored in the migration source NAS apparatus sequentially from the oldest file. The migration performance is calculated based on the capacity and migration time of the migrated files, and the time required for migrating the non-migrated files is calculated based on the size and migration performance of the non-migrated files.

Abstract: Data storage volumes, such as a file system on a storage system, may utilize a particular operating system format. Converting a volume to a different format may be desirable at times. However, this can be time consuming and resource intensive if data needs to be copied. Accordingly, substantially copying-free, in-place conversion of a data-storage volume from a first format to a second format is provided herein. In one embodiment, it is determined whether the volume can be converted, for example, by comparing compatibility of features between the first and second formats. A desired feature list is retrieved and respective features are checked for compatibility. Access to the volume is blocked during the conversion, and the volume is converted if the features are found to be compatible. If the conversion is successful, post conversion operations are performed, including unblocking the volume and notifying clients that the volume is available for access.

Abstract: A computer-implemented method for tracking changes to a volume is disclosed. The method may comprise: 1) identifying a first snapshot of a volume, 2) identifying a window within which the first snapshot was created, the window beginning with a first point known to have occurred before the first snapshot and ending with a second point known to have occurred after the first snapshot, 3) identifying at least one change to the volume that occurred within the window, and 4) associating the at least one change that occurred within the window with both the first snapshot and a second snapshot created after the first snapshot. Corresponding systems and computer-readable media are also disclosed.

Abstract: An agent installed on a server reclaims one or more reclaimable off-site copy storage volumes and one or more reclaimable on-site copy storage volumes. To this end, the agent identifies each reclaimable off-site copy storage volume, runs a plurality of threads to collectively copy each data object of the identified reclaimable off-site copy storage volume(s) that is stored within one or more primary storage volumes to one or more one on-site target copy storage volumes, identifies each reclaimable on-site copy storage volume, and runs the plurality of threads to collectively transfer each data object of the identified reclaimable on-site copy storage volume(s) to the on-site copy target copy storage volume(s).

Abstract: An apparatus for and a method are provided for managing data by dividing file identifier descriptors (FIDs) included in metadata of a universal disk format (UDF) file system, and arranging them. The apparatus for managing data includes an input unit that receives a command for generating data in a file system environment, a controller that determines a data type corresponding to the command, a data generator that generates the data by referring to the command, and a metadata updater that arranges an FID with respect to the generated data according to the data type.

Abstract: A method and system for generating and restoring a backup image are disclosed. A server receives a request, which includes a backup path, to generate a backup image. The server generates a backup image offset map that indicates a relative location where a file is stored in the backup image before file data has been written to the backup image. The server stores the backup image offset map in a portion of the backup image on a storage device. The backup image offset map comprises an array having a number of elements equal to a number of inodes on a file system that hosts a backup path, an element of the array representing an inode on the file system, and indicates the relative location where a file that is associated with a number of the inode is stored in the backup image.

Abstract: A method and system for efficient space management for single-instance-storage volumes is provided. A backup module storing data within a collection of containers according to access locality and retention time of the data, wherein the retention time defines an amount of time the data is stored within the collection of containers before deletion of the data, and the access locality comprises an order in which the data is to be accessed is further provided. A compaction module compacting the stored data by selecting at least two containers among the collection of containers, wherein the selection is performed using a predetermined criteria that includes access locality and retention time of the data is also provided. The compaction module distributes the data among the at least two containers. The compaction criteria creates an imbalance among the containers to create more empty, full, or nearly full containers.

Abstract: A user device connects to a global server via a public network and to a local server via a private network. The user device is configured to store information and preferences, where the preferences include information regarding a type of backup permitted by a user of the user device; determine that the preferences permit a local backup to the local server; determine whether a connection, to the local server, can be established, via the private network, based on the determination that the preferences permit the local backup; send at least some of the information to the local server and via the connection through the private network, when the connection to the local server can be established; and send, the at least some of the information to the local server, via the global server and the public network, when the connection to the local server cannot be established.

Abstract: A method for generating a backup script is disclosed. In accordance with the present invention, since the backup script is generated using a backup script generating logic, errors in the backup script may be reduced, and the backup script may be easily modified or complemented even if administrative policies or users are changed.

Abstract: A system includes a server and a controller embedded in a device. Both the server and the embedded controller are capable of communicating over a computer network. The embedded controller sends a command to the server over the computer network that identifies an instance of the device. In response, the server identifies the instance of the device based on the command, retrieves data that is specific to the instance of the device, and send the data to the embedded controller over the computer network.

Abstract: Embodiments are provided to maintain templates associated with a client. New and updated templates can be provided to the client and accessed by a user. In an embodiment, a system can be configured to automatically update locally stored templates with updated templates associated with a library. The updated templates can replace or be used to update the locally stored templates and be used by an application user. In one embodiment, a client can be configured to automatically initiate an update process to retrieve and/or receive new and updated templates from an associated document library. The update process can also be used to provide additional information associated with a template, such as metadata describing aspects of an associated template.

Abstract: The invention automatically selects a copy function according to a policy associated with data to be copied. The apparatus comprises an identification module configured to identify available copy functions in response to a data copy request that includes a predefined copy policy, a comparison module configured to compare each copy function of a storage device to attributes of the predefined copy policy, a selection module configured to automatically select a copy function that satisfies the predefined copy policy, and a relationship module configured to establish a copy relationship between the determined copy function and the data copy request. A policy generation module may be included and configured to read a set of required attributes from an application and to establish the predefined copy policy based on the set of required attributes from the application.

Abstract: The storage system includes a file server connected to a host apparatus and configured to provide a directory in a file system having a directory structure to the host apparatus, a storage subsystem connected to the file server and configured to provide a volume for storing the file system, and a management apparatus connected respectively to the file server and the storage subsystem and configured to manage backup/restoration of an arbitrary directory contained in the file system. The storage system selects one of backup methods of a directory designated as a backup target by the management apparatus, and executes backup processing to the designated directory. The storage system also includes a restoration controller configured to control execution of restoration processing to backup data based on the backup processing.

Abstract: Techniques for automatically detecting similar subsets (e.g., fragments) in electronic documents such as dynamic content-based data, e.g., web pages. The techniques of the invention may perform a systematic analysis of the web pages with respect to one or more of their information sharing behavior, their personalization characteristics, and their change pattern over time. Thus, the invention may be applied to discover fragments in web pages of web sites that are most beneficial for caching the contents of the web site. The present invention also comprises techniques for publishing electronic documents with automatic fragment detection.

Abstract: Described in detail herein are systems and methods for single instancing blocks of data in a data storage system. For example, the data storage system may include multiple computing devices (e.g., client computing devices) that store primary data. The data storage system may also include a secondary storage computing device, a single instance database, and one or more storage devices that store copies of the primary data (e.g., secondary copies, tertiary copies, etc.). The secondary storage computing device receives blocks of data from the computing devices and accesses the single instance database to determine whether the blocks of data are unique (meaning that no instances of the blocks of data are stored on the storage devices). If a block of data is unique, the single instance database stores it on a storage device. If not, the secondary storage computing device can avoid storing the block of data on the storage devices.

Abstract: A method for providing fault tolerance to multiple computer servers is disclosed. Basically, t backup computer servers are utilized to back up data from multiple active computer servers such that up to t faults can be tolerated. Data from the active computer servers are categorized under their respective data structure accordingly. In response to any access to data within one or more of the active computer servers, backup operations are performed on the accessed data in the t backup computer servers according to their data structures such that data with similar data structures are grouped under their respective fusible data structure within the t backup computer servers.

Abstract: Backup and restore operations in a distributed data system are described. In one embodiment of a backup operation, a computing system includes a media server, and two or more distributed data sources. The media server is configured to establish a first connection with an agent executing on the first data source and receives control information specifying one or more additional data sources to contact to continue the backup operation. Agents on the additional data sources pass control information and/or backup data via each respective connection until the backup operation is complete. In some embodiments, two or more concurrent connections may be established between the media server and distributed data sources. In this manner, a backup operation may be performed for distributed data using control information supplied by the distributed data sources.