Abstract: A method for generating a backup script is disclosed. In accordance with the present invention, since the backup script is generated using a backup script generating logic, errors in the backup script may be reduced, and the backup script may be easily modified or complemented even if administrative policies or users are changed.

Abstract: Provided are techniques for, in response to a source object being changed by a local transaction, generating log records, wherein each of the log records includes a sequence identifier, a source system entity modification timestamp, a target key, a target partition identifier, and values of source properties, wherein the source properties are identified using a target key indicator. The log records to process are selected based on a phase value of each log record, wherein the phase value is one of submitted, in-flight, and source system entity state change complete. One or more disjoint partitions are assigned to each of multiple processing instances. Under control of each of the multiple processing instances, it is determined whether to transmit a log record in the one or more disjoint partitions assigned to said processing instance and, in response to determining that the log record is to be transmitted, the log record is transmitted.

Abstract: A method for managing a storage service wherein checking and updating a result of a backup task are facilitated by analyzing a backup end log. In accordance with the method, the result of the backup task is determined by comparing the parameter of the backup end log with that of the backup script and is updated based on user input to obtain reliable statistics of the backup task.

Abstract: Database management systems and program products that exploit time dependent sequential database management system processes to ensure presentation of the same data or view to one or a plurality of users through sequencing asynchronous database management operations such as recovery and replication. Sequencing is accomplished through the use of entries in sequential logs, including transaction logs, recovery logs, and other data recovery tools and applications. Uses include managing data migration and data replication.

Abstract: In general, embodiments of the invention relate to reading data from and writing data to a storage system. Specifically, embodiments of the invention relate to a read only mode for a portion of a storage system. In one embodiment, a selective read-only mode for a portion of a storage system is implemented by monitoring a condition that may affect a subset of persistent storage in a storage system, by detecting the condition, by entering a read-only mode for the subset, and by enforcing a policy of processing write requests and read requests to the storage system, which includes processing the write requests without modifying user data stored on the subset and processing the read requests, including requests for user data stored on the subset.

Abstract: A method, system and computer-usable medium are disclosed for managing the evolution of a data model through the application of change statements. Each change statement comprises a change operator operable to perform change operations on the elements of a target data model. The change statements are appended to a data model change stack. Execution of the change statements stored in the data model change stack results in change operations being performed on the target data model. Each change statement is associated with a version ID and a timestamp which identify the scope of the data model version and time instance of the change.

Abstract: A methodology of applying storage and logistics center model to achieve business data exchange between systems, is based on the storage logistics center model, establishes data storage management center, which receives and saves the data in each business system and sends data extraction request to the corresponding data; Conducts a detailed checking and verification action in the sending and receiving process of aforementioned data storage management center. Comparing with the existing technology and according to the empirical test, the data delivery stem that is based on fragmented data transportation of the logistics center model (the most typical system in the concurrent technology) shows that: performance is increased by 10%, resource consumption is reduced by 30%, system failure rate has dropped 20%, and each process can be controlled.

Abstract: A method and mechanism for identifying one or more transactions that have modified or created an object in a database system. Also disclosed is a method and mechanism to compensate for the effects of a transaction in a database system is disclosed. The disclosed approach can be applied to perform auditing for changes and/or transactions in a database system and for identifying the scope of changes and data accesses made by a transaction in the system.

Abstract: A plurality of parts for an electronic document are generated. The plurality of parts include a root relationship part that identifies one or more of the plurality of parts, a payload part that stores data for the electronic document, and a tracking information part that stores tracking information for the electronic document. All of these parts are stored in a single package.

Abstract: Method and apparatus for detecting viruses in a continuous data protection system using by scanning journal data. In an exemplary embodiment, a system stores journal data, receiving a virus signature update containing a first new virus signature, scanning the journal data for the first new virus signature, and identifying a data block containing the first new virus signature for a first virus.

Abstract: Various embodiments include one or more of systems, methods, software, and data structures that allow dual access to concurrent data in a database management system including uncommitted updated data. Some embodiments include a dual snapshot of data in a multi-version concurrency control style database, but the embodiments described herein are equally applicable to virtually any other type of database and database management system.

Abstract: The invention relates to data processing methods and systems including: a method of database replication in which information strings are assigned to serialization groups for processing; a method of memory management in which data is read from a storage space area whilst no data is written to it; a method of replicating a database in which a dynamic table is created to provided processing information for database members; and/or a method of replicating a database wherein tasks are allocated to program components without program components interacting.

Abstract: A method and apparatus for maintaining an amount of reserve space using virtual placeholders. In one embodiment, a method of using placeholders for log files to maintain an amount of reserve storage space comprises determining a first required log file, wherein the first required log file is to be used to recover a database volume, generating at least one placeholder for representing at least one required log file in a log volume and storing the first required log file and the at least one placeholder in a portion of the log volume, wherein the at least one placeholder is used to control a size of the portion of the log volume.

Abstract: A write ordering style asynchronous replication service utilizes a loosely-accurate global clock in a data backup and recovery storage environment. The storage environment includes a set of source storage systems illustratively embodied as source replication nodes that cooperate to maintain a consistency group that may span multiple geographical sites. The storage environment also includes one or more target storage systems illustratively embodied as target replication nodes configured to service the consistency group. The write ordering style service utilizes the loosely-accurate global clock to provide consistent replication of a storage space of the consistency group.

Abstract: A system and method for safe and effective backup and restore of parallel server databases stored in data storage systems. Parallel server databases allow multiple nodes in MPP (Massively Parallel Processor) or SMP (Symmetric Multi-Processor) systems to simultaneously access a database. Each node is running an instance (thread) which provides access to the database. The present invention allows for online or offline backup to be performed from any node in the system, with proper access to all control files and logs, both archived and online, whether the files are stored in raw partitions in the data storage system, or local on certain nodes. Two different types of external restore supported: complete external restore and partial external restore. In a complete external restore, all spaces will be restored to the most recent checkpoint that was generated while creating an external backup. If users lose only a portion of the data (which is more typically the case), a partial external restore may be performed.

Abstract: Techniques for making light-weight checkpoints in logs of streams of transactions and for extending the logs from the checkpoints. The state saved in the light weight checkpoint need only include the state of all transactions that are active at a prior point in the log and are still active at the checkpoint. A log is extended from the checkpoint by processing new transactions in the transaction stream beginning at the prior point to produce the extending log. When the checkpoint is reached, the state saved at the checkpoint is used to continue to produce the extending log. Techniques are further disclosed for selecting points in the stream of transactions at which the checkpoints may be made and for determining the distance between checkpoints. As disclosed, the log in which the checkpoints are used is a logical log made from a physical log produced by a relational database system. The logical log may be used for replication and for data mining.

Abstract: A technology for verifying backup data capable of synchronizing timings of checksum calculation and verifying data consistency regardless of the storing position of the data is provided. In a backup system using a data update log, a checksum of data of a backup source and a checksum of backup data are checked, thereby verifying data consistency. Data check log generation means and the like are provided so that the data update log and the data check log are transmitted in order to a secondary site. By this means, the timings of the checksum calculation are synchronized. Further, by providing data area extraction means and the like, the verification of data consistency can be performed regardless of the storing position of the data.

Abstract: An improved method and apparatus for auditing database queries, wherein comments are added by a server prior to the server forwarding the queries to the database system. The comments are then used to derive audit information, which is correlated with other audit information in a different server, to produce a more complete audit record.

Abstract: A minimized journaling mechanism stores minimized journal data in a format that allows for display and outputting the journal data in human-readable form. When a change to a record occurs, instead of writing only the changed bytes, all of the bytes in each field that changed are written to the journal, along with all of the bytes in each field selected to be always journaled. A default object is created with default data in all of the fields. When the journal entry needs to be output in human-readable form, the default object is read, and the minimized journal entry is then overlaid on the default object. The result is an object that contains default data in all non-selected fields that were not changed, with the journal data in all fields and that did change and in all fields that were selected to always be journaled.

Abstract: A dynamic information hierarchy may be provided. Logging data comprising a captured user event and a component ID associated with a hierarchical node may be stored in a raw data table. The stored data may be aggregated across the nodes of the hierarchy, stored in an aggregation table, and provided to a user in a report.

Abstract: The embodiments of the invention provide a method of identifying a recovery point in a continuous data protection (CDP) log. More specifically, the method begins by detecting corrupted data in the CDP log and identifying the nature of corruption. Next, the nature of corruption is mapped to applications to identify components that may have caused the corrupted data. The method then finds a time instance of uncorrupted data in the components. Specifically, this can include searching CDP log entries in an order independent of log event age. Alternatively, the process of finding the time instance can include creating a data image of a first copy of uncorrupted data and sequentially apply entries of the CDP log until the corrupted data is reached.

Abstract: A management device of a storage device that executes CDP-based recovery comprises: a data protection term acquisition section that acquires a data protection term which is a term in which recovery of a data volume is ensured from a predetermined duration for which a predetermined time is a reference point; and a control section that executes control using the data protection term.

Abstract: Techniques are described herein for storing instances of data among nodes of a distributed store based on hierarchical scale unit values. Hierarchical scale unit values are assigned to the respective nodes of the distributed store. A first instance (e.g., a primary instance) of a data module is stored in a first node having a first hierarchical scale unit value. A primary instance of the data module with respect to a data operation is an instance of the data module at which the data operation with respect to the data module is initiated or initially directed. A second instance (e.g., a primary or secondary instance) of the data module is stored in a second node having a second hierarchical scale unit value based on a magnitude of a difference between the first hierarchical scale unit value and the second hierarchical scale unit value. A secondary instance is essentially a “back-up” instance.

Abstract: A model edit control system controls editing of a data model. A model repository manager allows multiple users to copy a stored model stored in a repository for executing changes on multiple model copies in parallel. An action log manager crates a model action log for the stored model and tracks actions executed on the stored model. The action log manager also creates a current action log for each model copy to record actions executed on the model copy. A model merger manager merges the model copies into the stored model in the repository, by playing the actions in the current action log against the stored model in the repository.

Abstract: A data processing system includes a data processing unit which processes data acquired and a plurality of data retaining units which store databases used to process the data. Each of the plurality of data retaining units stores a primary database in common and stores the respective shares of a secondary database. The primary database stores a list of IDs for identifying data to be processed by any one of the plurality of data processing units. Each of the data processing units is notified of a range of IDs that the data processing unit handles, among the list of IDs stored in the primary database, and, when acquiring a packet containing an ID that lies within the range of IDs, the data processing unit processes the packet.

Abstract: In one aspect, a method to recover data includes annotating metadata entries in a journal to indicate changes by an application to an object stored in a continuous data protection environment. Each entry of the metadata corresponds to one of a unique group of DO stream data blocks or a unique group of UNDO stream data blocks. The method also includes determining a version of the object that meets criteria by searching the annotated entries and obtaining the version of the object that meets the criteria. In another aspect, a method to recover data includes receiving criteria to recover an object, determining a version of the object that meets the criteria by searching point-in-time images using a DO stream and an UNDO stream and obtaining the version of the object that meets the criteria.

Abstract: A database management system managing one or more databases to suspend access to at least one selected database by one or more processes or applications (e.g., message processing programs, batch messaging programs, etc.). In some instances, the one or more databases may include one or more IMS databases. Access to the at least one selected database may be suspended to enable one or more operations to be performed on the at least one selected database by the database management system and/or an outside entity (e.g., a user, an external application, etc.). For example, the one or more operations may include an imaging operation, a loading operation, an unloading operation, a start operation, a stop operation, and/or other operations. In some instances, access to the at least one selected database may be suspended without canceling transactions being executed by the one or more processes or applications on the selected at least one database.

Abstract: A network of nodes caches replicated datasets in which dataset changes are efficiently propagated as a set of changes even under failure conditions. A master node and a plurality of subordinate nodes in the network each maintain a copy of the dataset and a change log storing change events in the dataset in that node. The change log further includes a rename chain having a plurality of linked rename records created in response to a new master gaining control of the dataset. The master node computes and propagates dataset changes to the subordinate nodes as a set of change events. If the master node fails, one of the subordinate nodes becomes temporary master and continues to propagate dataset changes using its dataset and its change log in response to update requests from other nodes where the update request contains information from the change log of the requestor node.

Abstract: Techniques for file system recovery are disclosed. In one particular exemplary embodiment, the techniques may be realized as a method for file system recovery comprising starting a recovery process for a failed node, utilizing the recovery process to read one or more committed but un-applied transactions from storage associated with the failed node, and recreating the one or more committed but un-applied transactions in memory associated with the recovery process.

Abstract: A system and method for managing log information is provided. The system includes an index/record/catalog management module that determines if a page to be updated is newly allocated; a storage management module that manages a free page list and a non-committed free page list and, if the index/record/catalog module determines that the page to be updated is newly allocated, allocating a new page from the free page list or the non-committed free page list; and a buffer management module that sets identification information on a buffer page corresponding to the new page.

Abstract: Systems and methods for managing electronic data are disclosed. Various data management operations can be performed based on a metabase formed from metadata. Such metadata can be identified from an index of data interactions generated by a journaling module, and obtained from their associated data objects stored in one or more storage devices. In various embodiments, such processing of the index and storing of the metadata can facilitate, for example, enhanced data management operations, enhanced data identification operations, enhanced storage operations, data classification for organizing and storing the metadata, cataloging of metadata for the stored metadata, and/or user interfaces for managing data. In various embodiments, the metabase can be configured in different ways. For example, the metabase can be stored separately from the data objects so as to allow obtaining of information about the data objects without accessing the data objects or a data structure used by a file system.

Abstract: Method and apparatus to dynamically add storage for a journal in a continuous data protection system. In an exemplary embodiment, a method includes storing a plurality of journal data streams for a journal in a continuous data protection system in first storage, where streams in the journal data streams contain linked lists of data blocks, determining when the first storage exceeds a selected fullness threshold, allocating second storage for the journal in addition to the first storage, and storing data for the journal in the second storage.

Abstract: A data storage management system comprises a workflow engine, a lifecycle module, and a storage application. The workflow engine is configured to manage a plurality of defined business processes and to execute at least one process step associated with at least one data item. The lifecycle module is configured to detect a change in lifecycle of the at least one data item. The storage application is configured to perform at least one storage action on the data item as a result of the data item reaching a step in a business process, the data item having a change in lifecycle, the data item having a change in metadata, or an event occurring to the data item. Application layer information about data derived from operation of the system allows the system to make more accurate determinations of business value of data and to determine appropriate storage actions to perform on data.

Abstract: Files stored on a non-removable storage device of a computer system are susceptible to being deleted and to theft. The present invention ensures that vital data files are not lost and that removable storage devices are not used to steal data.

Abstract: A computer device (2010) with a file system having clusters and meta data. The computer device (2010) includes a processor (1030) and a storage (1025) coupled to the processor and having physical representations of instructions so that the processor is operable to reserve (230) at least one of the clusters and to create a log record when meta data for the file system is to be updated by a write (240) of such meta data beforehand to such a reserved cluster, and then set (250) at least one state entry to substantially represent readiness to write the meta data to the file system. Various file systems, processes, circuits, devices and electronic systems are also disclosed.

Abstract: A controller sets a specified time which is a time that specifies a time in the future relative to the current time for all of one or more secondary storage systems. The respective secondary storage systems have a logical volume for backup (BVOL), and set a backup preparation end state when a journal up to a specified time has been established, and report information showing a preparation end state to the controller. The controller issues a backup command to all of the one or more secondary storage systems when information showing a preparation end state is reported from all of the one or more secondary storage systems.

Abstract: Enabling an off-host computer to migrate data of a data volume. In one embodiment, the off-host computer copies data contents of n data blocks of a first data volume to n data blocks, respectively, of a second data volume. A host computer is capable of modifying data contents of a first plurality of data blocks of the n data blocks of the first data volume after the off-host computer begins copying data contents of the n data blocks of the first data volume to the n data blocks, respectively, of the second data volume.

Abstract: Systems and methods are disclosed that facilitate providing page-level database restore functionality upon detection of a corruption event. Updates to a data page in a database can trigger generation of a snapshot of the data page, and an update log can be maintained that stores information related to page updates. Subsequent snapshots can be generated at predetermined intervals and can trigger truncation of a log segment and initiation of a new log segment. Upon detection of page corruption, a most-recent uncorrupt snapshot of the corrupt page can be identified, copied to the location of the corrupt page in the database, and modified according to the log segment associated with the uncorrupt snapshot to make the page current as of the corrupting event, all of which can be performed to restore the database without having to take the database offline.

Abstract: Method and system for allowing temporal navigation or time travel of data or data object across time are disclosed. In one embodiment, events that affected data objects are retrieved and inversed to revert the data objects back to a selected point-in-time, forward events are applied to move data objects to forward point-in-time. A sliding bar or a time dial allows a user to move data objects back and forward in time. Events that are applied may be a selected subset of events, altered events, new events, or events generated synthetically or any combinations thereof, for instance, to create counterfactual history.

Abstract: When logs are analyzed, an analysis with consistency is carried out on the presumption that shifting occurs among time stamps of logs output from a plurality of apparatuses engaged in time correction amount. In a log analysis apparatus which receives logs from a plurality of computers for generating a plurality of logs for analysis, for the plurality of logs output from the plurality of computers, a time stamp recorded in each log is corrected based on a time correction log according to a consistency rule among the logs.

Abstract: A method and apparatus is disclosed herein for logging and/or synchronizing data exchanges. In one embodiment, the method comprises receiving a request from a requester to post data to a first log, identifying the log based on a context identifier in the request indicative of a location of the first log and digital data associated with a document corresponding to the first log, creating a first entry based on data in the request, appending the first log with the first entry, calculating a first identifier based on log entries in the first log, and sending the first identifier to the requester.

Abstract: The invention is a reorganization system having a reorganization application, a database management system, and one or more database files. The reorganization application communicates with the database management system and the one or more database files to reorganize an object, such as, for example, a table or index, while providing one or more clients substantially continuous access to the object. The reorganization application employs one or more trigger locks to synchronize the data in an original table and a reorganized table. The one or more trigger locks block select data modification operations while allowing one or more read-only operations and structural modification operations.

Abstract: In a system that switches multiple database servers to separate computers, a switching order of the database servers is variably changed and set. In the system that allows an executive system computer and a standby system computer having the database servers to share a database respectively, the system is switched from the database server of the executive system computer to the database server of the standby system computer. Information (order information) that indicates an order in which the system of the executive system database server is switched is registered in a storage device. The order information is changed by detection of the occurrence of an event in the executive system computer. The system switching processing is performed from the executive system database server to the standby system database server in accordance with the changed order information.

Abstract: A client communication controlling unit determines whether an input retrieval condition has been received. A retrieval condition judging unit judges whether the input retrieval condition is included in an internal retrieval condition that has been stored in a retrieval condition storing unit. A retrieval target determining unit determines a retrieval target from which logs are retrieved. A log retrieving unit retrieves logs based on the input retrieval condition. A recording unit updates the internal retrieval condition and a result of retrieval based on the input retrieval condition. A client communication controlling unit outputs the result of retrieval.

Abstract: A method and apparatus for different embodiments of probabilistic summary data structure based encoding for garbage collection are described. In one embodiment, a method comprises generating a probabilistic summary data structure that represents active blocks of data within a storage device based on identifications of the active blocks or the data within the active blocks. The method also includes performing garbage collection of at least a portion of the storage device based on the probabilistic summary data structure.

Abstract: Methods, systems, and products for delayed deletion of extended attributes associated with a file in a file system are provided. Embodiments include identifying a file to delete, moving an extended attribute directory associated with the file to a background deletion directory, deleting the file, and deleting in the background the extended attribute directory. Some embodiments also include deleting an ACL associated with the file.

Abstract: A method to archive log entries created by a data storage system comprising a first memory and a library log encoded in that first memory, wherein the first memory comprises a storage capacity, and wherein the method writes a plurality of log entries to the library log, wherein each log entry comprises a log entry time. At a time T0, the method copies to a log archive the plurality of log entries written to the library log, and sets a subsequent retrieval time based upon a time T1 when an earliest log entry was written to the library log, and a time T2 when a latest log entry was written to the library log.

Abstract: Methods and systems for accessing data from a previous point in time, including receiving data stored in a storage system of addressable memory, the storage system including a plurality of addresses, receiving a journal history of write transactions for the storage, each write transaction including (i) a plurality of designated memory addresses, (ii) a corresponding plurality of current data to write in the designated memory addresses for storage, and (iii) a time indicator, generating a data structure that represents a virtual interface to the storage at a specified point in time, based on the write transactions in the journal history having a time subsequent to the specified point in time, and enabling a user to process the data from the specified point in time, via the virtual interface and the journal history.

Abstract: A method, apparatus and program product dynamically enlist a plurality of resources to be committed by a transaction during execution of the transaction and store information about each enlisted resource in the plurality of resources with the transaction in a transaction log, including information about a state of each resource, to facilitate recovery of the transaction. Enlisting and storing may be performed during the execution of the transaction, and the resources to be committed by the transaction may be unknown prior to execution of the transaction. By doing so, a more complete record of all the resources that were enlisted during runtime may be maintained.

Abstract: A processor (2) in a transaction processing system (1) has an event engine and a scenario engine. The event engine stores a framework (20) for each entity or type of service. The framework (20) has a parent class (21) and subsidiary classes (22-27). In real time the event engine instantiates an event object from a relevant class (22-27), giving it an effective time on a timeline of the parent class (21). The event objects many subsequently be handled as autonomous units for generation of reports or batch processing. The event engine moves the event objects between states of a finite state machine. A scenario engine also manipulates objects according to a finite state machine with future dates as the effective times. There is a state transition from the scenario environment to the event engine (live) environment.