Abstract: A lower-level master node sends, to a higher-level master node, a table-based write set as a bundle of combinations of a shadow copy of the database and a heap tuple map expanded in a memory, and the higher-level master node that received the write set verifies whether the update has already been executed and sends the record of this update to the lower-level master node as a transaction log including a table number, whereby the database can be updated efficiently and consistently from the lower-level master node to the higher-level master node, and from the higher-level master node to the lower-level master node under its control.

Abstract: An apparatus is provided to verify the computational results of a transaction processing system utilizing a parent node and a plurality of child nodes in a high-availability and scalable fashion. A transaction is executed in an identical manner in two or more participating child nodes, and the transaction is allowed to modify an application's state (e.g., commit) only if the validity of the result of the processing of the transaction is verified across the majority of the participating child nodes. Otherwise, the transaction is aborted. The child nodes may exist within a cloud provider or across multiple cloud providers.

Abstract: An associative object model for presenting composite entity information is provided. More particularly, a system and method of linking various data related to an entity from isolated databases in a distributed enterprise is provided. The system and method presents composite information on the entity to different systems within the distributed enterprise. The method includes propagating a change of data of a first entity type to one or more related or associated entity types in an active associative object model (AOM) accessible by a subscribing system and a publishing system in an enterprise.

Abstract: An identical request to process a transaction is initiated at a trusted subsystem of a system and a new subsystem of the system. Computed indicia of the transaction from both subsystems are compared at the trusted subsystem. An error condition is generated that indicates a logic error in the new subsystem when the comparison indicates that the computed indicia of the new subsystem does not match the computed indicia of the trusted subsystem. The error condition indicates a lack of transactional integrity in the new subsystem. The new subsystem may be taken out of service after the error condition is generated.

Abstract: A method for dynamically adjusting between asynchronous and synchronous data replication policies in a networked virtualization environment, includes identifying a current data replication policy for a user virtual machine (VM) determining a load level by a source service VM associated with the user VM and calculating a desired data replication policy for the user VM based on at least the load level.

Abstract: An identical request to process a transaction is initiated at multiple nodes or multiple applications, and the results are committed. Subsequent to the commit, indicia regarding the outcome of the processing are compared, and the transaction is rolled back if the comparison indicates that the processing was incorrect.

Abstract: A computer-implemented data collection and analysis method comprises receiving from a client computing device, at least one data analysis datapoint, adding the received at least one data analysis datapoints to a data structure, and adding an additional data analysis datapoint to the data structure, storing, in a data repository, the data structure further comprising a data processing result, maintaining at least partially consistent copies of the data structure across the plurality of host computers, in response to a request regarding an operation from the client computing device, retrieving the data processing result from the data repository, and providing the data processing result using routing information to the client computing device. The data structure comprises an index of data analysis datapoints from the plurality of host computing devices. A portion of the additional data analysis datapoint is added to the data value to generate a data processing result.

Abstract: For a given cross-data-store transaction request at a storage service, a coordinator transmits respective voting transition requests to a plurality of log-based transaction managers (LTMs) configured for the respective data stores to which writes are directed in the transaction. The LTMs transmit responses to the coordinator based on data-store-specific conflict detection performed using contents of the voting transition requests and respective data-store-specific state transition logs. The coordinator determines a termination status of the cross-data-store transaction based on the LTMs' responses, and provides an indication of the termination status to the LTMs.

Abstract: A corrupted database is returned to a correct state by rolling forward or backward through a change queue and applying changes to the database in a selective manner. Changes that did not cause the corruption are applied without modification when rolling forward or are skipped when rolling backward. Changes that caused corruption are addressed when rolling forward, such as by being ignored or modified and then applied. Changes that caused corruption are corrected when rolling backward.

Abstract: System, method, computer program product embodiments and combinations and sub-combinations thereof for data replication in a database system environment are described. In an aspect, the data replication includes grouping, in-memory, a plurality of transactions to be replicated as a single transaction from a source database system to a target database system. A plurality of net row changes is compiled for the plurality of transactions, and data inconsistency detection and resolution within a command application order are performed. The plurality of net row changes are organized in segments and the segments can be applied simultaneously in bulk to the target database system.

Abstract: A method for use in a database cluster is provided. A first transaction is received at a first node of the database cluster. A page pre-fetch request corresponding to the first transaction is generated while executing the first transaction at the first node. The page pre-fetch request is indicative of at least one database page that is referenced by the first transaction. Moreover, the page pre-fetch request is added to a replication write-set of a second transaction at the first node. Subsequently, the replication write-set of the second transaction, along with the page pre-fetch request, is communicated to a second node of the database cluster.

Abstract: This disclosure relates to assessing database migrations to cloud computing systems. On example method includes determining, by a migration server including one or more hardware processors, a set of possible transactions associated with a database application based at least in part on a set of application attributes associated with the database application; generating, by the migration server, a set of application requirements associated with the set of possible transactions; and creating, by the migration server, a set of migration recommendations associated with the database application based on the set of application requirements, the set of migration recommendations configured to allow the database application to be migrated to a cloud computing system and to allow the database application to comply with the set of application requirements when executed in the cloud computing system.

Abstract: A computing system includes at least one source data center that generates data and a plurality of recovery groups, coupled to the at least one source data center, where each of the recovery groups includes a synchronous data center that receives synchronous data from the at least one source data center and includes an asynchronous data center that receives asynchronous data from the at least one source data center. Cycle switching for asynchronous data transfer is coordinated by the at least one source data center for a first subset of recovery groups containing at least two of the recovery groups. The computing system may also include a second subset of the recovery groups, different from the first subset, where cycle switching for asynchronous data transfer is coordinated by the at least one source data center for the second subset.

Abstract: A method for distributing a file descriptor in a web server is disclosed. The method includes the steps of: (a) a listener processor, if acquiring at least one file descriptor representing a connection of a network between the web server and at least one client, transmitting the at least one file descriptor to a specific kernel buffer corresponding to a specified handler processor among at least one handler processor for handling at least one service request corresponding to the file descriptor, by referring to the number of file descriptors stored in each kernel buffer corresponding to each handler processor; and (b) the specified handler processor handling a service request of a specific client by receiving the file descriptor from the specific kernel buffer.

Abstract: Aspects of the present disclosure are directed to architectures, methods and systems and structures that facilitate the sharing and synchronization of electronically stored files among and between cloud entities and a number of computers, systems, devices and/or users. One particular exemplary architectural aspect includes the concurrent determination of file system changes within a cloud file system and a client file system, the serial ordering of necessary file system operations in response to the determined file system changes, and the concurrent execution of file system operations such that the cloud file system and the client computer file system are synchronized.

Abstract: A system for maintaining a two-site configuration for continuous availability over long distances may include a first computing site configured to execute a first instance associated with a priority workload, the first instance being designated as an active instance; a second computing site configured to execute a second instance of the priority workload, the second instance being designated as a standby instance; a software replication module configured to replicate a unit of work data associated with the priority workload from a first data object associated with the active instance to a second data object associated with the standby instance, and a hardware replication module configured to replicate an image from a first storage volume to a copy on a second storage volume, wherein the first storage volume is associated with the first computing site, and the second storage volume is associated with a third computing site.

Abstract: A method, system and computer-readable storage medium that selectively restore a version of an application object stored in a monolithic backup of a database, while maintaining hierarchical and other metadata relationships of the restored portion of the database are disclosed. Such a mechanism receives a request to restore a version of a selected object from among a plurality of backed up objects in a database backup, locates information associated with the selected object in the backup, and restores the version of the selected object to a target storage area using information associated with the selected object. Database table metadata, gathered from the backed up database at the time the backup was created, can be used to locate the information associated with the selected object.

Abstract: A system and method for transferring data between different types of systems, and in particular uses log-based replication to transfer data between different types of systems. In accordance with an embodiment, the system can be used to perform a one-time or initial copy of the MySQL data from a source database system to a target database system, and/or to replicate the on-going transactions captured from a MySQL database's binary log into one or additional non-MySQL database(s) on a continuous basis, such that the two systems are synchronized for transactions of interest. In accordance with an embodiment, full or partial data changes can be extracted from the MySQL binary log, optionally transformed, skipped or augmented, output or written to a file, and then applied at any of one or more target systems (e.g. another MySQL database, or a non-MySQL database), thereby synchronizing the source and target systems.

Abstract: An information processing apparatus that is capable of shortening downtime caused by updating firmware. A setting unit sets obtaining time at which update firmware for updating firmware of the information processing apparatus is obtained and update time at which the firmware of the information processing apparatus is updated. An obtaining unit obtains the update firmware from an external apparatus at the obtaining time. A development unit develops the update firmware obtained to a predetermined area. A determination unit determines whether the development unit has completed development of the update firmware at the update time. The information processing apparatus changes to the update starting state from the normal starting state when the update firmware has been developed. And the information processing apparatus cancels the developed update firmware and changes to the update starting state from the normal starting state after cancelling when the update firmware has not been developed.

Abstract: Mechanisms for generating an answer to an input question are provided. The mechanisms receive an input question and route the input question to a plurality of Question and Answer (QA) system pipelines. The mechanisms receive results of processing the input question from each QA system pipeline in the plurality of QA system pipelines. The results comprise one or more candidate answers to the input question and associated confidence scores. The mechanisms adjust, for each QA system pipeline, the confidence scores of the one or more candidate answers associated with the QA system pipeline based on one or more weighting factors. In addition, the mechanisms generate the answer to the input question based on the adjusted confidence scores of the one or more candidate answers for each QA system pipeline.

Abstract: Provided are systems and methods for managing asynchronous replication in a distributed database environment, wherein a cluster of nodes are assigned roles for processing database requests. In one embodiment, the system provides a node with a primary role to process write operations against its database, generate an operation log reflecting the processed operations, and permit asynchronous replication of the operations to at least one secondary node. In another embodiment, the primary node is the only node configured to accept write operations. Both primary and secondary nodes can process read operations. Although in some settings read requests can be restricted to secondary nodes or the primary node. In one embodiment, the systems and methods provide for automatic failover of the primary node role, can include a consensus election protocol for identifying the next primary node. Further, the systems and methods can be configured to automatically reintegrate a failed primary node.

Abstract: Embodiments of the present invention relate to asynchronously replicating data in a distributed computing environment. To achieve asynchronous replication, data received at a primary data store may be annotated with information, such as an identifier of the data. The annotated data may then be communicated to a secondary data store, which may then write the data and annotated information to one or more logs for eventual replay and committal at the secondary data store. The primary data store may communicate an acknowledgment of success in committing the data at the primary data store as well as of success in writing the data to the secondary data store. Additional embodiments may include committing the data at the secondary data store in response to receiving an instruction that authorizes committal of data through a identifier.

Abstract: A computer-readable, non-transitory medium storing therein a control program that causes a management apparatus to execute an operation, the operation comprises specifying, from among a plurality of databases, a database with the highest frequency of update of target data to be integrated which is stored in the database, transmitting, in accordance with acquisition of update data from the specified database, to a database other than the specified database among the plurality of databases, a request to transmit information stored in the database other than the specified database to the management apparatus and updating the target data to be integrated on the basis of the information transmitted to the management apparatus by the database other than the specified database in accordance with the request.

Abstract: Disclosed herein are system, method, and computer program product embodiments for replicating data in a distributed database system. Data containing a replicated truncation point associated with a replicating system is received via a data path. It can then be determined that the truncation point represents the point at which all data in a transaction log has been replicated (e.g., successfully or safely) and the transaction log can then be truncated at the truncation point (i.e., the data up to the truncation point deflected). Data containing an additional replicated truncation point associated with an additional replicating system via an additional data path may be received. It can then be determined that the additional replicated truncation point represents the point at which all data in the transaction log has been replicated and the transaction log can be then truncated at the additional replicated truncation point.

Abstract: Embodiments of the present invention provide a method, system and computer program product for consistent replication of transactional updates. In an embodiment of the invention, a method for consistent replication of data in a transaction processing system is provided. The method includes recording entries in a replication log of different data updates and corresponding transactions and additionally recording entries in the replication log indicating whether or not the transactions have been backed out. The method also includes replicating only those data updates referenced in the log which do not correspond to transactions indicated in the log to have been backed out. For instance the additionally recorded entries in the replication log indicate when a transaction has been backed out. Alternatively, the additionally recorded entries in the replication log indicate when a transaction has been committed.

Abstract: In a method for writing data having been subjected to transaction processing in a synchronization source database to data in a synchronization destination database, a synchronization processing management unit of the synchronization destination database requests, as synchronization target data, first data that is a part of the data having been subjected to the transaction processing from the synchronization source database, receives at least the first data from the synchronization source database, performs first synchronization processing on the first data in a cache memory, and performs second synchronization processing on second data, in the synchronization destination database, which has been processed in a same transaction as a transaction in which the first data has been processed in the synchronization source database.

Abstract: System, method, computer program product embodiments and combinations and sub-combinations thereof for data replication in a database system environment are described. In an aspect, the data replication includes grouping, in-memory, a plurality of transactions to be replicated as a single transaction from a source database system to a target database system. A plurality of net row changes is compiled for the plurality of transactions, and data inconsistency detection and resolution within a command application order are performed. Further included is bulk application of the plurality of net row changes to the target database system.

Abstract: A database is maintained that stores data persistently. Tasks are accepted from task sources. At least some of the tasks have competing requirements for use of regions of the database. Each of the regions includes data that is all either locked or not locked for writing at a given time. Each of the regions is associated with an available processor. For each of the tasks, jobs are defined each of which requires write access to regions that are to be accessed by no more than one of the processors. Jobs are distributed for concurrent execution by the associated processors.

Abstract: Embodiments include methods, apparatus, and systems for modifying data structures in distributed file systems. One method of software execution includes using minitransactions that include a set of compare items and a set of write items to atomically modify data structures in a distributed file system.

Abstract: A method including storing a first data object and metadata associated with the first data object at a computing device, storing metadata at the computing device for which a second data object associated with the metadata is not stored at the computing device, and displaying, in the appearance of a single file system, information identifying both the first data object and the second data object.

Abstract: A cluster server manages allocation of free blocks to cluster clients performing writes in a clustered file system. The cluster server manages free block allocation with a free block map and an in-flight block map. The free block map is a data structure or hardware structure with data that indicates blocks or extents of the clustered file system that can be allocated to a client for the client to write data. The in-flight block map is a data structure or hardware structure with data that indicates blocks that have been allocated to clients, but remain in-flight. A block remains in-flight until the clustered file system metadata has been updated to reflect a write performed to that block by a client. After a consistency snapshot of the metadata is published to the storage resources, the data at the block will be visible to other nodes of the cluster.

Abstract: Techniques are described for replicating data from one to one or more heterogeneous data processing or communication devices for the purpose of remote backup, redundancy, content distribution, communications, observations or measurements. In a first phase, the attributes of the data that are modified or created on a device or that are passing through the device are tracked and journaled in volatile or non-volatile storage in real-time. In a second phase, the attributes that match patterns pre-specified in a configuration are used to determine which data to replicate and which modifications to make the devices. In a third phase, the data is replicated. In a preferred embodiment, the described techniques comprise an application that runs on a host device or is embedded in a logic or memory device. The described invention is designed to be transparent for system redundancy and error recovery processes such as error correction, re-transmission on links, and raid configuration.

Abstract: A computer-implemented method for natural batching of I/O operations on a replication log may include: 1) identifying a replication log that records the order of writes within a cluster replication system, 2) determining that the replication log is unavailable, 3) queuing incoming I/O operations for the replication log in a single batch while the replication log is unavailable, 4) determining that the replication log has become available, 5) ceasing queuing of incoming I/O operations for the replication log based on the determination that the replication log has become available, and 6) grouping a plurality of I/O operations in the single batch for processing in parallel by assigning a same generation number to the plurality of I/O operations. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A method, machine, and computer-readable medium is provided for managing transactional sets of commands sent from a client to a server for execution. A first server reports logical identifiers that identify transactional sets of commands to a client. The first server commits information about a set of commands to indicate that the set has committed. A second server receives, from the client, a request that identifies the set based on the logical identifier that the client had received. The second server determines whether the request identified the latest set received for execution in a corresponding session and whether any transactions in the set have not committed. If any transaction has not committed, the second server enforces uncommitted state of the identified set by blocking completion of the identified set issued in the first session. The identified set may then be executed in the second session without risk of duplication.

Abstract: A replication server receives a first write request from a database server for writing first data to persistent data storage. The replication server determines that the first write request is designated as asynchronous. In response to determining that the first write request is asynchronous, the first data is saved to local cache at the replication server and an acknowledgement is sent to the database server. The local cache stores second data to be written to persistent data storage when the first data is saved to the local cache. The first data and the second data are written from the local cache to the persistent data storage in a batch operation.

Abstract: Systems, methods and computer program products for multi-path replication in databases are described herein. A non-limiting embodiment includes instantiating a plurality of replicate connections to a replicate database, providing transactions to the replicate database through a plurality of transaction streams, where the transaction streams associated with respective instantiated replicate connections. Transactions occurring in distinct transaction streams are applied, in parallel, at the replicate database. Another non-limiting embodiment includes instantiating a plurality of replication sender threads, where the replication sender threads communicate in parallel with respective replication servers over respective replication paths. Data sharing one or more attributes can be bound to a replication path in communication with the respective replication servers.

Abstract: Methods, systems, and computer program products for synchronizing a first closed system with a second closed system are disclosed. A first transaction synchronization function on a first computing device receives a first plurality of user transactions and stores corresponding transaction records in a first synchronization file in a common format. The first transaction synchronization function submits the first plurality of user transactions to the first closed system via a first vendor interface for application to a first database. A second computing device accesses the first synchronization file, translates the transaction records in accordance with a second vendor interface, and submits the translated transaction records to a second closed system via a second vendor interface for application to a second closed system.

Abstract: A method of transaction replication includes transmitting at least one transaction received during an epoch from a local node to remote nodes of a domain of 2N+1 nodes at the end of an epoch (N is an integer greater than or equal to 1). The remote nodes log receipt of the at least one transaction, notify the local node of the receipt of the at least one transaction, transmit the at least one transaction to all of the 2N+1 nodes, and add the at least one transaction to an execution order upon receiving at least N+1 copies of the at least one transaction.

Abstract: A method of transaction replication includes transmitting at least one transaction received during an epoch from a local node to remote nodes of a domain of 2N+1 nodes at the end of an epoch (N is an integer greater than or equal to 1). The remote nodes log receipt of the at least one transaction, notify the local node of the receipt of the at least one transaction, transmit the at least one transaction to all of the 2N+1 nodes, and add the at least one transaction to an execution order upon receiving at least N+1 copies of the at least one transaction.

Abstract: Embodiments of the present invention provide a method, system and computer program product for consistent replication of transactional updates. In an embodiment of the invention, a method for consistent replication of data in a transaction processing system is provided. The method includes recording entries in a replication log of different data updates and corresponding transactions and additionally recording entries in the replication log indicating whether or not the transactions have been backed out. The method also includes replicating only those data updates referenced in the log which do not correspond to transactions indicated in the log to have been backed out. For instance the additionally recorded entries in the replication log indicate when a transaction has been backed out. Alternatively, the additionally recorded entries in the replication log indicate when a transaction has been committed.

Abstract: Methods, systems, and computer-readable media for combined saving and validation are disclosed. A particular method includes receiving a command to save changes associated with a change set to a data storage device. Entities of the change set are validated and one or more pre-operation commands are executed on the change set. When a pre-operation command modifies one or more first entities of the change set, the first entities are revalidated. The method also includes executing a data operation based on the change set and executing one or more post-operation commands on the change set. When a post-operation command modifies one or more second entities of the change set, the second entities are re-validated.

Abstract: A system and method for processing a distributed transaction for an application are disclosed. Conventionally transactions on critical data (e.g. financial information) are processed using a database architecture whereby a persistent database (typically a redundant disk array) comprises the master record. In cases where large amounts of data need to be accessed but absolute data integrity is less critical, for example search engines, processing is conducted on live in-memory data without all the data being backed up, which can be much faster but data can be lost when processors fail. There have been attempts to use data grid architectures with some backup to persistent stores for more important data but these have either introduced disk access bottlenecks or required manual intervention in the event of failure.

Abstract: A device is provided for securely transferring digital data between at least one first computer system and at least one second computer system, including a controller that connects to at least one data store, a first transfer device connected to the controller and that receives the digital data from the first computer system and sends the data to the controller, a second transfer device connected to the controller and that receives the digital data from the controller and sends the data to the second computer system, and which is managed independently from the first transfer device. A corresponding transfer method and media containing a computer program are also provided.

Abstract: The invention discloses a system and method for simulating the asynchronous replication process. Transactions received by a server can be organized according to timestamp information or other metadata information, and are executed. The timestamp information can be modified to allow for time-shifted execution of the transactions, thereby compressing or extending the duration of the simulation.

Abstract: A method for accessing information in a replicated database may include receiving a request for information in a database. The request may be associated with a table in the database. The table may include a plurality of identifiers each identifying a portion of the information in the table. The method may also include executing a logical structure associated with the table to produce a logical view of the table. The logical view may contain at least a portion of the information from the table, without containing the identifiers. The method may further include identifying the requested information in the logical view, and communicating the identified requested information in the logical view.

Abstract: A system and method for enabling distributed transaction processing by moving all application logic away from the server and into the client by using an optimistic concurrency control framework with client-side transaction validation including virtual full replication under a transactional programming model with full Atomicity, Consistency, Isolation, and Durability (ACID) properties.

Abstract: Embodiments are directed to implementing a transitional redo phase to allow pre-redo phase data access and to determining which data pages including unprocessed transactions are to be processed during a transitional redo phase. In an embodiment, a computer system initiates an analysis phase of a database recovery that scans a database transaction log and builds a dirty page table that includes pages corresponding to unprocessed data transactions. The computer system determines from the dirty page table which pages are to be processed during the transitional redo phase, before the final redo phase. The computer system processes the determined pages during the transitional redo phase, before the final redo phase is reached and, upon completion of the system transaction undo phase, makes available those pages that were processed during the transitional redo phase, as well as those database pages that are not scheduled for processing during the final redo phase.

Abstract: The invention relates to data processing methods and systems including: a method of database replication in which information strings are assigned to serialization groups for processing; a method of memory management in which data is read from a storage space area while no data is written to it; a method of replicating a database in which a dynamic table is created to provided processing information for database members; and/or a method of replicating a database wherein tasks are allocated to program components without program components interacting.

Abstract: A lower-level master node sends, to a higher-level master node, a write set expanded in its own memory including a shadow copy of its own database and a heap tuple map, and the higher-level master node that received the write set verifies whether the update has already been executed and sends the record of this update to the lower-level master node as a transaction log, whereby the database can be updated efficiently and consistently from the lower-level master node to the higher-level master node, and from the higher-level master node to the lower-level master node under its control.

Abstract: Provided are a computer program product, system, and method for asynchronous pausing of the formation of consistency groups. A first copy operation is initiated to copy the source data from the first storage to the first data copy in the second storage. A second copy operation is initiated to copy the first data copy in the second storage to a second data copy in response to forming a consistency group of the source data at the first data copy forms consistent as of a point-in-time with respect to the source data. The first copy operation is suspended to allow for further processing of the first data copy in response to completing the second copy operation. The formation of a next consistency group is restarted between the source data and the first data copy in response to receiving a resume command.