Abstract: Methods, systems, and computer program products for synchronizing a first closed system with a second closed system are disclosed. A first transaction synchronization function on a first computing device receives a first plurality of user transactions and stores corresponding transaction records in a first synchronization file in a common format. The first transaction synchronization function submits the first plurality of user transactions to the first closed system via a first vendor interface for application to a first database. A second computing device accesses the first synchronization file, translates the transaction records in accordance with a second vendor interface, and submits the translated transaction records to a second closed system via a second vendor interface for application to a second closed system.

Abstract: A system and method for managing distributed coherent datasets using a hierarchical change log is provided. In some embodiments, a distributed storage system is provided that includes a primary storage device containing a primary dataset and a mirror storage device containing a mirror dataset. The mirror dataset includes a coherent copy of the primary dataset. The distributed storage system further includes a hierarchical change log tracking a coherence state for the mirror dataset. The hierarchical change log includes a first sub-log and a second sub-log, and a block range of the first sub-log overlaps a block range of the second sub-log. The hierarchical change log may define a priority relationship between the first sub-log and the second sub-log governing the overlap. The first sub-log and the second sub-log may be independently configured and may be different in one of a representation and a block size.

Abstract: A travel application for a mobile device is described. The travel application can include an application database which resides on the mobile device and application code for processing instructions stored in the application database, such as instructions for creating pages of information output via the travel application on the mobile device. Without recompiling or reinstalling the travel application on the mobile device, via updates to the travel application database, the navigation structure of the travel application can be changed, a travel data section can be added or removed, a filter for an existing travel data section can be added or removed and the output structure for any of the plurality interface states associated with the travel application can be modified. By executing from an application database stored locally on the mobile device, the travel application can provide some amount of guaranteed functionality when network access is unavailable.

Abstract: Disclosed is a data replication method in a Database Management System (DBMS). The data replication method includes generating a replication log through a transaction log of a master database to thereby transmit the generated replication log to a distributor, determining a slave host distributing the replication log to thereby distribute the replication log to the corresponding slave host, and reflecting the replication log in a slave database.

Abstract: A data synchronization system is provided. In the data synchronization system, a synchronization message transmitting party transmits a synchronization message with meta information to a synchronization message receiving party, and the synchronization message receiving party interprets and stores the meta information included in the synchronization message, and performs further processing for data that is to be synchronized, according to the meta information. Therefore, the frequency of wireless connections for synchronization is minimized.

Abstract: Embodiments of the present invention provide an approach for providing non-disruptive transitioning of application replication configurations and proactive analysis of possible error scenarios. Specifically, under embodiments of the present invention, a common integration model (CIM)-compatible representation of a system replication plan is provided in a computer data structure. Based on the representation, a hierarchical tree data structure having a set of nodes is created. A set of system configuration updates pertaining to the set of nodes are then classified (e.g., based upon the type of configuration update). Once the set of nodes has been classified, the set of nodes may then be analyzed to determine if any nodes of the set are isomorphic. If so, the plan can be modified accordingly. In any event, the replication plan (or modified replication plan) may then be implemented.

Abstract: Replicating data in a distributed database having a plurality of nodes is disclosed. Replicating includes receiving a semantic command at a local version of the database at a node, interpreting the semantic command, and applying the semantic command to the local version of the database.

Abstract: A metadata server of a distributed file system calculates an access frequency of a file and changes a maintaining method of chunks of a data server for dividing data of the file into chunk units to store the chunks in a stripe in accordance with access frequency of the file.

Abstract: A system and method for indexing user data on storage systems is provided. A client of the storage system executes a novel client side agent that is configured to detect changes to data stored by the client on the storage system. In response to detecting that data has been modified, the agent examines modified data containers and parses the modified data to identify new and/or modified index terms or the creation/deletion of data containers. Once the data has been parsed by the agent to identify new/modified index terms, the parsed data is transmitted from the agent to a management module executing on a management server. The management module receives the parsed data and updates a search database using the received parsed data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for storing data according to permissions. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of identifying a version of a data item to be stored; determining permissions associated with the version of the data item; and storing the version of the data item at a storage location that is based on the determined permissions.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for data synchronization. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving a knowledge vector from a first device of the pair of devices, the knowledge vector identifying data items and latest changes to the data items known to the peer device; comparing, at a second device of the pair of devices, the received knowledge vector with a local knowledge vector for changes unknown to the first device; and sending a list of changes to the first device.

Abstract: Data processing systems and methods are provided that include a relational database and an application program that performs a data processing step on data belonging to a pre-defined entity stored in the relational database. The relational database and the application program may be linked by an interface that provides an intermediate layer for extracting a self-contained temporary table out of the relational database that contains the data belonging to a user selected entity. The disclosed systems and methods may be used for various data processing purposes, including monitoring database replication.

Abstract: The present description refers in particular to a data processing method, a computer program product, and a data processing system for obtaining and storing data in an outsourcing environment, the method including providing a user interface on a user computer; determining an indicator which indicates whether there is synchronization data in a user database, wherein the synchronization data is for synchronization with a remote database which is located on a remote computer; obtaining user data with the user interface; and storing the user data in the user database if the indicator indicates that there is synchronization data in the user database.

Abstract: Various of the disclosed embodiments relate to systems and methods for reviewing, maintaining, and replicating data across a plurality of devices. For example, in some embodiments the system may replicate data across a plurality of internal and external storage devices connected to various computer systems in a home network. The user can review and direct replication via an interface in certain embodiments. In some embodiments, the user may use an email system to control and/or monitor the replication.

Abstract: Provided are techniques for replication in a grid based environment. Grid control structures, including a grid command structure, are created. At an authorized node in a grid of nodes, a Data Definition Language (DDL) operation is received, the DDL operation is inserted into the grid command structure, and the DDL operation is propagated from the authorized node to one or more other nodes in the grid of nodes at the end of a transaction that inserted the DDL operation into the grid command structure.

Abstract: Methods and systems are described that involve replica placement strategy for distributed systems. At the time of index creation, initial index replica placement is decided. The first index replica is placed locally on the current processing server node. This server node operates as a master host for the first replica. The other index replicas are placed on different hosts depending on the index type, split index or non-split index, and a set of criteria. For non-split indexes, the set of criteria includes: a number of recently created replicas per host, resource usage per host, and a total number of replicas per host. For split indexes, the set of criteria includes: a number of replicas of any split index part per host and a number of local first replicas of split index parts. If all criteria re equal, the first host in alphanumeric ordering receives a next replica.

Abstract: Various embodiments of systems and methods for synchronizing a primary repository and a secondary repository in a business infrastructure are disclosed. Content of artifacts present in the primary repository and the secondary repository are indexed. Based upon a search criteria received on the secondary repository, an integrated search service provided on the secondary repository is invoked to perform a combinatorial query on the indexed content and retrieve an identifier of each artifact corresponding to the search criteria. Based upon relevancy parameters, the retrieved identifiers are ranked and rendered as a categorized table including a first column and a second column for identifiers present in the primary repository and the second repository respectively. Based upon a user action received on the ranked identifiers in the first column of the categorized table, the associated artifacts are determined and downloaded from the primary repository to the secondary repository.

Abstract: Methods and computer readable media for keyword-based dynamic advertisements in computer applications are described. One embodiment includes a method comprising the steps of receiving context information associated with a user interaction within an application window, receiving a response set comprising at least one article, the response set based at least in part on the context information, selecting an article from the response set, and causing the article to be displayed within the application window without reloading the application window.

Abstract: The present application is directed towards systems and methods of hunting for a hash table entry in a hash table distributed over a multi-node system. More specifically, when entries are created in an ASDR table, the owner node of the entry may replicate the entry onto a non-owner node. The replica can act as a backup of the ASDR table entry in the event the node leaves the multi-mode system. When the node returns to the multi-node system, the node may no longer have the most up to date ASDR table entries, and may hunt to find the existence of the value associated with the entry. Responsive to receiving a request for an entry that may be outdated on the node, the node sends a request down a replication chain for an updated copy of the ASDR table entry from one of the replicas. Responsive to receiving the replica copy of the entry, the node responds to the client's request for the entry.

Abstract: A system, method and computer-readable medium for data capture for replication are provided. A data record from a transaction log of a source database indicative of a data element change is retrieved. A DDL command is generated from the retrieved data record. Once generated, the DDL command is distributed for replication to a target database such that the source database and the target database are synchronized.

Abstract: The improved system provides for selective replication of a subset of a larger central database. A replication structuring utility uses a first textual file to analyze the central database table schema to construct a second textual file representing an ordered list of table and record data element relationships. A client device utilizes this second textual file to determine the subset of the data that should be replicated on a client database. Root objects are defined to inform the second textual file creation and to assist in determining the optimum path through the relational table data. The client device may connect either wired or wirelessly to the central database server.

Abstract: Embodiments of the present invention provide a method, system and computer program product for consistent replication of transactional updates. In an embodiment of the invention, a method for consistent replication of data in a transaction processing system is provided. The method includes recording entries in a replication log of different data updates and corresponding transactions and additionally recording entries in the replication log indicating whether or not the transactions have been backed out. The method also includes replicating only those data updates referenced in the log which do not correspond to transactions indicated in the log to have been backed out. For instance the additionally recorded entries in the replication log indicate when a transaction has been backed out. Alternatively, the additionally recorded entries in the replication log indicate when a transaction has been committed.

Abstract: A mechanism is provided for rendering tape file system information. The mechanism obtains a list of one or more files residing on a tape in the tape file system from a file directory. The mechanism obtains location information associated with at least one file of the one or more files. Finally, the mechanism renders a representation of the location information with the at least one file.

Abstract: Providing efficient data replication for a transaction processing server is provided. A notification is received from the transaction processing server which completes a transaction of a message. The notification includes a message digest and a message identifier. The message identifier in the received notification is compared with a stored message identifier. In response to a match of the comparing of the message identifier, the message digest in the received notification is compared with a stored message digest. In response to a match of the comparing of the message digest, a stored input message is directly stored in a physical storage.

Abstract: A data management unit stores therein configuration items including attribute items described according to different schemas. A dictionary candidate retrieval unit specifies a combination of a pair of attribute items, which defines a correspondence relation between the attribute items of the different schemas, as a dictionary definition item, and retrieves, as a dictionary candidate, a combination of the attribute names corresponding to the same attribute value in the attribute items, which are described according to the schemas, of the dictionary definition item from the data management unit. A dictionary generation unit generates dictionary information defining synonymity between the attribute names of the different attribute items described according to the different schemas based on the dictionary candidate retrieved by the dictionary candidate retrieval unit. A dictionary management unit stores therein the dictionary information generated by the dictionary generation unit.

Abstract: Technologies are generally provided for conveying tree and index needs of a database by collecting and forwarding a statistically representative set of data requests so that a new datacenter can use its existing auto-learning and adjustment techniques to create local indices before receiving its first real or live requests. In some examples, requests at an origin datacenter may be collected to provide a small population of queries that are representative of a larger population of queries. Filters and/or anonymizers may be employed to adhere to data sharing rules and restrictions while still allowing a new datacenter to build indices and test performance. Thus, the new datacenter may be trained asynchronously from another site and without actual data changing hands. Training and testing of destination database services may be completed before committing to customer migration.

Abstract: The disclosure is related to selecting data nodes in a distributed storage system. A server may be provided in a distributed storage system including a plurality of data nodes for providing a storage service. The server may include a receiver configured to receive a replication request and a control unit configured to select data nodes based on at least one of evaluation results and real-time service statuses of the plurality of data nodes. An evaluation result of each data node may be a sum of points of at least one evaluation item assigned to each data node from evaluation of each data node according to at least one evaluating item.

Abstract: Affinities between hosts in a virtualized environment may be monitored, such as by analyzing application interactions and network communications. Hosts that are determined to have dependencies on each other may be migrated together to improve performance of the hosts, such as by reducing network traffic. A method for migrating hosts may include determining an affinity between a plurality of hosts on a plurality of servers, identifying a host from the plurality of hosts for migration from a first server of the plurality of servers to a second server of the plurality of servers, and migrating the host from the first server to the second server. The servers may be part of different interconnected clouds.

Abstract: A document service may be provided by many document service packages, each presenting a particular set of service characteristics (e.g., the performance achievable on various storage device types; the available indexing models; and the types of transactions, scripts, and queries supported by the document service). For a particular project, an administrator may endeavor to select a document service package exhibiting characteristics that match some criteria of the project and to configure or adapt the document service for other criteria, but the range of adaptability for each document service package may be limited. Presented herein are architectures for document services involving a composable set of components respectively providing a service feature with a service characteristic.

Abstract: A data processing system and method of operation are disclosed. The data processing system includes a first site for processing data; a second site for processing data; and a transaction replay program configured to send a copy of data from the first site to the second site. A processor defines a maximum replication latency threshold and a reset threshold for the system, estimates a replication latency of a workload the system, switches the system to a first replication latency state when the estimated replication latency rises above the maximum replication latency and switches the system out of the first replication latency state to a second replication latency state when the estimated replication latency falls below the reset threshold.

Abstract: A method and apparatus are disclosed for enabling nodes in a distributed system to share one or more memory portions. A home node makes a portion of its main memory available for sharing, and one or more sharer nodes mirrors that shared portion of the home node's main memory in its own main memory. To maintain memory coherency, a memory coherence protocol is implemented. Under this protocol, a special data value is used to indicate that data in a mirrored memory location is not valid. This enables a sharer node to know when to obtain valid data from a home node. With this protocol, valid data is obtained from the home node and updates are propagated to the home node. Thus, no “dirty” data is transferred between sharer nodes. Consequently, the failure of one node will not cause the failure of another node or the failure of the entire system.

Abstract: A database system may maintain a plurality of log records at a distributed storage system. Each of the plurality of log records may be associated with a respective change to a data page. A snapshot may be generated that is usable to read the data as of a state corresponding to the snapshot. Generating the snapshot may include generating metadata that is indicative of a particular log identifier of a particular one of the log records. Generating the snapshot may be performed without additional reading, copying, or writing of the data.

Abstract: Systems and methods are disclosed for suggesting relevant documents to a local user. In one embodiment, a method is disclosed comprising determining, at a local device, a set of selection criteria for suggestion of relevant documents to the local user, the suggestion criteria including at least one of keywords and document metadata; retrieving a plurality of file statistics from a remote server, wherein at least one of the file statistics has been created by a remote user; creating a table of suggestions from the plurality of file statistics and from the set of suggestion criteria; and suggesting at least one file to the local user based on the table of suggestion criteria.

Abstract: According to an embodiment, a database system includes a plurality of nodes in which a database is stored; and a management device configured to manage the plurality of nodes. The management device includes a first assigning unit and a second assigning unit. Depending on a change in state of each of the plurality of nodes, the first assigning unit assigns a first node, which stores therein data pieces and receives an access request with respect to the data pieces, and assign a second node, which stores therein the data pieces and serves as a backup node for the first node, and instructs each of the plurality of nodes to perform operations according to assignment.

Abstract: Techniques are disclosed for providing services to a client device via a shared cloud service. In one embodiment, a method is disclosed that includes storing information on a first device relating to a subject, saving the stored information in a serialized format data file to the shared cloud service, the data file having a filename generated as a function of the subject, providing authenticated access to the data file for a second device via the shared cloud service, synchronizing a copy of the data file via the shared cloud service to the second device, the copied data file reflecting a single up-to-date state of the data file in the shared cloud service, and de-serializing the serialized format data file at the second device.

Abstract: Resiliency techniques for a virtual disk are described that enable user control over storage efficiency and recovery time. Configuration parameters for a virtual disk are obtained that indicate a number of available storage devices and a specified tolerance for storage device failures. A default configuration for the virtual disk that designates a default amount of redundancy data to store with client data to balance storage efficiency and recovery time is derived based on the configuration parameters. Options may then be provided to specify a custom configuration that changes the amount of redundancy data to customize the level of storage efficiency and recovery time. The virtual disk is configured and data is stored thereon in accordance with the default configuration or the custom configuration as directed by the user.

Abstract: Systems and methods for managing distributed data using any of a plurality of data models are disclosed. One method includes receiving a data request from one of a plurality of database interfaces, each database interface associated with a different data model type. The method further includes translating the data request to a second data request based at least in part on a data model neutral description of a data model in the data store that is associated with data and the database interface, wherein the data store maintains descriptions of each of a plurality of different data models corresponding to the different data model types. The method also includes executing the second data request, thereby reflecting the data request in data storage such that data is managed consistently across each of the plurality of database interfaces.

Abstract: Embodiments of the present invention provide a method, system and computer program product for partnership relationship management (PRM) data synchronization in a customer relationship management (CRM) data processing system. In an embodiment of the invention, a method for PRM data synchronization in a CRM data processing system can include receiving a data synchronization request from one of several different CRM systems over a computer communications network. The method additionally can include identifying the one different CRM system from amongst the different CRM systems and locating a mapping of data fields corresponding to the identified CRM system. Finally, the method can include synchronizing data received from the identified one of the different CRM systems data with data in the CRM data processing system that maps to the received data according to the located mapping of data fields.

Abstract: Disclosed are methods and structures that facilitate the synchronization of mobile devices and apps with cloud storage systems. Our disclosure, Simba, provides a unified synchronization mechanism for object and table data in the context of mobile clients. Advantageously, Simba provides application developers a single, API where object data is logically embedded with the table data. On the mobile device, Simba uses a specialized data layout to efficiently store both table data and object data. SQL-like queries are used to store and retrieve all data via a table abstraction. Simba also provides efficient synchronization by splitting object data into chunks which can be synchronized independently. Therefore, if only a small part of an object changes, the full object need not be synced. Advantageously only the changed chunks need be synched.

Abstract: Techniques for replicating changes to access control lists on investigative analysis data are disclosed. After a change is made in a database to an access control list (ACL) governing access to a secured component of a data object, an exporting nexus sends an ACL change network message to an importing nexus. The ACL change message includes information that importing nexus can use to apply the ACL change to the importing database. Applying the ACL change message includes using the information in the ACL change message to determine which change records for which secured components of the data object in the importing database the ACL change should be applied to. By doing so, user access to all change records in the importing database to which the ACL change is applied is governed by the new ACL, thereby preventing unauthorized access to the change records, including historical change records.

Abstract: A device is provided for securely transferring digital data between at least one first computer system and at least one second computer system, including a controller that connects to at least one data store, a first transfer device connected to the controller and that receives the digital data from the first computer system and sends the data to the controller, a second transfer device connected to the controller and that receives the digital data from the controller and sends the data to the second computer system, and which is managed independently from the first transfer device. A corresponding transfer method and media containing a computer program are also provided.

Abstract: A source server maintains a replication rule specifying a condition for a replication attribute and a replication action to take if the condition with respect to the replication attribute is satisfied, wherein the replication action indicates to include or exclude the object having an attribute value for the replication attribute that satisfies the condition. For each of the objects, the replication rule is applied by determining an attribute value of the object corresponding to the replication attribute in the replication rule and determining whether the determined attribute value satisfies the condition for the replication attribute defined in the determined replication rule. The replication action on the object in response to determining that the determined attribute value satisfies the condition for the replication attribute.

Abstract: Generally, this disclosure provides devices, methods and computer readable media for device synchronization policy management. The device may include a context determination module configured to determine a usage context associated with the device; a content determination module configured to determine a data content classification associated with data to be synchronized between the device and a cloud; a synchronization policy database configured to store synchronization policies, the policies based on the device usage context, the data content classification and a classification of the cloud type; and a synchronization policy management module configured to select a synchronization policy from the synchronization policy database and further configured to synchronize the data with the cloud based on the selected synchronization policy.

Abstract: Techniques for cross-ACL multi-master replication are provided. The techniques allow a replication site in a multi-master replication system implementing an asynchronous replication protocol and an access control policy to appropriately apply received data change updates to data maintained at the site even where a data change update is missing information because of the implemented access control policy.

Abstract: A system and method for running an application on multiple databases is described. A selection of data stored in a database to be used in conjunction with an in-memory database is identified. A selection of a storage mode corresponding to a dual system storage mode or a source system storage mode is received. The selection of data is initialized in the in-memory database. An entry corresponding to the selection of data is generated in a lookup table when the dual system storage mode is selected.

Abstract: A database associated with a primary database cluster may be replicated in a backup database cluster located in a different location in order to provide a highly-available fault tolerant database service. The databases are reconciled through a cluster management module distributed in each database cluster. The cluster management module uses a set of reconciliation data structures to track locally the reconciled states of each database in each database cluster, the operations made locally to the databases in each database cluster, and the author of the operations. The cluster management module in each database cluster engages in a stateless messaging protocol using the set of reconciliation data structures to determine whether or not the databases may be reconciled.

Abstract: A system that implements a data storage service may maintain tables in a data store on behalf of clients. The service may maintain table data in multiple replicas of partitions of the data that are stored on respective computing nodes in the system. In response to detecting a failure or fault condition, or receiving a service request from a client to move or copy a partition replica, the data store may copy a partition replica to another computing node using a physical copy mechanism. The physical copy mechanism may copy table data from physical storage locations in which it is stored to physical storage locations allocated to a destination replica on the other computing node. During copying, service requests to modify table data may be logged and applied to the replica being copied. A catch-up operation may be performed to apply modification requests received during copying to the destination replica.

Abstract: A remote file server managing a remote storage device and a local file server managing a local storage device are coupled to a communication network (e.g. the Internet). The local file server (A) replicates a file in the local storage device to the remote file server and, (B) if a first condition is satisfied, manages the replicated file which is the file from which the data is replicated as a migration target file. The local file server, even if the (B) is completed, does not delete the migration target file from the local storage device and, if the second condition is satisfied, deletes the migration target file from the local storage device.

Abstract: An on-disk structure of a file system has the capability to efficiently manage and organize data containers, such as snapshots, stored on a storage system. A multi-bit, monotonically increasing, snapshot identifier (“snapid”) is provided that represents a snapshot and that increases every time a snapshot is generated for a volume of the storage system. The snapid facilitates organization of snapshot metadata within, e.g., a data structure used to organize metadata associated with snapshot data. In the illustrative embodiment, the data structure is a balanced tree structure configured to index the copy-out snapshot data blocks. The snapid is also used to determine which blocks belong to which snapshots. To that end, every block that is used in a snapshot has an associated “valid-to” snapid denoting the newest snapshot for which the block is valid. The oldest snapshot for which the block is valid is one greater than the valid-to field of the next older block at the same file block number.

Abstract: A data management system is provided for facilitating in-memory indexing of data based on certain data access modes. The data management system includes an indexing module for indexing data stored in a data memory as a first data index. The first data index is further provided with a first data access mode, wherein the first data access mode enables the first data index to update itself by providing data write privileges to the first data index. The data management system further includes a synchronizing module for synchronizing a second data index with the first data index, wherein the second data access mode is provided with second data access mode to enable external systems to query data. The data management system further includes an index handling module for interchanging data access modes of the first and the second data indexes based on pre-defined rules.