Abstract: Systems and methods are provided that enable a general framework for partitioning application-defined jobs in a scalable environment. The general framework decouples partitioning of a job from the other aspects of the job. As a result, the effort required to define the application-defined job is reduced or minimized, as the user is not required to provide a partitioning algorithm. The general framework also facilitates management of masters and servers performing computations within the distributed environment.

Abstract: The described embodiments set forth techniques for providing a backup progress estimate for a backup of a source file system volume (FSV). The techniques involve determining, for the source FSV, a backup size during performance of backup operations. The operations can include determining the backup size based on a number of files on the source FSV. Additionally, the operations can include copying files of the source FSV and/or propagating corresponding files of a destination FSV to a location of the backup of the source FSV on a destination storage device and updating one or more metrics using a number of files and/or a number of bytes copied and/or propagated to the backup. In this manner, a progress indication for the backup may be determined based on the one or more metrics responsive to files and/or directories of the source file system volume being stored on a destination storage device.

Abstract: Embodiments of a method are disclosed. The method includes performing distributed deep learning training on a batch of training data. The method also includes determining training times representing an amount of time between a beginning batch time and an end batch time. Further, the method includes modifying a communication aspect of the communication straggler to reduce a future network communication time for the communication straggler to send a future result of the distributed deep learning training on a new batch of training data in response to the centralized parameter server determining that the learner is the communication straggler.

Abstract: The present disclosure is directed to a flexible architecture for video gaming applications. In some embodiments, the flexible architecture is platform agnostic and provides a continuous visual experience for players across different platforms while engaging them at different levels of play. The architecture provides user interfaces that facilitate access to video gaming applications in various ways that may include: via social networks or sites; via wall posts or via an online social networking service that enables its users to send and read text-based posts; via mobile devices (iOS, Android, or Windows-based smart phones); or via dedicated game consoles.

Abstract: Methods and systems for providing distributed user agent information updating. One system includes a data processing server configured to receive an update event associated with an update to an active version of user agent information. The active version of the user agent information is actively accessible for request enrichment. The data processing server is also configured to generate an updated version of the user agent information according to the update and replace the active version with the updated version in storage. In response to the storage of the updated version, the updated version is actively accessible for request enrichment.

Abstract: A system and a method for handling and storing data records are provided. A software application is configured to process user requests and accordingly generate a master data record that is associated with at least one user and/or a user application. The software application further generates a partition token, which is used by a routing module to route the user request for storing a master data record to the master storage partition associated with the partition identifier indicated in the generated partition token.

Abstract: Certain example embodiments involve accessing data in a database. At least one key is associated with the data. The data is indexed based on the at least one key. The index provides key-value pairs in which keys in the key-value pairs correspond to the at least one key associated with the data and values in the key-value pairs correspond to deserializable serialized blobs generated to include the data in variant data type format. The variant data type format includes different possible equivalent representations of the data such that the data stored in the blobs is of potentially different structures. Responsive to a request received from a computing device, a database transaction is performed on the data in connection with the index and based on the received request. These techniques can be used in connection with tasks as well as data “per se.” O(1) performance is achievable in some instances.

Abstract: A shared storage architecture persistently stores database files in non-volatile random access memories (NVRAMs) of computing nodes of a multi-node DBMS. The computing nodes of the multi-node DBMS not only collectively store database data on NVRAMs of the computing nodes, but also host database server instances that process queries in parallel, host database sessions and database processes, and together manage access to a database stored on the NVRAMs of the computing nodes. To perform a data block read operation from persistent storage, a data block may be transferred directly over a network between NVRAM of a computing node that persistently stores the data block to a database buffer in non-volatile RAM of another computing node that requests the data block. The transfer is accomplished using remote direct memory access (“RDMA).

Abstract: A method for data storage includes assigning multiple different portions of a given object, which is stored in non-volatile storage, for access by multiple respective software modules running on one or more processors. Storage operations are performed by the software modules in the portions of the given object. Respective local values, which are indicative of most-recent times the storage operations were performed in the given object by the respective software modules, are updated by the software modules. A global value is updated for the given object, by consolidating updates of the local values performed by the software modules.

Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase the speed of provisioning, a pool of data replication groups may be maintained. When a request is received a data replication group may be selected from the pool, removed from the pool, and associated with the request. Furthermore, a replacement data replication group may be provisioned and added to the pool.

Abstract: Embodiments of the disclosure describe a system, method, and apparatus for acquiring global information. The method comprises receiving current version information from a global information server, the current version information associated with current global information and associated with a network service; retrieving the current global information associated with the current version information and associated with the network service from the global information server; and providing or suspending the network service associated with the current global information based on a presence of a stop-write identifier in the current global information.

Abstract: A group of remote devices executing an omnichannel application are coordinated from a network node. An omnichannel mediator coordinates formation of at least two of said remote devices into an omnichannel cloudlet. A component manager controls which of a plurality of components of said omnichannel application should optimally be placed on which individual devices of said omnichannel cloudlet and how data should flow to individual devices of said omnichannel cloudlet. A replication optimizer optimally coordinates data replication for the group of remote device.

Abstract: In accordance with an embodiment, described herein is a system and method for supporting multiple partitions and edit sessions in a multitenant application server environment. In accordance with an embodiment, a first administrator or user can obtain a named edit session for use with a partition, make changes, and then activate those changes. Another administrator or user can create a named edit session in parallel. If there are conflicts between a concurrent change and changes being made by another user, the administrator will receive an error when activating the changes. At that point, the administrator can resolve the conflicts and activate the changes. Upon activation, the changes in the edit session will be applied to a global edit configuration.

Abstract: Real-time and historical data can be managed. For example, a processing engine can be selectively operated in a historical mode. In the historical mode, the processing engine can analyze data associated with a previous date. For example, the processing device can access a database that includes multiple entries. Each entry in the database can be associated with a respective record and including (i) an entity associated with the respective record, (ii) an identifier of a block of records that comprises the respective record, and (iii) a timestamp indicating when the block of records was generated. The processing engine can filter entries in the database to determine blocks of records that include a most current record for each entity as of the previous date. The processing engine can process the blocks of records to determine an output corresponding to the previous date.

Abstract: A slave storage is provisioned using metadata of a master B-tree and updates to references (e.g., offsets) pertaining to data operations of the master B-tree. Master-slave pairs can be used to provide data redundancy, and a master copy can include the master B-tree with references to corresponding data. When provisioning a slave copy, the master sends a B-tree copy to the slave, which stores the slave B-tree copy, allocates the necessary space on local storage, and updates respective offsets of the slave B-tree copy to point to the local storage. Data from the master can then be transferred to the slave and stored according to a note and commit process that ensures operational sequence of the data. Operations received to the master during the process can be committed to the slave copy until the slave is consistent with the master and able to take over as master in the event of a failure.

Abstract: In an example of masterless cache replication, a processor of a server of a plurality of servers hosting a distributed application can receive a local cache event for a local data item stored in an application cache of the server. The processor can determine whether the local cache event is from another server. The processor can also determine whether a remote cache event of the other server is different from the local cache event and whether the local cache event is in conflict with at least one other cache event for the local data item. The processor can also determine whether the local cache event has a higher priority over the at least one other cache event and direct performance of the local cache event amongst the plurality of servers.

Abstract: A method is used for managing consistency groups in storage systems. A consistency group comprising multiple logical objects is created and multiple replicas of the consistency group are created. The consistency group is restored to one of the multiple replicas.

Abstract: A distributed tree protocol is provided for managing computing devices that form a peer-to-peer overlay network, and for modifying data that is synchronized between the devices. A method for modifying the data includes representing data in a tree structure. The tree structure includes at least one tree node identified by a tree node ID, the tree node ID including a numerical value representing a path from a root node to the at least one node. The root node and the tree structure are identified by a root node ID. The device can send or receive a peer-to-peer message with an other computing device. The message includes a format value specifying a format of the numerical value, the root node ID, an operation value specifying modification of the data, and at least one tree node ID associated with the modification of the data.

Abstract: A system and method is disclosed, which facilitates data replication in a multi-master Relational Database Management Systems (RDBMS). An in-memory attribute is stored at a server of a multi-master database system. The in-memory attribute is associated with an operation, a record, and a global unique identifier (GUID) assuring uniqueness across the database system. The in-memory attribute indicates disallowing at the server additional requested operations associated with the record. The operation associated with the in-memory attribute is performed at the server and logged in a global accessible log associated with the server and available to other servers of the database system. The in-memory attribute is removed from the server based on a global accessible log associated with at least one of the other servers.

Abstract: A method includes monitoring, on a computing device, data events corresponding to manipulation of data by an application. The monitoring is performed by a data library service that is embedded in the application. The method includes, in response to the monitoring indicating first data on the computing device is modified by the application, synchronizing, by the computing device under control at least in part of the data library service, second data stored on one or more storage providers in a network with the first data modified by the application and stored on the computing device. Apparatus and computer program products are also disclosed.

Abstract: A computer-implemented system and method performs an iterative process to assess the installation of an upgrade version of a database product for consistency with a baseline version of the database product. To assess the installation, the baseline version and the upgrade version are reconciled by modifying one or both of the baseline and upgrade versions. The modified baseline and upgrade versions are then analyzed to determine whether any remaining inconsistencies exist. Any remaining inconsistencies are then identified and classified, and reconciled. Thereafter, the process is repeated iteratively until the upgrade version is reconciled with the baseline version.

Abstract: A portable media player which broadcasts synchronization data, but not streaming media content, for a media file which is currently being played. The media players are programmed, user-selectably, to synchronize to other media players which are already playing a desirable track.

Abstract: A data synchronization system is provided. In the data synchronization system, a synchronization message transmitting party transmits a synchronization message with meta information to a synchronization message receiving party, and the synchronization message receiving party interprets and stores the meta information included in the synchronization message, and performs further processing for data that is to be synchronized, according to the meta information. Therefore, the frequency of wireless connections for synchronization is minimized.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for data synchronization. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving a knowledge vector from a first device of the pair of devices, the knowledge vector identifying data items and latest changes to the data items known to the peer device; comparing, at a second device of the pair of devices, the received knowledge vector with a local knowledge vector for changes unknown to the first device; and sending a list of changes to the first device.

Abstract: A system that implements a data storage service may store data on behalf of clients in multiple replicas on respective computing nodes. The system may employ an external service to select a master replica for a replica group. The master replica may service consistent read operations and/or write operations that are directed to the replica group (or to a data partition stored by the replica group). The master replica may employ a quorum based mechanism for performing replicated write operations, and a local lease mechanism for determining the replica authorized to perform consistent reads, even when the external service is unavailable. The master replica may propagate local leases to replica group members as replicated writes. If another replica assumes mastership for the replica group, it may not begin servicing consistent read operations that are directed to the replica group until the lease period for a current local lease expires.

Abstract: Techniques to cross-synchronize data are described. An apparatus may comprise a cross-synchronization component to synchronize multiple data items for different application programs between multiple client devices synchronized using multiple synchronization circuits. The cross-synchronization component may determine whether changes to the multiple data items made at a first client device are propagated to a second client device using consistency information maintained by a consistency group item for a consistency group including the data items. Other embodiments are described and claimed.

Abstract: An extensible file system format for portable storage media is provided. The extensible file system format includes the specification of primary and secondary directory entry types that may be custom defined. The primary and secondary directory entry types can be further classified as critical and benign directory entries. The directory entry types can define whether a cluster chain corresponding to a file can be contiguously allocated.

Abstract: A computerized system and method is presented for analyzing quotations made in a quoting document of text originally found in a source document. The present invention analyzes the quoting document for quoted text, searches the source document for that text, and stores the existence of the quotation in association with the source document. When displaying the source document, a list of text items that were quoted by another document is presented sorted by frequency of quotation. Quoted text is also highlighted when the original text of the source document is displayed. Hyperlinking is allowed between items of quoted text by the user and a list of documents that have quoted that text. From this list the full text of a quoting document may be displayed. The frequency of quotations taken from a source document can also be used to rank documents in search results.

Abstract: A method, device, and program product are provided for inter-site database replication. A replicating server tracks other servers that it needs to replicate with and the sites where the other servers are located. In response to an indication to replicate, the replicating server determines whether each of the other servers is at the same location as the replicating server or a different location from the replicating server. The replicating server replicates with each of the other servers at the same site as the replicating server, and the replicating server replicates with only one of the servers at each different site. The replicated server at each different site replicates with the other servers at the site of the replicated server.

Abstract: A method for historically synchronizing configuration data of a computer network is provided. A network management server collects from a first database a first plurality of configuration tables corresponding to a plurality of entities in the computer network according to a hierarchy of the entities when an entity in the computer network has changed. The network management server identifies the entity that has changed. The network management server adds a history identifier to an entity configuration table of the first plurality of configuration tables. The entity configuration table corresponds to the entity that has changed. The network management server updates a second plurality of configuration tables in a second database with the first plurality of configuration tables.

Abstract: Systems and methodologies are provided for efficiently performing concurrent transactions by multiple users, and tracking data at a logical level beneath a physical level of the object being modified. Each transaction can copy a committed version of the data segment to be modified to its respective space, and can update such copy during modification. A detect component detects whether any data segment being operated upon requires updating as a result of other transactions committing, and a merge component synchronizes the data segment with its committed version. Various optimization procedures can also be incorporated as part of the commit stage, upon completion of the detect and merge process.

Abstract: A multi-master cloud-based data replication service designed to support the needs of a broad class of web applications is disclosed. Generally, the replication service serves the purposes of facilitating sharing of web application data among personal computing devices and increasing the availability of that data. In one embodiment, the replication service includes a replica identifier reassignment features that allows a personal computing device to begin sharing application data changes with an existing group of personal computing devices that are already sharing application data changes between them even if the joining personal computing device has application data changes to share with the other personal computing devices of the group at the time the joining personal computing device requests to join the group.

Abstract: System, methods and computer program products for creating and maintaining an address book are described. The address book may collect or update its existing contact information from sent or received communications. Contact information associated with the existing contacts also may be collected (or updated based on information received) from outside sources (e.g., external to an application hosting or accessing the address book). The address book may intelligently combine profile data from various sources to enrich the existing records associated with the contacts.

Abstract: Replicated instances in a database environment provide for automatic failover and recovery. A monitoring component can obtain a lease enabling the component to periodically communicate with, and monitor, one or more data instances in the data environment, where the data instance can be a replicated instance including a primary and a secondary replica. For a large number of instances, the data environment can be partitioned such that each monitoring component can be assigned a partition of the workload. In the event of a failure of a monitoring component, the instances can be repartitioned and the remaining monitoring components can be assigned to the new partitions to substantially evenly distribute the workload.

Abstract: System, methods and computer program products for creating and maintaining an address book are described. The address book may collect or update its existing contact information from sent or received communications. Contact information associated with the existing contacts also may be collected (or updated based on information received) from outside sources (e.g., external to an application hosting or accessing the address book). The address book may intelligently combine profile data from various sources to enrich the existing records associated with the contacts.

Abstract: An apparatus and a method operating on data at a server node of a data grid system with distributed cache. Data is copied to a network cloud of storage services remotely coupled to a server node with an asynchronous input output interface. The asynchronous input output interface is configured to asynchronously communicate with the network cloud of storage services. Confirmation that the data has been copied on the network cloud of storage services is received at the server node.

Abstract: Synchronization of two or more items can be optimized through the use of parallel execution of synchronization tasks and adaptable processing that monitors and adjusts for system loading. Two or more synchronization tasks required to be performed for an item can, if not inherently serial in nature, be performed in parallel, optimizing synchronization of the item. Even if multiple synchronization tasks required for one item must be serially executed, e.g., download the item prior to translating the item, these synchronization tasks can be executed in parallel for different items, optimizing a download request involving two or more items. Moreover, multiple threads for one or more synchronization tasks can be concurrently executed when supportable by the current operating system resources. Rules can be established to ensure synchronization activity is not degraded by the overextension of system resources.

Abstract: A distributed database synchronization capability is provided herein. The distributed database synchronization capability may be implemented using one or more of a timer-based scheme and a token-based scheme. The distributed database synchronization capability enables synchronization of databases of nodes in various types of networks, including dynamic networks (e.g., such as rapidly deployable wireless networks) and various other types of networks. The synchronization of databases may include synchronization of databases as a whole and/or portions of databases (which may include any suitable database table or tables). The distributed database synchronization capability enables synchronization of databases of nodes under various dynamic conditions (e.g., synchronization of databases of nodes within a cluster of nodes, synchronization of databases of nodes between clusters of nodes, synchronization of databases of nodes by administrative domain, and the like).

Abstract: A method and apparatus for updating a slave system in a multi-master replication network is provided. The method involves executing a first event on a first master system within the multi-master replication network and executing a second event on a second master system in the multi-master replication network, where the first event and the second event are identical. The method further involves selecting an event from the first event and the second event and executing the selected event on a slave system.

Abstract: A method performed by two or more devices of a group of devices in a distributed data replication system may include receiving a group of chunks having a same unique temporary identifier, the group of chunks comprising an object to be uploaded; creating an entry for the object in a replicated index, the entry being keyed by the unique temporary identifier, and the replicated index being replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method may also include calculating a content-based identifier to the object; creating another entry for the object in the replicated index, the other entry being keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

Abstract: Disclosed are systems and methods for synchronizing data present in a target data set with data present in a source data set. The data present in the target data set is partitioned to determine a partition definition of the target data set. A target message digest is calculated for the data present in each partition of the target data set. Based upon the partition definition of the target data set, the data present in the source data set is partitioned. A source message digest is calculated for the data present in each partition of the source data set. The source message digest of a partition is compared with the target message digest of a corresponding partition to capture a change in data present in the source data set. Based upon the captured data, the data in the target data set is synchronized with the data in the source data set.

Abstract: Synchronization between email, contact management, scheduling (ECS) and customer relationship management (CRM) applications is facilitated through a synchronization module on the ECS side using an Extensible Markup Language (XML) file for keeping track of synchronization states. The CRM server version of an item is compared with the XML file to detect changes and the same performed for the ECS item. The changes are then pushed to the corresponding item for the columns that have changed. Last updated item is selected in case of a conflict.

Abstract: Provided is a storage system which provides a data storage area to an external apparatus. The storage system includes at least a first information apparatus including a first logical storage area constituting the data storage area, and a first data processing part for performing a processing for reducing a storage capacity of the first logical storage area used by backup target data, and a second information apparatus including a second logical storage area constituting the data storage area, and a second data processing part for performing a processing for reducing a storage capacity of the second logical storage area used by backup target data. The second information apparatus is communicatively coupled with the first information apparatus.

Abstract: An information retrieval system having: a client adapted for accessing a plurality of file sets stored on one of a plurality of file servers; a plurality of file servers configured to operate with a federated file system namespace; and a memory for storing re-direction information accessible by the client for identifying a request issued by the client for a file set at a first location in the namespace where the file set is located at a second, different location on one of the file servers and wherein the client in examining the re-direction information in the memory, re-directs the request to the second location in accordance with the re-direction information.

Abstract: Background synchronization of data objects may be provided. A background thread associated with an application may be created. A first data item associated with the application may be opened by the background thread and a copy of the first data item may be created. A modification may be performed on a property of the first data item. If no second data item is associated with a pending modification, the first data item may be replaced with the modified copy of the first data item.

Abstract: It is an object of the present invention to conduct data transfer or data copying between a plurality of storage systems, without affecting the host computer of the storage systems. Two or more auxiliary storage systems 100B, 100C are connected to a primary storage system 100A connected to a host device 180. The auxiliary storage systems 100B, 100C read journals of data update from the primary storage system 100A at respective independent timings, save the journals in prescribed logical volumes JNL 2, JNL 3, produce copying of the data present in the primary storage system 100A based on the journals present in the logical volumes JNL 2, JNL 3 at the independent timings, and save the copies in auxiliary logical volumes COPY 1, COPY 3. The primary storage system 100A holds the journals till both auxiliary storage systems 100B, 100C read the journals and restore. The timing of journal read can be controlled according to the journal quantity, processing load, and the like.

Abstract: User data is shared among servers or server farms, referred to transaction nodes. A user is assigned to one of multiple transaction nodes as its home when the user enrolls in a web-based service. Each transaction nodes maintains records of the users assigned to it, including blocks which are formed when a specified number of new users are assigned. A block hash value is computed based on row hash values, where one row is provided for each user. A transaction node advertises its block identifiers when there is a changed full or partial block, or at other times, to allow other transaction nodes to request a block they do not have. Changed blocks can also be advertised with their recomputed block hash value. Advertisements can be provided to transaction nodes actively accepting new users, and to a subset of transaction nodes which are deactivated and not accepting new users.

Abstract: A communication device includes a database. The database is configured to store data records to be synchronized with a host device and to store, for each record, a corresponding device synchronization parameter (DSP) and a corresponding host synchronization parameter (HSP). The DSP indicates a version number assigned to a current version, of the respective data record, as stored in the database of the device. The HSP indicates a version number assigned to a current version, of the same record, as stored in the host device.

Abstract: The present invention relates to the field of communications technologies, and in particular, to a file synchronization method and device. Through the present invention, two-way synchronization between a device for synchronization and the server can be implemented, thereby improving user experience.

Abstract: An extensible file system format for portable storage media is provided. The extensible file system format includes the specification of primary and secondary directory entry types that may be custom defined. The primary and secondary directory entry types can be further classified as critical and benign directory entries. The directory entry types can define whether a cluster chain corresponding to a file can be contiguously allocated.