Abstract: Methods for synchronizing a source document repository with a target document repository include monitoring documents of the source document repository to detect changes to the documents. A last processed time is stored in association each changed document that indicates a time when the document was last processed. A transaction item is added to a synchronization queue each time a document is changed, and a queue time is stored in association with each of the transaction items that indicates when the transaction item was added to the queue. The transaction items are processed by comparing the queue time of the transaction item with the last processed time of the document pertaining to the transaction item. If the queue time is earlier than the last processed time, the transaction item is ignored.

Abstract: Documents maintained by a first storage system that supports security groups are synchronized to a second storage system that supports group entities, which are incompatible with security groups. Permissions associated with the synchronized documents, including security groups, can be synchronized from the first storage system to the second storage system when a security group is created, when membership in a security group is modified, and when a security group is deleted. Synchronization of security groups in this manner can also be selectively enabled on a per-site basis or at another level of granularity.

Abstract: A data processing system implements identifying one-way correctness issues in datasets of large computing systems including a first computing system and a second computing system. The second computing system is associated with a dependent dataset that includes references to data in a second datastore associated with the first computing system. These references updated in response to changes to the data referred to by these references. However, errors can cause the two datasets to become out of sync. The system herein implements automatically identifying unattached items in a dependent dataset that references items in a reference dataset that is no longer present in the reference dataset by comparing the dependent dataset with the reference dataset, and automatically causing the second computing system to delete the unattached items from the dependent dataset.

Abstract: Systems and methods for synchronizing a source document repository with a target document repository include monitoring documents of the source document repository to detect changes to the documents. A last processed time is stored in association each changed document that indicates a time when the document was last processed. A transaction item is added to a synchronization queue each time a document is changed, and a queue time is stored in association with each of the transaction items that indicates when the transaction item was added to the queue. The transaction items are processed by comparing the queue time of the transaction item with the last processed time of the document pertaining to the transaction item. If the queue time is earlier than the last processed time, the transaction item is ignored. If the queue time is not earlier than the last processed time, the document pertaining to the transaction item is synchronized to the target document repository.

Abstract: Systems and methods for reprocessing documents in a database system include receiving job definitions performing reprocessing operations on documents in the database system, and generating recrawl jobs based on the job definitions. The recrawl jobs are flighted to the database system. Iterations of recrawl timer jobs are generated for each of the databases based on a predefined recrawl timer job base class. Each of the recrawl timer job iterations being configured to access a recrawl job list for the one of the databases and access a property list for the databases to identify recrawl job information stored in the property list. Based on the recrawl job information, a respective batch of documents to be reprocessed in association with each of the recrawl jobs on the recrawl job list is selected. The batches of documents are then reprocessed in accordance with the recrawl jobs. The recrawl job information is then updated based on the completion of the batches.