Abstract: Systems and methods are directed to monitoring and managing a health of a content processing data ingestion pipeline. In example embodiments, a plurality of content elements are ingested from a source to a destination through the ingestion pipeline, whereby the ingestion pipeline comprises a plurality of nodes between the source and the destination. A data management system detects a gap in the ingestion pipeline. The gap indicates a difference associated with a content element of the plurality of content elements between a first node and a second node of the ingestion pipeline. In response to detecting the gap, the data management system automatically triggers reingesting of the content element from the first node. The data management system also determines, based on monitoring of the ingestion pipeline, the health of the ingestion pipeline and provides a dashboard that graphically represents the health.

Abstract: Systems and methods are directed to monitoring and managing a health of a content processing data ingestion pipeline. In example embodiments, a plurality of content elements are ingested from a source to a destination through the ingestion pipeline, whereby the ingestion pipeline comprises a plurality of nodes between the source and the destination. A data management system detects a gap in the ingestion pipeline. The gap indicates a difference associated with a content element of the plurality of content elements between a first node and a second node of the ingestion pipeline. In response to detecting the gap, the data management system automatically triggers reingesting of the content element from the first node. The data management system also determines, based on monitoring of the ingestion pipeline, the health of the ingestion pipeline and provides a dashboard that graphically represents the health.

Abstract: Technologies are described herein for providing efficient in-place preservation of content in multiple, disparate content sources without disrupting end-users' access to the content or content sources. A preservation request comprising a specification of a content source and a filter specification is received and the content source is marked as “on hold.” If a content item in the content source is modified or deleted, a copy of the current version of the content item is placed in a preservation storage area. A trim job may be run periodically that removes content items from the preservation storage area that do not match the filter specification.

Abstract: Systems and methods for implementing a query-based hold on electronic items hosted by a communication device and/or system. Electronic items from a plurality of user-specific folders are purged and copied to a discovery hold folder. The purged items, along with all existing items, contained within the discovery hold folder are evaluated against the query-based hold criteria. Items that fail to meet the query-based hold criteria are permanently deleted from the discovery hold folder. Items that meet the query-based hold criteria are maintained within discovery hold folder.