Abstract: Data reduction services are implemented on one or more nodes of an IIoT data pipeline to intelligently determine an appropriate data reduction strategy based on characteristics of the incoming data. In one or more embodiments, data reduction components on the pipeline node or on an edge device define different data filtering rules or algorithms that are selectively applied to streaming time-series data based on a probability distribution of the data. The data pipeline node performs real-time distribution analysis on the streaming data to determine whether the data has a unimodal distribution, a multimodal distribution, or no mode, and selects one of the data filtering rules based on this determined probability distribution. In this way, the data is intelligently reduced in a manner that retains critical information within the reduced data set while achieving a high level of data reduction.

Abstract: A reactive buffering system for use in IIoT data pipelines dynamically adjusts data accumulation and delivery by a node of a pipeline based on aggregated downstream metrics representing current data processing latencies of downstream nodes. Based on these downstream performance metrics, a reactive node that adjusts the size of the next data batch to be sent to an adjacent downstream node. The nodes of the data pipeline are configured to support a request-response based handshaking protocol whereby the nodes that send data to downstream nodes maintain up-to-date performance level information from adjacent downstream nodes. With this performance information, together with pipeline priorities, the sending node (or reactive node) adjusts the transmission rate and intermediate buffering of data. In this way, the nodes of the pipeline can dynamically regulate interim data storage to avoid overwhelming the pipeline system with too much data during periods of high latency.

Abstract: A reactive buffering system for use in IIoT data pipelines dynamically adjusts data accumulation and delivery by a node of a pipeline based on aggregated downstream metrics representing current data processing latencies of downstream nodes. Based on these downstream performance metrics, a reactive node that adjusts the size of the next data batch to be sent to an adjacent downstream node. The nodes of the data pipeline are configured to support a request-response based handshaking protocol whereby the nodes that send data to downstream nodes maintain up-to-date performance level information from adjacent downstream nodes. With this performance information, together with pipeline priorities, the sending node (or reactive node) adjusts the transmission rate and intermediate buffering of data. In this way, the nodes of the pipeline can dynamically regulate interim data storage to avoid overwhelming the pipeline system with too much data during periods of high latency.

Abstract: Data reduction services are implemented on one or more nodes of an IIoT data pipeline to intelligently determine an appropriate data reduction strategy based on characteristics of the incoming data. In one or more embodiments, data reduction components on the pipeline node or on an edge device define different data filtering rules or algorithms that are selectively applied to streaming time-series data based on a probability distribution of the data. The data pipeline node performs real-time distribution analysis on the streaming data to determine whether the data has a unimodal distribution, a multimodal distribution, or no mode, and selects one of the data filtering rules based on this determined probability distribution. In this way, the data is intelligently reduced in a manner that retains critical information within the reduced data set while achieving a high level of data reduction.