Abstract: A controller in a distributed information technology system provides an end-of-batch indication for a batch of initial data to be processed by at least one first processing node. The controller receives a completion indication indicating that the at least one first processing node has completed processing the batch of initial data resulting in one or more batches of intermediate data. The controller provides an end-of-batch indication for each of the one or more batches of intermediate data to be processed by one or more second processing nodes of the plurality of processing nodes. The controller receives a completion indication indicating that the at least one second processing node has completed processing the batch of intermediate data resulting in a batch of final data and generates a control signal indicating that the batch processing has been completely processed.