Abstract: A method, apparatus, and program product stream data between a host element and a target element in a parallel computing system. The method comprises partitioning data used to perform a task into a plurality of data streams based at least in part upon data associated with the task and partitioning a data stream into a plurality of data stream views based at least in part on a memory size associated with a target element configured to process the data stream. The method further comprises sequentially communicating at least a portion of the data stream views to the target element via a data streaming infrastructure implemented on at least a host element and the target element, wherein the portion of the data streaming infrastructure on the host element transfers the portion of the data stream views to the portion of the data streaming infrastructure on the target element.