Abstract: A coherence protocol applied to memory pages maintains coherence between memory spaces on a plurality of nodes so that the threads of the runtime are operable on any of the nodes. The nodes operating according to the coherence protocol track a state and an epoch number for each memory page residing therein. The states include a modified state in which only one particular node has an up-to-date copy of the memory page, an exclusive state in which only one particular node owns the memory page, a shared state in which all nodes that have the memory page in the shared state have the same copy, and a lost state in which the memory page cannot be either read or written. The epoch number is a number that is incremented each time the page enters the modified state and is used to determine whether the page contains data that is stale.

Abstract: A coherence protocol applied to memory pages maintains coherence between memory spaces on a plurality of nodes so that the threads of the runtime are operable on any of the nodes. The nodes operating according to the coherence protocol track a state and an epoch number for each memory page residing therein. The states include a modified state in which only one particular node has an up-to-date copy of the memory page, an exclusive state in which only one particular node owns the memory page, a shared state in which all nodes that have the memory page in the shared state have the same copy, and a lost state in which the memory page cannot be either read or written. The epoch number is a number that is incremented each time the page enters the modified state and is used to determine whether the page contains data that is stale.

Abstract: A computer system, method, and computer readable product are provided for adaptive parallelism of workload execution on computers with accelerators. In various embodiments, information about both static and dynamic characteristics of computational accelerators for a plurality of computers is received. Based on this information, waves of a workload is divided among this plurality of computers for processing. As the dynamic characteristics of those computational accelerators change over time, future waves may be divided among this plurality of computers differently.

Abstract: A computer system, method, and computer readable product are provided for adaptive parallelism of workload execution on computers with accelerators. In various embodiments, information about both static and dynamic characteristics of computational accelerators for a plurality of computers is received. Based on this information, waves of a workload is divided among this plurality of computers for processing. As the dynamic characteristics of those computational accelerators change over time, future waves may be divided among this plurality of computers differently.