Abstract: Managing load in a set of multiple processing modules interconnected by an interconnection network includes: communicating with each of the processing modules in the set, from a load management unit, over respective communication channels that are independent from the interconnection network. In a memory of the load management unit, information is stored indicative of quantities of tasks assigned for execution by respective ones of the processing modules in the set. The load management unit communicates with processing modules in the set over the communication channels to request reassignment of tasks for execution by different processing modules based at least in part on the stored information.