Abstract: A method and apparatus of a device that trains or evaluates a model is described. In an exemplary embodiment, the device creates a loop network between a central aggregating node and a set of one or more worker nodes, where the loop network communicatively couples the central aggregating node. The device further receives and broadcasts a model training or evaluation request from one of the nodes in the loop network to one or more other nodes in the loop network.