Abstract: A network for parallel processing for high performance parallel processing systems. Such a network solves the network communication problem by making use, in its nodes, of large size memory units capable of being simultaneously accessed by several processing units installed on the network edges intersecting that node. The processing units provide a large number of high performance virtual processors performing processing operations on both the two memories between which the processing unit is connected and transfer operations therebetween.