Abstract: The technology disclosed herein pertains to a system and method for scaling storage using peer-to-peer NVMe communication, the method including selecting one of a plurality of NVMe devices as principal device to control communication with a host via a PCI switch, designating remainder of the plurality of NVMe devices as subordinate devices, and controlling the communication between the host and the subordinate devices using a PCI P2P DMA between the principal device and the subordinate devices.

Abstract: A data storage system employing distributed memories can have at least one host connected to a plurality of data storage devices via a network controller. One or more performance bottlenecks through the network controller may be identified with a performance module. A peer group consisting of at least two of the plurality of data storage devices is created with the performance module in response to the identified performance bottleneck so that a task can be assigned by the performance module to the peer group. The task may be chosen to mitigate the performance bottleneck by avoiding involvement of the network controller in the task.

Abstract: Method and apparatus for offloading upstream processing tasks to peer groups of downstream data storage devices. A peer control circuit forms a peer group of storage devices in response to a detected processing bottleneck associated with a network controller. One of the storage devices in the peer group is designated as a primary device, and is responsible for interface communications, for subdividing the processing task for execution by secondary devices in the peer group, and coordinating overall execution. The peer group and the processing task are selected to avoid or minimize the processing bottleneck at the network controller level while maintaining ongoing data transfer performance at the storage device level. A list of available device resources and capabilities may be maintained by the peer control circuit. Offloaded tasks can include data rebuilds, cryptographic functions, new device authentication operations, and the like. Multiple overlapping peer groups can be formed as needed.