Abstract: Approaches presented herein provide for the real-time backhauling of data streams direct to memory. In at least one embodiment, a host device can initiate a Remote Direct Memory Access (RDMA) transmission with a remote device for sensor data streams. Initialization data for the RDMA transmission can be sent from the host to the remote device, such as over an existing physical Ethernet or InfiniBand (IB) connection. The host device can enter a Ready-to-Receive (RTR) state and send instructions to the remote device to enter a Ready-to-Send (RTS) state. The RDMA transmission can be initialized between the host device and the remote device to transfer streaming data. Using a remote data manager, the streaming data can be sent over the existing Ethernet connection as a RDMA transmission and written directly to allocated memory. The system may be scaled to include higher throughput sensors, additional sensors, and multiple remote transmission devices.

Abstract: Approaches presented herein provide for the real-time backhauling of data streams direct to memory. In at least one embodiment, a host device can initiate a Remote Direct Memory Access (RDMA) transmission with a remote device for sensor data streams. Initialization data for the RDMA transmission can be sent from the host to the remote device, such as over an existing physical Ethernet or InfiniBand (IB) connection. The host device can enter a Ready-to-Receive (RTR) state and send instructions to the remote device to enter a Ready-to-Send (RTS) state. The RDMA transmission can be initialized between the host device and the remote device to transfer streaming data. Using a remote data manager, the streaming data can be sent over the existing Ethernet connection as a RDMA transmission and written directly to allocated memory. The system may be scaled to include higher throughput sensors, additional sensors, and multiple remote transmission devices.

Abstract: A method for processing includes receiving a definition of a processing pipeline including multiple sequential processing stages. The processing pipeline is partitioned into a plurality of partitions. The first partition of the processing pipeline is executed on a first computational accelerator, whereby the first computational accelerator writes output data from a final stage of the first partition to an output buffer in a first memory. The output data are copied over a packet communication network to an input buffer in a second memory. The second partition of the processing pipeline is executed on a second computational accelerator using the copied output data in the second memory as input data to a first stage of the second partition.

Abstract: A method for processing includes receiving a definition of a processing pipeline including multiple sequential processing stages. The processing pipeline is partitioned into a plurality of partitions. The first partition of the processing pipeline is executed on a first computational accelerator, whereby the first computational accelerator writes output data from a final stage of the first partition to an output buffer in a first memory. The output data are copied over a packet communication network to an input buffer in a second memory. The second partition of the processing pipeline is executed on a second computational accelerator using the copied output data in the second memory as input data to a first stage of the second partition.

Abstract: A method of managing remote direct memory access (RDMA) to a virtual computing instance includes suspending locally initiated RDMA operations of the virtual computing instance executing on a first host prior to a migration of the virtual computing instance to a second host. The first host includes a first hypervisor and the second host includes a second hypervisor. The method further includes requesting a peer to suspend remotely initiated RDMA operations that target the virtual computing instance through a first channel, establishing after the migration, a second channel between the peer and the second hypervisor that supports execution of the virtual computing instance on the second host, configuring a virtual object of the second hypervisor on the second host to use the second channel for the locally initiated RDMA operations, and requesting the peer to resume the remotely initiated RDMA operations using the second channel.

Abstract: A method of managing remote direct memory access (RDMA) to a virtual computing instance includes suspending locally initiated RDMA operations of the virtual computing instance executing on a first host prior to a migration of the virtual computing instance to a second host. The first host includes a first hypervisor and the second host includes a second hypervisor. The method further includes requesting a peer to suspend remotely initiated RDMA operations that target the virtual computing instance through a first channel, establishing after the migration, a second channel between the peer and the second hypervisor that supports execution of the virtual computing instance on the second host, configuring a virtual object of the second hypervisor on the second host to use the second channel for the locally initiated RDMA operations, and requesting the peer to resume the remotely initiated RDMA operations using the second channel.