Abstract: Methods and systems for performing a training operation of a neural network are provided. In one example, a method comprises: performing backward propagation computations for a second layer of a neural network to generate second weight gradients; splitting the second weight gradients into portions; causing a hardware interface to exchange a first portion of the second weight gradients with the second computer system; performing backward propagation computations for a first layer of the neural network to generate first weight gradients when the exchange of the first portion of the second weight gradients is underway, the first layer being a lower layer than the second layer in the neural network; causing the hardware interface to transmit the first weight gradients to the second computer system; and causing the hardware interface to transmit the remaining portions of the second weight gradients to the second computer system.

Abstract: A system records information relating to performing a logical activity on a group of devices. The information includes information transmitted to each device in the group of devices and information received from each device in the group of devices. The system also uses the recorded information for troubleshooting purposes.

Abstract: A system includes a relational database and processing logic. The relational database is configured to define a relationship between a group of logical activities and groups of physical commands that perform the logical activities. The processing logic is configured to receive a request to perform one logical activity of the group of logical activities, translate the one logical activity into one group of physical commands using the relational database, and cause the one logical activity to be performed on a remote device using the one group of physical commands.

Abstract: A system includes a relational database and processing logic. The relational database is configured to define a relationship between users and a group of device groups to which the users are permitted access. The processing logic is configured to receive identification information from a user, identify one or more device groups using the relational database and the user identification information, construct a first graphical user interface using the one or more device groups, and provide the first graphical user interface to the user.