Abstract: In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited. A Bayesian nonparametric framework is presented for federated learning with neural networks. Each data server is assumed to provide local neural network weights, which are modeled through our framework. An inference approach is presented that allows us to synthesize a more expressive global network without additional supervision, data pooling and with as few as a single communication round. The efficacy of the present invention on federated learning problems simulated from two popular image classification datasets is shown.

Abstract: A method for training control software to reinforce safety constraints using visual inputs includes performing template matching for each object in an image of a reinforcement learning (RL) agent's action space using a visual template for each object wherein each object in the RL agent's action space is detected, mapping each detected object to a set of planar coordinates for each object in the RL agent's action space, determining a set of safe actions for the RL agent by applying a safety specification for the RL agent's action space to the set of variables for coordinates for each object in the RL agent's action space, outputting the set of safe actions to the RL agent for a current state of a RL procedure, and preventing the RL agent from executing an action that is unsafe, before the RL agent takes an action.

Abstract: Embodiments of the disclosure provide a reinforcement learning model configured to receive state data (e.g., image state data) and determine candidate actions (e.g., environment navigation actions, environment modification actions, etc.) based on the received state data. Embodiments of the disclosure further provide an object detector configured to generate symbolic state data (e.g., safety relevant data) from the state data. Accordingly, as described herein, a safety system can update a dynamical safety constraint based on the symbolic state data, as well as filter the actions determined by the reinforcement learning model and select an action to be executed based on the dynamical safety constraint. For instance, the safety system classifies each action (e.g., each candidate action determined by the reinforcement learning model) in each symbolic state as either “safe” or “not safe” based on the dynamical safety constraint (e.g., and a safe action may be selected and executed).

Abstract: A method for training control software to reinforce safety constraints using visual inputs includes performing template matching for each object in an image of a reinforcement learning (RL) agent's action space using a visual template for each object wherein each object in the RL agent's action space is detected, mapping each detected object to a set of planar coordinates for each object in the RL agent's action space, determining a set of safe actions for the RL agent by applying a safety specification for the RL agent's action space to the set of variables for coordinates for each object in the RL agent's action space, outputting the set of safe actions to the RL agent for a current state of a RL procedure, and preventing the RL agent from executing an action that is unsafe, before the RL agent takes an action.

Abstract: In federated learning problems, data is scattered across different servers and exchanging or pooling it is often impractical or prohibited. A Bayesian nonparametric framework is presented for federated learning with neural networks. Each data server is assumed to provide local neural network weights, which are modeled through our framework. An inference approach is presented that allows us to synthesize a more expressive global network without additional supervision, data pooling and with as few as a single communication round. The efficacy of the present invention on federated learning problems simulated from two popular image classification datasets is shown.