Abstract: A brain machine interface (BMI) to control a device is provided. The BMI has a neural decoder, which is a neural to kinematic mapping function with neural signals as input to the neural decoder and kinematics to control the device as output of the neural decoder. The neural decoder is based on a continuous-time multiplicative recurrent neural network, which has been trained as a neural to kinematic mapping function. An advantage of the invention is the robustness of the decoder to perturbations in the neural data; its performance degrades less—or not at all in some circumstances—in comparison to the current state decoders. These perturbations make the current use of BMI in a clinical setting extremely challenging. This invention helps to ameliorate this problem. The robustness of the neural decoder does not come at the cost of some performance, in fact an improvement in performance is observed.

Abstract: A brain machine interface (BMI) to control a device is provided. The BMI has a neural decoder, which is a neural to kinematic mapping function with neural signals as input to the neural decoder and kinematics to control the device as output of the neural decoder. The neural decoder is based on a continuous-time multiplicative recurrent neural network, which has been trained as a neural to kinematic mapping function. An advantage of the invention is the robustness of the decoder to perturbations in the neural data; its performance degrades less—or not at all in some circumstances—in comparison to the current state decoders. These perturbations make the current use of BMI in a clinical setting extremely challenging. This invention helps to ameliorate this problem. The robustness of the neural decoder does not come at the cost of some performance, in fact an improvement in performance is observed.

Abstract: A method for generating a segmentation of an image that assigns each pixel to a respective segmentation category from a set of segmentation categories is described. The method includes obtaining features of the image, the image including a plurality of pixels. For each of one or more time steps starting from an initial time step and continuing until a final time step, the method includes generating a network input from the features of the image and a current segmentation output as of the time step, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step. The method includes generating a final segmentation of the image from the updated segmentation output.

Abstract: A method for generating a segmentation of an image that assigns each pixel to a respective segmentation category from In a set of segmentation categories is described. The method includes obtaining features of the image, the image including a plurality of pixels. For each of one or more time steps starting from an initial time step and continuing until a final time step, the method includes generating a network input from the features of the image and a current segmentation output as of the time step, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an up dated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step. The method includes generating a final segmentation of the image from the updated segmentation output.

Abstract: A brain machine interface (BMI) to control a device is provided. The BMI has a neural decoder, which is a neural to kinematic mapping function with neural signals as input to the neural decoder and kinematics to control the device as output of the neural decoder. The neural decoder is based on a continuous-time multiplicative recurrent neural network, which has been trained as a neural to kinematic mapping function. An advantage of the invention is the robustness of the decoder to perturbations in the neural data; its performance degrades less—or not at all in some circumstances—in comparison to the current state decoders. These perturbations make the current use of BMI in a clinical setting extremely challenging. This invention helps to ameliorate this problem. The robustness of the neural decoder does not come at the cost of some performance, in fact an improvement in performance is observed.

Abstract: A brain machine interface (BMI) to control a device is provided. The BMI has a neural decoder, which is a neural to kinematic mapping function with neural signals as input to the neural decoder and kinematics to control the device as output of the neural decoder. The neural decoder is based on a continuous-time multiplicative recurrent neural network, which has been trained as a neural to kinematic mapping function. An advantage of the invention is the robustness of the decoder to perturbations in the neural data; its performance degrades less—or not at all in some circumstances—in comparison to the current state decoders. These perturbations make the current use of BMI in a clinical setting extremely challenging. This invention helps to ameliorate this problem. The robustness of the neural decoder does not come at the cost of some performance, in fact an improvement in performance is observed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resizing neural network layers, the method including obtaining data specifying a trained neural network, wherein the neural network comprises one or more neural network layers; reducing a size of one or more of the neural network layers to generate a resized neural network, including: selecting one or more neural network layers for resizing; for each selected neural network layer: determining an effective dimensionality reduction for the neural network layer; based on the determined effective dimensionality reduction, resizing the neural network layer; and retraining the resized neural network.

Abstract: A brain machine interface (BMI) to control a device is provided. The BMI has a neural decoder, which is a neural to kinematic mapping function with neural signals as input to the neural decoder and kinematics to control the device as output of the neural decoder. The neural decoder is based on a continuous-time multiplicative recurrent neural network, which has been trained as a neural to kinematic mapping function. An advantage of the invention is the robustness of the decoder to perturbations in the neural data; its performance degrades less—or not at all in some circumstances—in comparison to the current state decoders. These perturbations make the current use of BMI in a clinical setting extremely challenging. This invention helps to ameliorate this problem. The robustness of the neural decoder does not come at the cost of some performance, in fact an improvement in performance is observed.