Patents by Inventor Luke Benjamin Hudlass-Galley

Luke Benjamin Hudlass-Galley has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • System having multiple processing unit sets for training neural networks
    Patent number: 11651226
    Abstract: A data processing system for training a neural network, the data processing system comprising: a first set of one or more processing units running one model of the neural network, a second set of one or more processing units running another model of the neural network, a data storage, and an interconnect between the first set of one or more processing units, the second set of processing units and the data storage, wherein the data storage is configured to provide over the interconnect, training data to the first set of one or more processing units and the second set of one more processing units, wherein each of the first and second set of processing units is configured to, when performing the training, evaluate loss for the respective training iteration including a measure of the dissimilarity between the output values calculated based on the different modes running on the first and second set of processing units, wherein the dissimilarity measure is weighted in the evaluation of the loss in accordance with a
    Type: Grant
    Filed: February 12, 2020
    Date of Patent: May 16, 2023
    Assignee: GRAPHCORE LIMITED
    Inventors: Helen Byrne, Luke Benjamin Hudlass-Galley, Carlo Luschi
  • System Having Multiple Processing Unit Sets For Training Neural Networks
    Publication number: 20210241093
    Abstract: A data processing system for training a neural network, the data processing system comprising: a first set of one or more processing units running one model of the neural network, a second set of one or more processing units running another model of the neural network, a data storage, and an interconnect between the first set of one or more processing units, the second set of processing units and the data storage, wherein the data storage is configured to provide over the interconnect, training data to the first set of one or more processing units and the second set of one more processing units, wherein each of the first and second set of processing units is configured to, when performing the training, evaluate loss for the respective training iteration including a measure of the dissimilarity between the output values calculated based on the different modes running on the first and second set of processing units, wherein the dissimilarity measure is weighted in the evaluation of the loss in accordance with a
    Type: Application
    Filed: February 12, 2020
    Publication date: August 5, 2021
    Inventors: Helen Byrne, Luke Benjamin Hudlass-Galley, Carlo Luschi
  • System Having Multiple Processing Unit Sets For Training Neural Networks
    Publication number: 20210241089
    Abstract: A data processing system for training a neural network, the data processing system comprising: a first set of one or more processing units, a second set of one or more processing units, a data storage, and an interconnect between the first set of one or more processing units, the second set of processing units and the data storage, wherein the data storage is configured to provide over the interconnect, training data to the first set of one or more processing units and the second set of one more processing units, wherein each of the first and second set of processing units is configured to, when performing the training, evaluate loss for the respective training iteration including a metric measuring the dissimilarity between the output values calculated by the first and second set of processing units, wherein the metric is weighted in the evaluation of the loss in accordance with a parameter that is updated between different training iterations.
    Type: Application
    Filed: January 30, 2020
    Publication date: August 5, 2021
    Inventors: Helen Byrne, Luke Benjamin Hudlass-Galley, Carlo Luschi