Patents by Inventor Marthinus Coenraad De Clercq Wentzel

Marthinus Coenraad De Clercq Wentzel has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11836577
    Abstract: A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: December 5, 2023
    Assignee: Amazon Technologies, Inc.
    Inventors: Sunil Mallya Kasaragod, Sahika Genc, Leo Parker Dirac, Bharathan Balaji, Eric Li Sun, Marthinus Coenraad De Clercq Wentzel
  • Patent number: 11429762
    Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: August 30, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Sunil Mallya Kasaragod, Sahika Gene, Leo Parker Dirac, Bharathan Balaji, Eric Li Sun, Marthinus Coenraad De Clercq Wentzel, Brian James Townsend, Pramod Ravikumar Kumar
  • Patent number: 11288415
    Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
    Type: Grant
    Filed: November 27, 2018
    Date of Patent: March 29, 2022
    Assignee: Amazon Technologies, Inc.
    Inventors: Sunil Mallya Kasaragod, Sahika Gene, Leo Parker Dirac, Bharathan Balaji, Eric Li Sun, Marthinus Coenraad De Clercq Wentzel, Brian James Townsend, Pramod Ravikumar Kumar
  • Publication number: 20200167686
    Abstract: A simulation management service receives a request to perform reinforcement learning for a robotic device. The request can include computer-executable code defining a reinforcement function for training a reinforcement learning model for the robotic device. In response to the request, the simulation management service generates a simulation environment and injects the computer-executable code into a simulation application for the robotic device. Using the simulation application and the computer-executable code, the simulation management service performs the reinforcement learning within the simulation environment.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Inventors: Sunil Mallya Kasaragod, Sahika Genc, Leo Parker Dirac, Bharathan Balaji, Eric Li Sun, Marthinus Coenraad De Clercq Wentzel
  • Publication number: 20200167437
    Abstract: A simulation workflow manager obtains a set of parameters for simulation of a system and training of a reinforcement learning model for optimizing an application of the system. In response to obtaining the set of parameters, the simulation workflow manager configures a first compute node that includes a training application for training the reinforcement learning model. The simulation workflow manager also configures a second compute note with a simulation application to perform the simulation of the system in a simulation environment. Data is generated through execution of the simulation in the second compute node that is provided to the first compute node to cause the training application to use the data to train the reinforcement learning model.
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Inventors: Sunil Mallya Kasaragod, Sahika Genc, Leo Parker Dirac, Bharathan Balaji, Eric Li Sun, Marthinus Coenraad De Clercq Wentzel, Brian James Townsend, Pramod Ravikumar Kumar