Patents by Inventor Felix Milo Richter

Felix Milo Richter has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240370773
    Abstract: A method for training a machine learning model. The method includes: ascertaining, for each of a plurality of training data elements, a gradient of a target function, wherein the gradient comprises a component for each of a plurality of parameters of the machine learning model; generating an overall gradient by averaging the ascertained gradients component-wise by summing, for each component, the values of the ascertained gradients for this component and by dividing a resulting sum for the component by the number of ascertained gradients for which the component is above a specified threshold value; and adjusting the machine learning model in a direction given by the overall gradient.
    Type: Application
    Filed: April 24, 2024
    Publication date: November 7, 2024
    Inventors: Diane Sabine Staudt, Felix Berkenkamp, Felix Milo Richter, Ilya Kamenshchikov, Valentin Loeffelmann
  • Publication number: 20230130032
    Abstract: A method for generating a state model describing a controllable system. The method includes: providing at least one part of the state model; selecting an action from a set of actions starting from the second state of the components; simulating further states of the components by a successive application of an action from the set of actions to the components in each case, an individual reward being determined for each of the applications of an action to the components; optimizing the at least one part of the state model based on the determined rewards, the optimizing of the at least one part of the state model taking place based on a variance reduction method and a maximum of the determined rewards; and adding the selected action and the second state to the at least one part of the state model.
    Type: Application
    Filed: October 17, 2022
    Publication date: April 27, 2023
    Inventors: Felix Milo Richter, Joel Oren
  • Publication number: 20220146997
    Abstract: A method for training a control strategy with the aid of reinforcement learning. The method includes carrying out passes, in each pass, an action that is to be carried out being selected for each state of a sequence of states of an agent, for at least some of the states the particular action being selected by specifying a planning horizon that predefines a number of states, ascertaining multiple sequences of states, reachable from the particular state, using the predefined number of states, by applying an answer set programming solver to an answer set programming program which models the relationship between actions and the successor states that are reached by the actions, selecting the sequence that delivers the maximum return, and selecting an action as the action for the particular state via which the first state of the selected sequence may be reached, starting from the particular state.
    Type: Application
    Filed: November 4, 2021
    Publication date: May 12, 2022
    Inventors: Daria Stepanova, Johannes Oetsch, Nysret Musliu, Thomas Eiter, Felix Milo Richter
  • Publication number: 20220011748
    Abstract: A method for an industrial system. The method includes: ascertaining a representation of the industrial system, the ascertainment of the representation including: selecting a first state of the representation, selecting, based on the first state, at least one machining order from a plurality of machining orders as a function of the first state of the representation and as a function of at least one previously ascertained recommendation, and ascertaining a second state as a subsequent state of the first state via a simulation of the second state as a function of the at least one selected machining order and as a function of the first state; and ascertaining a manufacturing schedule for the industrial system as a function of the ascertained representation.
    Type: Application
    Filed: July 1, 2021
    Publication date: January 13, 2022
    Inventors: Felix Milo Richter, Maksym Lefarov
  • Publication number: 20210312280
    Abstract: A method for scheduling a set of jobs for a plurality of machines. Each job is defined by at least one feature which characterizes a processing time of the job. If any of the machines is free, a job from of the set of jobs is selected to be carrying out by said machine and scheduled for said machine. The job is selected as follows: a Graph Neural Network receives as input the set of jobs and a current state of at least the machine which is free, the Graph Neural Network outputs a reward for the set of jobs if launched on the machines, which states are inputted into the Graph Neuronal Network, and the job for the free machine is selected depending on the Graph Neural Network output.
    Type: Application
    Filed: February 19, 2021
    Publication date: October 7, 2021
    Inventors: Ayal Taitler, Christian Daniel, Dotan Di Castro, Felix Milo Richter, Joel Oren, Maksym Lefarov, Nima Manafzadeh Dizbin, Zohar Feldman