Patents by Inventor Richard Hanes

Richard Hanes has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12282839
    Abstract: A method including receiving a pre-determined constraint on user actions. A constraint vector is generated based on the pre-determined constraint. The constraint vector is input into a machine learning model. A first output is generated from the machine learning model by executing the machine learning model using the constraint vector as a first input to the machine learning model. The constraint vector is converted into a legal action mask. A probability vector is generated by executing a masked softmax operator. The masked softmax operator takes, as a second input, the first output. The masked softmax operator takes, as a third input, the legal action mask. The masked softmax operator generates, as a second output, the probabilities vector. Action outputs are generated by applying a sampling system to the probability vector. The action outputs include a subset of the user actions, and wherein the subset includes only allowed user actions.
    Type: Grant
    Filed: November 17, 2021
    Date of Patent: April 22, 2025
    Assignee: The Boeing Company
    Inventors: Joshua G. Fadaie, Richard Hanes
  • Patent number: 11586200
    Abstract: A method includes receiving, by machine-learning logic, observations indicative of a states associated with a first and second group of vehicles arranged within an engagement zone during a first interval of an engagement between the first and the second group of vehicles. The machine-learning logic determines actions based on the observations that, when taken simultaneously by the first group of vehicles during the first interval, are predicted by the machine-learning logic to result in removal of one or more vehicles of the second group of vehicles from the engagement zone during the engagement. The machine-learning logic is trained using a reinforcement learning technique and on simulated engagements between the first and second group of vehicles to determine sequences of actions that are predicted to result in one or more vehicles of the second group being removed from the engagement zone. The machine-learning logic communicates the plurality of actions to the first group of vehicles.
    Type: Grant
    Filed: June 22, 2020
    Date of Patent: February 21, 2023
    Assignees: The Boeing Company, HRL Laboratories LLC
    Inventors: Joshua G. Fadaie, Richard Hanes, Chun Kit Chung, Sean Soleyman, Deepak Khosla
  • Publication number: 20220164636
    Abstract: A method including receiving a pre-determined constraint on user actions. A constraint vector is generated based on the pre-determined constraint. The constraint vector is input into a machine learning model. A first output is generated from the machine learning model by executing the machine learning model using the constraint vector as a first input to the machine learning model. The constraint vector is converted into a legal action mask. A probability vector is generated by executing a masked softmax operator. The masked softmax operator takes, as a second input, the first output. The masked softmax operator takes, as a third input, the legal action mask. The masked softmax operator generates, as a second output, the probabilities vector. Action outputs are generated by applying a sampling system to the probability vector. The action outputs include a subset of the user actions, and wherein the subset includes only allowed user actions.
    Type: Application
    Filed: November 17, 2021
    Publication date: May 26, 2022
    Applicant: The Boeing Company
    Inventors: Joshua G. Fadaie, Richard Hanes
  • Publication number: 20210397179
    Abstract: A method includes receiving, by machine-learning logic, observations indicative of a states associated with a first and second group of vehicles arranged within an engagement zone during a first interval of an engagement between the first and the second group of vehicles. The machine-learning logic determines actions based on the observations that, when taken simultaneously by the first group of vehicles during the first interval, are predicted by the machine-learning logic to result in removal of one or more vehicles of the second group of vehicles from the engagement zone during the engagement. The machine-learning logic is trained using a reinforcement learning technique and on simulated engagements between the first and second group of vehicles to determine sequences of actions that are predicted to result in one or more vehicles of the second group being removed from the engagement zone. The machine-learning logic communicates the plurality of actions to the first group of vehicles.
    Type: Application
    Filed: June 22, 2020
    Publication date: December 23, 2021
    Inventors: Joshua G. Fadaie, Richard Hanes, Chun Kit Chung, Sean Soleyman, Deepak Khosla