Patents by Inventor Mark Bishop Ring

Mark Bishop Ring has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12354027
    Abstract: A method and system for teaching an artificial intelligent agent where the agent can be placed in a state that it would like it to learn how to achieve. By giving the agent several examples, it can learn to identify what is important about these example states. Once the agent has the ability to recognize a goal configuration, it can use that information to then learn how to achieve the goal states on its own. An agent may be provided with positive and negative examples to demonstrate a goal configuration. Once the agent has learned certain goal configurations, the agent can learn policies and skills that achieve the learned goal configuration. The agent may create a collection of these policies and skills from which to select based on a particular command or state.
    Type: Grant
    Filed: April 3, 2018
    Date of Patent: July 8, 2025
    Assignee: SONY GROUP CORPORATION
    Inventors: Mark Bishop Ring, Satinder Baveja, Peter Stone, James MacGlashan, Samuel Barrett, Roberto Capobianco, Varun Kompella, Kaushik Subramanian, Peter Wurman
  • Patent number: 11443229
    Abstract: A method and system for teaching an artificial intelligent agent includes giving the agent several examples where it can learn to identify what is important about these example states. Once the agent has the ability to recognize a goal configuration, it can use that information to then learn how to achieve the goal states on its own. An agent may be provided with positive and negative examples to demonstrate a goal configuration. Once the agent has learned certain goal configurations, the agent can learn an option to achieve the goal configuration and a distance function that predicts at least one of a distance and a duration to the goal configuration under the learned option. This distance function prediction may be incorporated as a state feature of the agent.
    Type: Grant
    Filed: August 31, 2018
    Date of Patent: September 13, 2022
    Assignees: Sony Group Corporation, Sony Corporation of America
    Inventors: Mark Bishop Ring, Satinder Baveja, Roberto Capobianco, Varun Kompella, Kaushik Subramanian, James MacGlashan
  • Publication number: 20200074349
    Abstract: A method and system for teaching an artificial intelligent agent includes giving the agent several examples where it can learn to identify what is important about these example states. Once the agent has the ability to recognize a goal configuration, it can use that information to then learn how to achieve the goal states on its own. An agent may be provided with positive and negative examples to demonstrate a goal configuration. Once the agent has learned certain goal configurations, the agent can learn an option to achieve the goal configuration and a distance function that predicts at least one of a distance and a duration to the goal configuration under the learned option. This distance function prediction may be incorporated as a state feature of the agent.
    Type: Application
    Filed: August 31, 2018
    Publication date: March 5, 2020
    Inventors: Mark Bishop RING, Satinder BAVEJA, Roberto CAPOBIANCO, Varun KOMPELLA, Kaushik SUBRAMANIAN, James MACGLASHAN
  • Publication number: 20190303776
    Abstract: A method and system for teaching an artificial intelligent agent where the agent can be placed in a state that it would like it to learn how to achieve. By giving the agent several examples, it can learn to identify what is important about these example states. Once the agent has the ability to recognize a goal configuration, it can use that information to then learn how to achieve the goal states on its own. An agent may be provided with positive and negative examples to demonstrate a goal configuration. Once the agent has learned certain goal configurations, the agent can learn policies and skills that achieve the learned goal configuration. The agent may create a collection of these policies and skills from which to select based on a particular command or state.
    Type: Application
    Filed: April 3, 2018
    Publication date: October 3, 2019
    Applicant: COGITAI, INC.
    Inventors: Mark Bishop RING, Satinder BAVEJA, Peter STONE, James MACGLASHAN, Samuel BARRETT, Roberto CAPOBIANCO, Varun KOMPELLA, Kaushik SUBRAMANIAN, Peter WURMAN
  • Patent number: 9311600
    Abstract: A method and system comprise providing means and method for producing, modifying, and/or exploiting the structure of a policy manifold. Each of the policies at least comprises information for mapping state and/or sensory information as input to action preferences as output. One or more processing units assign each of the policies a policy coordinate on a policy manifold. The policy coordinate may in part be determined by a dissimilarity matrix or other means for organizing the coordinates of the policies on the policy manifold according to the properties of the policies and the topology of the policy manifold. The policy manifold comprises a dimensionality that is lower than a combined dimensionality of the input and the output, wherein the policy manifold at least in part determines a behavior of the intelligent artificial agent.
    Type: Grant
    Filed: June 2, 2013
    Date of Patent: April 12, 2016
    Inventor: Mark Bishop Ring