Patents by Inventor Ruofan Kong

Ruofan Kong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240051128
    Abstract: The techniques disclosed herein enable a machine learning model to learn a termination condition of a sub-task. A sub-task is one of a number of sub-tasks that, when performed in sequence, accomplish a long-running task. A machine learning model used to perform the sub-task is augmented to also provide a termination signal. The termination signal indicates whether the sub-task's termination condition has been met. Monitoring the termination signal while performing the sub-task enables subsequent sub-tasks to seamlessly begin at the appropriate time. A termination condition may be learned from the same data used to train other model outputs. In some configurations, the model learns whether a sub-task is complete by periodically attempting subsequent sub-tasks. If a subsequent sub-task can be performed, positive reinforcement is provided for the termination condition. The termination condition may also be trained using synthetic scenarios designed to test when the termination condition has been met.
    Type: Application
    Filed: December 5, 2022
    Publication date: February 15, 2024
    Inventors: Kartavya NEEMA, Kazuhiro SASABUCHI, Aydan AKSOYLAR, Naoki WAKE, Jun TAKAMATSU, Ruofan KONG, Marcos de MOURA CAMPOS, Victor SHNAYDER, Brice Hoani Valentin CHUNG, Katsushi IKEUCHI
  • Patent number: 11775850
    Abstract: The AI engine has a first module that chooses from a library of algorithms to use when automatically assembling and building different learning topologies to solve different concepts making up a resulting AI model. The AI engine may integrate both i) one or more dynamic programming training algorithms and ii) one or more policy optimization algorithms, to build the different learning topologies to solve the different concepts contained with an AI model in order to solve a wide variety of problem types. Each concept contained in the AI model can use a most appropriate approach for achieving a mission of that concept. A learning topology representing a first concept can be built by the first module with a first dynamic programming training algorithm, while a learning topology representing a second concept in the same AI model can be built by the first module with a first policy optimization algorithm.
    Type: Grant
    Filed: August 16, 2018
    Date of Patent: October 3, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Marcos Campos, Aditya Gudimella, Ruofan Kong, Matthew Brown
  • Patent number: 11120365
    Abstract: Methods and apparatuses that apply a hierarchical-decomposition reinforcement learning technique to train one or more AI objects as concept nodes composed in a hierarchical graph incorporated into an AI model. The individual sub-tasks of a decomposed task may correspond to its own concept node in the hierarchical graph and are initially trained on how to complete their individual sub-task and then trained on how the all of the individual sub-tasks need to interact with each other in the complex task in order to deliver an end solution to the complex task. Next, during the training, using reward functions focused for solving each individual sub-task and then a separate one or more reward functions focused for solving the end solution of the complex task. In addition, where reasonably possible, conducting the training of the AI objects corresponding to the individual sub-tasks in the complex task, in parallel at the same time.
    Type: Grant
    Filed: June 14, 2018
    Date of Patent: September 14, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Marcos Campos, Aditya Gudimella, Ross Story, Matineh Shaker, Ruofan Kong, Matthew Brown, Victor Shnayder
  • Patent number: 11100423
    Abstract: Provided herein in some embodiments is an artificial intelligence (“AI”) engine hosted on one or more remote servers configured to cooperate with one or more databases including one or more AI-engine modules and one or more server-side client-server interfaces. The one or more AI-engine modules include an instructor module and a learner module configured to train an AI model. An assembly code can be generated from a source code written in a pedagogical programming language describing a mental model of one or more concept modules to be learned by the AI model and curricula of one or more lessons for training the AI model. The one or more server-side client-server interfaces can be configured to enable client interactions from a local client such as submitting the source code for training the AI model and using the trained AI model for one or more predictions.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: August 24, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, Megan Adams
  • Patent number: 10803401
    Abstract: The multiple independent processes run in an AI engine on its cloud-based platform. The multiple independent processes are configured as an independent process wrapped in its own container so that multiple instances of the same processes can run simultaneously to scale to handle one or more users to perform actions. The actions to solve AI problems can include 1) running multiple training sessions on two or more AI models at the same time, 2) creating two or more AI models at the same time, 3) running a training session on one or more AI models while creating one or more AI models at the same time, 4) deploying and using two or more trained AI models to do predictions on data from one or more data sources, 5) etc. A service handles scaling by dynamically calling in additional computing devices to load on and run additional instances of one or more of the independent processes as needed.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: October 13, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Shane Arney, Matthew Haigh, Jett Evan Jones, Matthew James Brown, Ruofan Kong, Chetan Desh
  • Patent number: 10733531
    Abstract: Provided herein in some embodiments is an artificial intelligence (“AI”) engine hosted on one or more servers configured to cooperate with one or more databases including one or more AI-engine modules. The one or more AI-engine modules include an architect module configured to propose an AI model from an assembly code. The assembly code can be generated from a source code written in a pedagogical programming language describing a mental model of one or more concept modules to be learned by the AI model and curricula of one or more lessons for training the AI model on the one or more concept modules in one or more training cycles. The AI engine can be configured to instantiate a trained AI model based on the one or more concept modules learned by the AI model in the one or more training cycles.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: August 4, 2020
    Assignee: Bonsai AI, Inc.
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, Megan Adams
  • Patent number: 10586173
    Abstract: An AI database hosted on cloud platform is configured to cooperate with a search engine and an AI engine. The AI database stores and indexes trained AI objects and its class of AI objects have searchable criteria. The AI database cooperates with the search engine to utilize search criteria supplied from a user, from either or both 1) via scripted software code and 2) via data put into defined fields of a user interface. The search engine utilizes the search criteria in order for the search engine to retrieve one or more AI data objects that have already been trained as query results. The AI database is coupled to an AI engine to allow any of reuse, reconfigure ability, and recomposition of the one or more trained AI data objects from the AI database into a new trained AI model.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: March 10, 2020
    Assignee: Bonsai AI, Inc.
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, William Guss, Ross Story
  • Patent number: 10540613
    Abstract: An AI database hosted on cloud platform is configured to cooperate with a search engine and an AI engine. The AI database stores and indexes trained AI objects and its class of AI objects have searchable criteria. The AI database cooperates with the search engine to utilize search criteria supplied from a user, from either or both 1) via scripted software code and 2) via data put into defined fields of a user interface. The search engine utilizes the search criteria in order for the search engine to retrieve one or more AI data objects that have already been trained as query results. The AI database is coupled to an AI engine to allow any of reuse, reconfigure ability, and recomposition of the one or more trained AI data objects from the AI database into a new trained AI model.
    Type: Grant
    Filed: January 26, 2017
    Date of Patent: January 21, 2020
    Assignee: Bonsai AI, Inc.
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, William Guss, Ross Story
  • Publication number: 20180357552
    Abstract: The AI engine has a first module that chooses from a library of algorithms to use when automatically assembling and building different learning topologies to solve different concepts making up a resulting AI model. The AI engine may integrate both i) one or more dynamic programming training algorithms and ii) one or more policy optimization algorithms, to build the different learning topologies to solve the different concepts contained with an AI model in order to solve a wide variety of problem types. Each concept contained in the AI model can use a most appropriate approach for achieving a mission of that concept. A learning topology representing a first concept can be built by the first module with a first dynamic programming training algorithm, while a learning topology representing a second concept in the same AI model can be built by the first module with a first policy optimization algorithm.
    Type: Application
    Filed: August 16, 2018
    Publication date: December 13, 2018
    Applicant: Bonsai AI, Inc.
    Inventors: Marcos Campos, Aditya Gudimella, Ruofan Kong, Matthew Brown
  • Publication number: 20180357543
    Abstract: An AI engine configured for measuring training accuracy of one or more AI models over time is disclosed. The AI engine includes, in some embodiments, one or more AI-engine modules including an instructor module, a learner module, and an assessor module. The instructor module is configured to coordinate training for each AI model of the one or more AI models with a corresponding simulator. The learner module is configured to train each AI model with the corresponding simulator on one or more concepts of a mental model defined in a pedagogical programming language. The assessor module is configured to determine when each AI model is sufficiently trained on at least a concept of the mental model by measuring the training accuracy of the AI model over time. The assessor module is also configured to terminate the training of each AI model by ending any simulations of the corresponding simulator.
    Type: Application
    Filed: August 16, 2018
    Publication date: December 13, 2018
    Applicant: Bonsai AI, Inc.
    Inventors: Matthew Brown, Marcos Campos, Ruofan Kong
  • Publication number: 20180293498
    Abstract: Methods and apparatuses that apply a hierarchical-decomposition reinforcement learning technique to train one or more AI objects as concept nodes composed in a hierarchical graph incorporated into an AI model. The individual sub-tasks of a decomposed task may correspond to its own concept node in the hierarchical graph and are initially trained on how to complete their individual sub-task and then trained on how the all of the individual sub-tasks need to interact with each other in the complex task in order to deliver an end solution to the complex task. Next, during the training, using reward functions focused for solving each individual sub-task and then a separate one or more reward functions focused for solving the end solution of the complex task. In addition, where reasonably possible, conducting the training of the AI objects corresponding to the individual sub-tasks in the complex task, in parallel at the same time.
    Type: Application
    Filed: June 14, 2018
    Publication date: October 11, 2018
    Inventors: Marcos CAMPOS, Aditya GUDIMELLA, Ross STORY, Martineh SHAKER, Ruofan KONG, Matthew BROWN, Victor SHNAYDER
  • Publication number: 20170213155
    Abstract: An AI database hosted on cloud platform is configured to cooperate with a search engine and an AI engine. The AI database stores and indexes trained AI objects and its class of AI objects have searchable criteria. The AI database cooperates with the search engine to utilize search criteria supplied from a user, from either or both 1) via scripted software code and 2) via data put into defined fields of a user interface. The search engine utilizes the search criteria in order for the search engine to retrieve one or more AI data objects that have already been trained as query results. The AI database is coupled to an AI engine to allow any of reuse, reconfigure ability, and recomposition of the one or more trained AI data objects from the AI database into a new trained AI model.
    Type: Application
    Filed: January 26, 2017
    Publication date: July 27, 2017
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, William Guss, Ross Story
  • Publication number: 20170213156
    Abstract: The multiple independent processes run in an AI engine on its cloud-based platform. The multiple independent processes are configured as an independent process wrapped in its own container so that multiple instances of the same processes can run simultaneously to scale to handle one or more users to perform actions. The actions to solve AI problems can include 1) running multiple training sessions on two or more AI models at the same time, 2) creating two or more AI models at the same time, 3) running a training session on one or more AI models while creating one or more AI models at the same time, 4) deploying and using two or more trained AI models to do predictions on data from one or more data sources, 5) etc. A service handles scaling by dynamically calling in additional computing devices to load on and run additional instances of one or more of the independent processes as needed.
    Type: Application
    Filed: January 26, 2017
    Publication date: July 27, 2017
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Shane Arney, Matthew E. Haigh, Jett Evan Jones, Matthew James Brown, Ruofan Kong, Chetan Desh
  • Publication number: 20170213128
    Abstract: Provided herein in some embodiments is an artificial intelligence (“AI”) engine hosted on one or more remote servers configured to cooperate with one or more databases including one or more AI-engine modules and one or more server-side client-server interfaces. The one or more AI-engine modules include an instructor module and a learner module configured to train an AI model. An assembly code can be generated from a source code written in a pedagogical programming language describing a mental model of one or more concept modules to be learned by the AI model and curricula of one or more lessons for training the AI model. The one or more server-side client-server interfaces can be configured to enable client interactions from a local client such as submitting the source code for training the AI model and using the trained AI model for one or more predictions.
    Type: Application
    Filed: January 26, 2017
    Publication date: July 27, 2017
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, Megan Adams
  • Publication number: 20170213154
    Abstract: Provided herein in some embodiments is an artificial intelligence (“AI”) engine hosted on one or more servers configured to cooperate with one or more databases including one or more AI-engine modules. The one or more AI-engine modules include an architect module configured to propose an AI model from an assembly code. The assembly code can be generated from a source code written in a pedagogical programming language describing a mental model of one or more concept modules to be learned by the AI model and curricula of one or more lessons for training the AI model on the one or more concept modules in one or more training cycles. The AI engine can be configured to instantiate a trained AI model based on the one or more concept modules learned by the AI model in the one or more training cycles.
    Type: Application
    Filed: January 26, 2017
    Publication date: July 27, 2017
    Inventors: Mark Isaac Hammond, Keen McEwan Browne, Marcos Campos, Matthew James Brown, Ruofan Kong, Megan Adams