Patents by Inventor Zhiqian Qiao

Zhiqian Qiao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Method and apparatus for automatically generated curriculum sequence based reinforcement learning for autonomous vehicles
    Patent number: 10732639
    Abstract: The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.
    Type: Grant
    Filed: March 8, 2018
    Date of Patent: August 4, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Upali P. Mudalige, Katharina Muelling, John M. Dolan
  • AUTONOMOUS DRIVING DECISIONS AT INTERSECTIONS USING HIERARCHICAL OPTIONS MARKOV DECISION PROCESS
    Publication number: 20200026277
    Abstract: A method in an autonomous vehicle (AV) is provided. The method includes determining, from vehicle sensor data and road geometry data, a plurality of range measurements and obstacle velocity data; determining vehicle state data wherein the vehicle state data includes a velocity of the AV, a distance to a stop line, a distance to a midpoint of an intersection, and a distance to a goal; determining, based on the plurality of range measurements, the obstacle velocity data and the vehicle state data, a set of discrete behavior actions and a unique trajectory control action associated with each discrete behavior action; choosing a discrete behavior action and a unique trajectory control action to perform; and communicating a message to vehicle controls conveying the unique trajectory control action associated with the discrete behavior action.
    Type: Application
    Filed: July 19, 2018
    Publication date: January 23, 2020
    Applicants: GM GLOBAL TECHNOLOGY OPERATIONS LLC, Carnegie Mellon University
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Katharina Muelling, John M. Dolan, Upali P. Mudalige
  • METHOD AND APPARATUS FOR AUTOMATICALLY GENERATED CURRICULUM SEQUENCE BASED REINFORCEMENT LEARNING FOR AUTONOMOUS VEHICLES
    Publication number: 20190278282
    Abstract: The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.
    Type: Application
    Filed: March 8, 2018
    Publication date: September 12, 2019
    Inventors: Praveen Palanisamy, Zhiqian Qiao, Upali P. Mudalige, Katharina Muelling, John M. Dolan