Patents by Inventor Shiyang LIANG

Shiyang LIANG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11794898
    Abstract: The present disclosure provides an air combat maneuvering method based on parallel self-play, including the steps of constructing a UAV (unmanned aerial vehicle) maneuver model, constructing a red-and-blue motion situation acquiring model to describe a relative combat situation of red and blue sides, constructing state spaces and action spaces of both red and blue sides and a reward function according to a Markov process, followed by constructing a maneuvering decision-making model structure based on a soft actor-critic (SAC) algorithm, training the SAC algorithm by performing air combat confrontations to realize parallel self-play, and finally testing a trained network, displaying combat trajectories and calculating a combat success rate. The level of confrontations can be effectively enhanced and the combat success rate of the decision-making model can be increased.
    Type: Grant
    Filed: October 13, 2021
    Date of Patent: October 24, 2023
    Assignee: NORTHWESTERN POLYTECHNICAL UNIVERSITY
    Inventors: Bo Li, Kaifang Wan, Xiaoguang Gao, Zhigang Gan, Shiyang Liang, Kaiqiang Yue, Zhipeng Yang
  • Publication number: 20220315219
    Abstract: The present disclosure provides an air combat maneuvering method based on parallel self-play, including the steps of constructing a UAV (unmanned aerial vehicle) maneuver model, constructing a red-and-blue motion situation acquiring model to describe a relative combat situation of red and blue sides, constructing state spaces and action spaces of both red and blue sides and a reward function according to a Markov process, followed by constructing a maneuvering decision-making model structure based on a soft actor-critic (SAC) algorithm, training the SAC algorithm by performing air combat confrontations to realize parallel self-play, and finally testing a trained network, displaying combat trajectories and calculating a combat success rate. The level of confrontations can be effectively enhanced and the combat success rate of the decision-making model can be increased.
    Type: Application
    Filed: October 13, 2021
    Publication date: October 6, 2022
    Inventors: Bo Li, Kaifang WAN, Xiaoguang GAO, Zhigang GAN, Shiyang LIANG, Kaiqiang YUE, Zhipeng YANG