Patents by Inventor Desong Bian

Desong Bian has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11610214
    Abstract: A system with deep reinforcement learning based control determines optimal actions for major components in a commercial building to minimize operation costs while maximizing comprehensive comfort levels of occupants. An unsupervised deep Q-network method is introduced to handle the energy management problem by evaluating the influence of operation costs on comfort levels considering the environment factors at each time slot. An optimum control decision can be derived that targets both immediate and long-term goals, where exploration and exploitation are considered simultaneously.
    Type: Grant
    Filed: November 24, 2020
    Date of Patent: March 21, 2023
    Assignee: Global Energy Interconnection Research Institute North America
    Inventors: Desong Bian, Xiaohu Zhang, Di Shi, Ruisheng Diao, Siqi Wang, Zheming Liang
  • Patent number: 11336092
    Abstract: Systems and methods are disclosed for control voltage profiles, line flows and transmission losses of a power grid by forming an autonomous multi-objective control model with one or more neural networks as a Deep Reinforcement Learning (DRL) agent; training the DRL agent to provide data-driven, real-time and autonomous grid control strategies; and coordinating and optimizing power controllers to regulate voltage profiles, line flows and transmission losses in the power grid with a Markov decision process (MDP) operating with reinforcement learning to control problems in dynamic and stochastic environments.
    Type: Grant
    Filed: November 9, 2020
    Date of Patent: May 17, 2022
    Inventors: Ruisheng Diao, Di Shi, Bei Zhang, Siqi Wang, Haifeng Li, Chunlei Xu, Desong Bian, Jiajun Duan, Haiwei Wu
  • Publication number: 20220036392
    Abstract: A system with deep reinforcement learning based control determines optimal actions for major components in a commercial building to minimize operation costs while maximizing comprehensive comfort levels of occupants. An unsupervised deep Q-network method is introduced to handle the energy management problem by evaluating the influence of operation costs on comfort levels considering the environment factors at each time slot. An optimum control decision can be derived that targets both immediate and long-term goals, where exploration and exploitation are considered simultaneously.
    Type: Application
    Filed: November 24, 2020
    Publication date: February 3, 2022
    Inventors: Desong Bian, Xiaohu Zhang, Di Shi, Ruisheng Diao, Siqi Wang, Zheming Liang
  • Publication number: 20210367424
    Abstract: Systems and methods are disclosed for control voltage profiles, line flows and transmission losses of a power grid by forming an autonomous multi-objective control model with one or more neural networks as a Deep Reinforcement Learning (DRL) agent; training the DRL agent to provide data-driven, real-time and autonomous grid control strategies; and coordinating and optimizing power controllers to regulate voltage profiles, line flows and transmission losses in the power grid with a Markov decision process (MDP) operating with reinforcement learning to control problems in dynamic and stochastic environments.
    Type: Application
    Filed: November 9, 2020
    Publication date: November 25, 2021
    Inventors: Ruisheng Diao, Di Shi, Bei Zhang, Siqi Wang, Haifeng Li, Chunlei Xu, Desong Bian, Jiajun Duan, Haiwei Wu