Patents by Inventor Zhanhong Jiang

Zhanhong Jiang has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240110717
    Abstract: A method for controlling building equipment includes providing an occupancy prediction for a building using an occupancy prediction model that uses both historical values and forecast values of an environmental condition as inputs. The method also includes controlling the building equipment based on the occupancy prediction.
    Type: Application
    Filed: September 21, 2023
    Publication date: April 4, 2024
    Inventors: Chenlu Zhang, Young M. Lee, Zhanhong Jiang
  • Patent number: 11859847
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
    Type: Grant
    Filed: October 13, 2022
    Date of Patent: January 2, 2024
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Publication number: 20230315079
    Abstract: A method includes obtaining a fault prediction model for building equipment, predicting, with the fault prediction model, both (i) whether a fault will occur during a first prediction bin and (ii) whether a fault will occur during a second prediction bin, performing a first mitigating action for the building equipment if the fault is predicted to occur during the first prediction bin, and performing a second mitigating action for the building equipment if the fault is predicted to occur during the second prediction bin.
    Type: Application
    Filed: March 31, 2022
    Publication date: October 5, 2023
    Applicant: Johnson Controls Tyco IP Holdings LLP
    Inventors: Michael J. Risbeck, Chenlu Zhang, Zhanhong Jiang, Young M. Lee, Santle Camilus Kulandai Samy, Jaume Amores, Saman Cyrus
  • Publication number: 20230315031
    Abstract: A system includes a plurality of devices of building equipment, an additional device of building equipment, and a computing system. The computing system is configured to process data from the plurality of devices to extract common features of the plurality of devices, train a global model based on the common features, obtain additional data from the additional device, adapt the global model for the additional device based on the additional data to obtain an adapted model for the additional device, predict a status of the additional device using the adapted model, and affect an operation of the additional device based on the status.
    Type: Application
    Filed: March 31, 2022
    Publication date: October 5, 2023
    Applicant: Johnson Controls Tyco IP Holdings LLP
    Inventors: Santle Camilus Kulandai Samy, Michael J. Risbeck, Young M. Lee, Chenlu Zhang, Zhanhong Jiang
  • Publication number: 20230316066
    Abstract: A method includes training a conditional generator by operating a generative adversarial network that includes the conditional generator, generating, by the conditional generator, synthetic timeseries data corresponding to a plurality of fault types, wherein labels for the plurality of fault types are used as inputs to the conditional generator, training a fault prediction model using the synthetic timeseries data, and predicting a fault for building equipment by applying the fault prediction model to real timeseries data relating to the building equipment.
    Type: Application
    Filed: March 31, 2022
    Publication date: October 5, 2023
    Inventors: Zhanhong Jiang, Michael J. Risbeck, Young M. Lee, Santle Camilus Kulandai Samy, Chenlu Zhang
  • Patent number: 11573540
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: February 7, 2023
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Publication number: 20230034809
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
    Type: Application
    Filed: October 13, 2022
    Publication date: February 2, 2023
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Patent number: 11531308
    Abstract: Systems and methods for training a surrogate model for predicting system states for a building management system based on generated data from a simulation model are disclosed herein. The simulation model is calibrated for a building of interest. The building of interest includes building equipment operable to control a variable state of the building. The simulated data of system states are generated using the calibrated simulation model. A surrogate model is trained based on the simulated data of system states from the calibrated simulation model. System state predictions are generated using the surrogate model. The surrogate model is re-trained based on updated operational data. An updated series of system state predictions is generated using the re-trained surrogate model.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 20, 2022
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang, Kirk Drees, Michael Risbeck
  • Patent number: 11525596
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: December 13, 2022
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Patent number: 11436492
    Abstract: A method includes collecting a first dataset of input-output data for a first building, training a deep learning model using the first dataset, initializing parameters of a target model for a second building using parameters of the deep learning model, collecting a second dataset of input-output data for a second building, training the target model for the second building using the initialized parameters of the target model and the second dataset, and controlling building equipment using the target model. Controlling the building equipment affects a variable state or condition of the building.
    Type: Grant
    Filed: May 6, 2020
    Date of Patent: September 6, 2022
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang
  • Patent number: 11409250
    Abstract: Systems and methods for training a surrogate model for predicting system states for a building management system based on generated data from a system identification model are disclosed herein. The system identification model is used to generate predicted system parameters of a zone of the building based on historic data from operation of the building equipment. The surrogate model is trained based on the predicted system parameters from the system identification model. Predicted future parameters of the variable state of the building are generated using the surrogate model. The surrogate model is re-trained based on new operational data from the building equipment. An updated series of predicted future parameters is generated using the re-trained surrogate model.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: August 9, 2022
    Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLP
    Inventors: Young M. Lee, Zhanhong Jiang, Kirk Drees, Michael Risbeck
  • Publication number: 20210190364
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.
    Type: Application
    Filed: December 23, 2019
    Publication date: June 24, 2021
    Applicant: Johnson Controls Technology Company
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Publication number: 20210191348
    Abstract: Systems and methods for training a surrogate model for predicting system states for a building management system based on generated data from a system identification model are disclosed herein. The system identification model is used to generate predicted system parameters of a zone of the building based on historic data from operation of the building equipment. The surrogate model is trained based on the predicted system parameters from the system identification model. Predicted future parameters of the variable state of the building are generated using the surrogate model. The surrogate model is re-trained based on new operational data from the building equipment. An updated series of predicted future parameters is generated using the re-trained surrogate model.
    Type: Application
    Filed: December 23, 2019
    Publication date: June 24, 2021
    Applicant: Johnson Controls Technology Company
    Inventors: Young M. Lee, Zhanhong Jiang, Kirk Drees, Michael Risbeck
  • Publication number: 20210191342
    Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.
    Type: Application
    Filed: December 23, 2019
    Publication date: June 24, 2021
    Applicant: Johnson Controls Technology Company
    Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
  • Publication number: 20210191343
    Abstract: Systems and methods for training a surrogate model for predicting system states for a building management system based on generated data from a simulation model are disclosed herein. The simulation model is calibrated for a building of interest. The building of interest includes building equipment operable to control a variable state of the building. The simulated data of system states are generated using the calibrated simulation model. A surrogate model is trained based on the simulated data of system states from the calibrated simulation model. System state predictions are generated using the surrogate model. The surrogate model is re-trained based on updated operational data. An updated series of system state predictions is generated using the re-trained surrogate model.
    Type: Application
    Filed: December 23, 2019
    Publication date: June 24, 2021
    Applicant: Johnson Controls Technology Company
    Inventors: Young M. Lee, Zhanhong Jiang, Kirk Drees, Michael Risbeck
  • Publication number: 20200356857
    Abstract: A method includes collecting a first dataset of input-output data for a first building, training a deep learning model using the first dataset, initializing parameters of a target model for a second building using parameters of the deep learning model, collecting a second dataset of input-output data for a second building, training the target model for the second building using the initialized parameters of the target model and the second dataset, and controlling building equipment using the target model. Controlling the building equipment affects a variable state or condition of the building.
    Type: Application
    Filed: May 6, 2020
    Publication date: November 12, 2020
    Applicant: Johnson Controls Technology Company
    Inventors: Young M. Lee, Zhanhong Jiang