Patents by Inventor Viswanath Ramamurti
Viswanath Ramamurti has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11886153Abstract: A method of operating a building management system is disclosed. The method includes determining, by a processing circuit, policy rankings for a plurality of control policies based on building operation data of a first previous time period, selecting, by the processing circuit, a set of control policies from among the plurality of control policies based on the policy rankings of the set of control policies satisfying a ranking threshold, generating, by the processing circuit, a plurality of prediction models for the set of control policies, selecting, by the processing circuit, a first prediction model of the plurality of prediction models based on building operation data of a second previous time period, and responsive to selecting the first prediction model, operating, by the processing circuit, the building management system using the first prediction model.Type: GrantFiled: July 22, 2021Date of Patent: January 30, 2024Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLPInventors: Sugumar Murugesan, Young M. Lee, Viswanath Ramamurti
-
Patent number: 11859847Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.Type: GrantFiled: October 13, 2022Date of Patent: January 2, 2024Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLPInventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Patent number: 11573540Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.Type: GrantFiled: December 23, 2019Date of Patent: February 7, 2023Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLPInventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Publication number: 20230034809Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.Type: ApplicationFiled: October 13, 2022Publication date: February 2, 2023Inventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Patent number: 11525596Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.Type: GrantFiled: December 23, 2019Date of Patent: December 13, 2022Assignee: JOHNSON CONTROLS TYCO IP HOLDINGS LLPInventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Patent number: 11270084Abstract: A method for generating a human-like response to a voice or text command includes receiving an input sequence of words and processing the input sequence of words to generate a trigger word that is indicative of a desired nature of the human-like response. The method further includes encoding a neural network using the trigger word and generating the human-like response using an output of the neural network. The method enables implementation of voice command functionality in various types of devices with only a small amount of training data.Type: GrantFiled: October 12, 2018Date of Patent: March 8, 2022Assignee: Johnson Controls Tyco IP Holdings LLPInventors: Viswanath Ramamurti, Young M. Lee
-
Publication number: 20220026864Abstract: A method of operating a building management system is disclosed. The method includes determining, by a processing circuit, policy rankings for a plurality of control policies based on building operation data of a first previous time period, selecting, by the processing circuit, a set of control policies from among the plurality of control policies based on the policy rankings of the set of control policies satisfying a ranking threshold, generating, by the processing circuit, a plurality of prediction models for the set of control policies, selecting, by the processing circuit, a first prediction model of the plurality of prediction models based on building operation data of a second previous time period, and responsive to selecting the first prediction model, operating, by the processing circuit, the building management system using the first prediction model.Type: ApplicationFiled: July 22, 2021Publication date: January 27, 2022Applicant: Johnson Controls Tyco IP Holdings LLPInventors: Sugumar Murugesan, Young M. Lee, Viswanath Ramamurti
-
Publication number: 20210191342Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. A calibrated simulation model is used to train a surrogate model of the HVAC system operating within a building. The surrogate model is used to generate simulated experience data for the HVAC system. The simulated experience data can be used to train a reinforcement learning (RL) model of the HVAC system. The RL model is used to control the HVAC system based on the current state of the system and the best predicted action to perform in the current state. The HVAC system generates real experience data based on the actual operation of the HVAC system within the building. The real experience data is used to retrain the surrogate model, and additional simulated experience data is generated using the surrogate model. The RL model can be retrained using the additional simulated experience data.Type: ApplicationFiled: December 23, 2019Publication date: June 24, 2021Applicant: Johnson Controls Technology CompanyInventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Publication number: 20210190364Abstract: Systems and methods for training a reinforcement learning (RL) model for HVAC control are disclosed herein. Simulated experience data for the HVAC system is generated or received. The simulated experience data is used to initially train the RL model for HVAC control. The HVAC system operates within a building using the RL model and generates real experience data. A determination may be made to retrain the RL model. The real experience data is used to retrain the RL model. In some embodiments, both the simulated and real experience data are used to retrain the RL model. Experience data may be sampled according to various sampling functions. The RL model may be retrained multiple times over time. The RL model may be retrained less frequently over time as more real experience data is used to train the RL model.Type: ApplicationFiled: December 23, 2019Publication date: June 24, 2021Applicant: Johnson Controls Technology CompanyInventors: Young M. Lee, Zhanhong Jiang, Viswanath Ramamurti, Sugumar Murugesan, Kirk H. Drees, Michael James Risbeck
-
Patent number: 10852023Abstract: A building management system includes one or more processors, and one or more computer-readable storage media communicably coupled to the one or more processors and having instructions stored thereon that cause the one or more processors to: define a state of a zone or space within a building; control an HVAC system to adjust a temperature of the zone or space corresponding to a first action; receive utterance data from a voice assist device located in the zone or space; analyze the utterance data to identify a sentiment relating to the temperature of the zone or space; calculate a reward based on the state, the first action, and the sentiment; determine a second action to adjust the temperature of the zone or space based on the reward; and control the HVAC system to adjust the temperature of the zone or space corresponding to the second action.Type: GrantFiled: May 15, 2018Date of Patent: December 1, 2020Assignee: Johnson Controls Technology CompanyInventors: Viswanath Ramamurti, Young M. Lee, Youngchoon Park, Sugumar Murugesan
-
Patent number: 10845081Abstract: A building management system includes one or more processors, and one or more computer-readable storage media communicably coupled to the one or more processors and having instructions stored thereon that cause the one or more processors to: receive utterance data from a voice assist device; determine a location of the voice assist device; analyze the utterance data to identify a sentiment relating to a temperature of the location; and control an HVAC system to adjust the temperature of the location based on the sentiment.Type: GrantFiled: May 16, 2018Date of Patent: November 24, 2020Assignee: Johnson Controls Technology CompanyInventors: Young M. Lee, Viswanath Ramamurti, Youngchoon Park, Sugumar Murugesan
-
Publication number: 20200117717Abstract: A method for generating a human-like response to a voice or text command includes receiving an input sequence of words and processing the input sequence of words to generate a trigger word that is indicative of a desired nature of the human-like response. The method further includes encoding a neural network using the trigger word and generating the human-like response using an output of the neural network. The method enables implementation of voice command functionality in various types of devices with only a small amount of training data.Type: ApplicationFiled: October 12, 2018Publication date: April 16, 2020Applicant: Johnson Controls Technology CompanyInventors: Viswanath Ramamurti, Young M. Lee
-
Publication number: 20190353378Abstract: A building management system includes one or more processors, and one or more computer-readable storage media communicably coupled to the one or more processors and having instructions stored thereon that cause the one or more processors to: define a state of a zone or space within a building; control an HVAC system to adjust a temperature of the zone or space corresponding to a first action; receive utterance data from a voice assist device located in the zone or space; analyze the utterance data to identify a sentiment relating to the temperature of the zone or space; calculate a reward based on the state, the first action, and the sentiment; determine a second action to adjust the temperature of the zone or space based on the reward; and control the HVAC system to adjust the temperature of the zone or space corresponding to the second action.Type: ApplicationFiled: May 15, 2018Publication date: November 21, 2019Inventors: Viswanath Ramamurti, Young M. Lee, Youngchoon Park, Sugumar Murugesan
-
Publication number: 20190353379Abstract: A building management system includes one or more processors, and one or more computer-readable storage media communicably coupled to the one or more processors and having instructions stored thereon that cause the one or more processors to: receive utterance data from a voice assist device; determine a location of the voice assist device; analyze the utterance data to identify a sentiment relating to a temperature of the location; and control an HVAC system to adjust the temperature of the location based on the sentiment.Type: ApplicationFiled: May 16, 2018Publication date: November 21, 2019Inventors: Young M. Lee, Viswanath Ramamurti, Youngchoon Park, Sugumar Murugesan
-
Publication number: 20060280120Abstract: A system and method for managing data packets at an ingress to a Resilient Packet Ring (“RPR”) and an egress to the RPR. A system to manage data packets at an ingress to the RPR comprises a RPR station coupled with a plurality of other stations via a dual ring and a RPR client coupled with at least the RPR station to pass data packets between the RPR station and the RPR client. The RPR client comprises a plurality of client ports that receives at least fairness and non-fairness eligible data to be added to the RPR; a plurality fairness eligible traffic queues, comprising a high and low watermark, each fairness eligible queue associated with one client port to receive fairness eligible data from the client port; and a plurality of local traffic queues, comprising a high and low watermark, to receive non-fairness eligible data form the client port and fairness eligible data from the fairness eligible traffic queue.Type: ApplicationFiled: June 10, 2005Publication date: December 14, 2006Inventors: Viswanath Ramamurti, John Siwko