Patents by Inventor Paulito Palmes
Paulito Palmes has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240135234Abstract: A method for computing possibly optimal policies in reinforcement learning with multiple objectives and tradeoffs includes receiving a dataset comprising state, action, and reward information for objectives in a multiple objective environment. Tradeoff information indicating that a first vector comprising first values of the objectives in the multiple objective environment is preferred to a second vector comprising second values of the objectives in the multiple objective environment is received. A set of possibly optimal policies for the multiple objective environment is produced based on the dataset and the tradeoff information, where the set of possibly optimal policies indicates actions for an intelligent agent operating in the multiple objective environment to take.Type: ApplicationFiled: October 23, 2022Publication date: April 25, 2024Inventors: Radu Marinescu, Parikshit Ram, Djallel Bouneffouf, Tejaswini Pedapati, Paulito Palmes
-
Patent number: 11956138Abstract: An embodiment establishes a knowledge base based at least in part on sensor data received from a network. The embodiment generates a predicted performance parameter for a designated entity of the network using a first machine learning algorithm. The embodiment compares the predicted performance parameter to an actual performance parameter and determines whether the actual performance parameter exceeds a threshold difference from the predicted performance parameter. The embodiment generates, responsive to determining that the threshold difference is exceeded, incentive data using a second machine learning algorithm, where the incentive data is representative of an action selected by the second machine learning algorithm using an iterative optimization process, and where the iterative optimization process comprises performing the action and determining that the actual performance parameter approaches the threshold value in response to the action.Type: GrantFiled: April 26, 2023Date of Patent: April 9, 2024Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Amadou Ba, Fearghal O'Donncha, Albert Akhriev, Paulito Palmes
-
Publication number: 20230409957Abstract: According to one embodiment, a method, computer system, and computer program product for reinforcement learning is provided. The present invention may include training, using an offline dataset, a plurality of diverse reward models, and creating a policy based on an output of the reward models and a robustness operator of the reward models.Type: ApplicationFiled: June 17, 2022Publication date: December 21, 2023Inventors: Radu Marinescu, Parikshit Ram, Djallel BOUNEFFOUF, Tejaswini Pedapati, Paulito Palmes
-
Patent number: 11774295Abstract: Embodiments for assessing energy in a thermal energy fluid transfer system in a cloud computing environment by a processor. Behavior of the thermal energy fluid transfer system, associated with a heating service, a cooling service, or a combination thereof, may be learned according to collected data to identify one or more energy usage events. An energy usage assessment operation may be performed using temperature signal disambiguation operations, with data collected over a selected time period by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions in the thermal energy fluid transfer system, to learn the system performance indicators, and when coupled with ingested expected policy behavior, identify one or more energy usage waste events according to the learned behavior in real time.Type: GrantFiled: August 29, 2017Date of Patent: October 3, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Niall Brady, Paulito Palmes
-
Publication number: 20230004918Abstract: A processor may identify a first task of a set of tasks. The processor may identify features of the first task. The processor may generate a reputation assessment for a first user related to the features of the first task. The processor may match the first user to the first task based on the reputation assessment.Type: ApplicationFiled: June 30, 2021Publication date: January 5, 2023Inventors: Fearghal O'Donncha, Paulito Palmes, Albert Akhriev
-
Publication number: 20230004843Abstract: A computer-implemented method for automated policy decision making optimization is disclosed. The computer-implemented method includes creating a dataset from a tabular database, wherein the dataset includes one or more columns selected as state variables, a column selected as action variables, and a column selected as reward variables. The computer-implemented method further includes determining a candidate function approximator Q based on applying at least one state variable, one action variable, and one reward variable to a trained regression model. The computer-implemented method further includes learning a decision policy based on applying the candidate function approximator Q to a reinforcement learning algorithm. The computer-implemented method further includes determining, based on the learned decision policy, an expected reward.Type: ApplicationFiled: June 30, 2021Publication date: January 5, 2023Inventors: Radu Marinescu, Akihiro Kishimoto, Paulito Palmes, Martin Wistuba
-
Patent number: 11074513Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.Type: GrantFiled: March 13, 2015Date of Patent: July 27, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
-
Patent number: 11023816Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.Type: GrantFiled: June 22, 2015Date of Patent: June 1, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
-
Patent number: 10690548Abstract: Embodiments for assessing energy usage efficiency in a fluid transfer pumping system in a cloud computing environment by a processor. A rate of temperature decay may be determined over a selected time period using a temperature signal collected by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions of a piping network in the fluid transfer pumping system so as to determine energy efficiency in the fluid transfer pumping system associated with a heating service, a cooling service, or combination thereof.Type: GrantFiled: August 29, 2017Date of Patent: June 23, 2020Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Niall Brady, Liam S. Harpur, Paulito Palmes
-
Publication number: 20200143294Abstract: Embodiments for implementing intelligent refrigeration state classification in an Internet of Things (IoT) computing environment by a processor. A signal from a single IoT sensor associated with a refrigeration system may be used to assist in automatically classifying refrigeration states according to a training phase and an operational phase.Type: ApplicationFiled: November 7, 2018Publication date: May 7, 2020Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Niall BRADY, Paulito PALMES, Amadou BA
-
Publication number: 20190064004Abstract: Embodiments for assessing energy in a thermal energy fluid transfer system in a cloud computing environment by a processor. Behavior of the thermal energy fluid transfer system, associated with a heating service, a cooling service, or a combination thereof, may be learned according to collected data to identify one or more energy usage events. An energy usage assessment operation may be performed using temperature signal disambiguation operations, with data collected over a selected time period by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions in the thermal energy fluid transfer system, to learn the system performance indicators, and when coupled with ingested expected policy behavior, identify one or more energy usage waste events according to the learned behavior in real time.Type: ApplicationFiled: August 29, 2017Publication date: February 28, 2019Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Niall BRADY, Paulito PALMES
-
Publication number: 20180357564Abstract: Embodiments for intelligent flow prediction by a processor. One or more flows of a domain of interest between target entities may be forecasted according to one or more forecast models learned via machine learning using extracted features of one or more target variables from one or more data sources. The one or more flows may include a quantitative value, an intensity score, an intensity category, or a combination thereof between the target entities.Type: ApplicationFiled: June 13, 2017Publication date: December 13, 2018Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Stefano BRAGHIN, Vincent LONIJ, Rahul NAIR, Rana E. NOVACK, Paulito PALMES
-
Publication number: 20180292270Abstract: Embodiments for assessing energy usage efficiency in a fluid transfer pumping system in a cloud computing environment by a processor. A rate of temperature decay may be determined over a selected time period using a temperature signal collected by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions of a piping network in the fluid transfer pumping system so as to determine energy efficiency in the fluid transfer pumping system associated with a heating service, a cooling service, or combination thereof.Type: ApplicationFiled: August 29, 2017Publication date: October 11, 2018Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Niall BRADY, Liam S. HARPUR, Paulito PALMES
-
Publication number: 20160267390Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.Type: ApplicationFiled: March 13, 2015Publication date: September 15, 2016Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
-
Publication number: 20160267391Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.Type: ApplicationFiled: June 22, 2015Publication date: September 15, 2016Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth