Patents by Inventor Paulito Palmes

Paulito Palmes has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240135234
    Abstract: A method for computing possibly optimal policies in reinforcement learning with multiple objectives and tradeoffs includes receiving a dataset comprising state, action, and reward information for objectives in a multiple objective environment. Tradeoff information indicating that a first vector comprising first values of the objectives in the multiple objective environment is preferred to a second vector comprising second values of the objectives in the multiple objective environment is received. A set of possibly optimal policies for the multiple objective environment is produced based on the dataset and the tradeoff information, where the set of possibly optimal policies indicates actions for an intelligent agent operating in the multiple objective environment to take.
    Type: Application
    Filed: October 23, 2022
    Publication date: April 25, 2024
    Inventors: Radu Marinescu, Parikshit Ram, Djallel Bouneffouf, Tejaswini Pedapati, Paulito Palmes
  • Patent number: 11956138
    Abstract: An embodiment establishes a knowledge base based at least in part on sensor data received from a network. The embodiment generates a predicted performance parameter for a designated entity of the network using a first machine learning algorithm. The embodiment compares the predicted performance parameter to an actual performance parameter and determines whether the actual performance parameter exceeds a threshold difference from the predicted performance parameter. The embodiment generates, responsive to determining that the threshold difference is exceeded, incentive data using a second machine learning algorithm, where the incentive data is representative of an action selected by the second machine learning algorithm using an iterative optimization process, and where the iterative optimization process comprises performing the action and determining that the actual performance parameter approaches the threshold value in response to the action.
    Type: Grant
    Filed: April 26, 2023
    Date of Patent: April 9, 2024
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Amadou Ba, Fearghal O'Donncha, Albert Akhriev, Paulito Palmes
  • Publication number: 20230409957
    Abstract: According to one embodiment, a method, computer system, and computer program product for reinforcement learning is provided. The present invention may include training, using an offline dataset, a plurality of diverse reward models, and creating a policy based on an output of the reward models and a robustness operator of the reward models.
    Type: Application
    Filed: June 17, 2022
    Publication date: December 21, 2023
    Inventors: Radu Marinescu, Parikshit Ram, Djallel BOUNEFFOUF, Tejaswini Pedapati, Paulito Palmes
  • Patent number: 11774295
    Abstract: Embodiments for assessing energy in a thermal energy fluid transfer system in a cloud computing environment by a processor. Behavior of the thermal energy fluid transfer system, associated with a heating service, a cooling service, or a combination thereof, may be learned according to collected data to identify one or more energy usage events. An energy usage assessment operation may be performed using temperature signal disambiguation operations, with data collected over a selected time period by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions in the thermal energy fluid transfer system, to learn the system performance indicators, and when coupled with ingested expected policy behavior, identify one or more energy usage waste events according to the learned behavior in real time.
    Type: Grant
    Filed: August 29, 2017
    Date of Patent: October 3, 2023
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Niall Brady, Paulito Palmes
  • Publication number: 20230004918
    Abstract: A processor may identify a first task of a set of tasks. The processor may identify features of the first task. The processor may generate a reputation assessment for a first user related to the features of the first task. The processor may match the first user to the first task based on the reputation assessment.
    Type: Application
    Filed: June 30, 2021
    Publication date: January 5, 2023
    Inventors: Fearghal O'Donncha, Paulito Palmes, Albert Akhriev
  • Publication number: 20230004843
    Abstract: A computer-implemented method for automated policy decision making optimization is disclosed. The computer-implemented method includes creating a dataset from a tabular database, wherein the dataset includes one or more columns selected as state variables, a column selected as action variables, and a column selected as reward variables. The computer-implemented method further includes determining a candidate function approximator Q based on applying at least one state variable, one action variable, and one reward variable to a trained regression model. The computer-implemented method further includes learning a decision policy based on applying the candidate function approximator Q to a reinforcement learning algorithm. The computer-implemented method further includes determining, based on the learned decision policy, an expected reward.
    Type: Application
    Filed: June 30, 2021
    Publication date: January 5, 2023
    Inventors: Radu Marinescu, Akihiro Kishimoto, Paulito Palmes, Martin Wistuba
  • Patent number: 11074513
    Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.
    Type: Grant
    Filed: March 13, 2015
    Date of Patent: July 27, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
  • Patent number: 11023816
    Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.
    Type: Grant
    Filed: June 22, 2015
    Date of Patent: June 1, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
  • Patent number: 10690548
    Abstract: Embodiments for assessing energy usage efficiency in a fluid transfer pumping system in a cloud computing environment by a processor. A rate of temperature decay may be determined over a selected time period using a temperature signal collected by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions of a piping network in the fluid transfer pumping system so as to determine energy efficiency in the fluid transfer pumping system associated with a heating service, a cooling service, or combination thereof.
    Type: Grant
    Filed: August 29, 2017
    Date of Patent: June 23, 2020
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Niall Brady, Liam S. Harpur, Paulito Palmes
  • Publication number: 20200143294
    Abstract: Embodiments for implementing intelligent refrigeration state classification in an Internet of Things (IoT) computing environment by a processor. A signal from a single IoT sensor associated with a refrigeration system may be used to assist in automatically classifying refrigeration states according to a training phase and an operational phase.
    Type: Application
    Filed: November 7, 2018
    Publication date: May 7, 2020
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Niall BRADY, Paulito PALMES, Amadou BA
  • Publication number: 20190064004
    Abstract: Embodiments for assessing energy in a thermal energy fluid transfer system in a cloud computing environment by a processor. Behavior of the thermal energy fluid transfer system, associated with a heating service, a cooling service, or a combination thereof, may be learned according to collected data to identify one or more energy usage events. An energy usage assessment operation may be performed using temperature signal disambiguation operations, with data collected over a selected time period by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions in the thermal energy fluid transfer system, to learn the system performance indicators, and when coupled with ingested expected policy behavior, identify one or more energy usage waste events according to the learned behavior in real time.
    Type: Application
    Filed: August 29, 2017
    Publication date: February 28, 2019
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Niall BRADY, Paulito PALMES
  • Publication number: 20180357564
    Abstract: Embodiments for intelligent flow prediction by a processor. One or more flows of a domain of interest between target entities may be forecasted according to one or more forecast models learned via machine learning using extracted features of one or more target variables from one or more data sources. The one or more flows may include a quantitative value, an intensity score, an intensity category, or a combination thereof between the target entities.
    Type: Application
    Filed: June 13, 2017
    Publication date: December 13, 2018
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Stefano BRAGHIN, Vincent LONIJ, Rahul NAIR, Rana E. NOVACK, Paulito PALMES
  • Publication number: 20180292270
    Abstract: Embodiments for assessing energy usage efficiency in a fluid transfer pumping system in a cloud computing environment by a processor. A rate of temperature decay may be determined over a selected time period using a temperature signal collected by one or more non-intrusive Internet of Things (IoT) sensors located at one or more selected positions of a piping network in the fluid transfer pumping system so as to determine energy efficiency in the fluid transfer pumping system associated with a heating service, a cooling service, or combination thereof.
    Type: Application
    Filed: August 29, 2017
    Publication date: October 11, 2018
    Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Niall BRADY, Liam S. HARPUR, Paulito PALMES
  • Publication number: 20160267390
    Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.
    Type: Application
    Filed: March 13, 2015
    Publication date: September 15, 2016
    Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth
  • Publication number: 20160267391
    Abstract: A method for forecasting time delays added to a scheduled start time and a scheduled end time of a task includes generating a stochastic model of the task and resources affecting the task, the stochastic model includes a reactionary delay component that is a function of previous task end times and a root cause delay component that is an independent random process at a specific time. The method further includes: calculating a probability distribution of time delays added to the scheduled start time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of start times; and calculating a probability distribution of time delays added to the scheduled end time as a combination of the reactionary delay component and the root cause delay component using the stochastic model to provide a probability distribution of end times.
    Type: Application
    Filed: June 22, 2015
    Publication date: September 15, 2016
    Inventors: Randall L. Cogill, Jakub Marecek, Martin Mevissen, Paulito Palmes, Robert Shorten, Fabian R. Wirth