Patents by Inventor Evelyn Duesterwald

Evelyn Duesterwald has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11856021
    Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.
    Type: Grant
    Filed: March 22, 2023
    Date of Patent: December 26, 2023
    Assignee: International Business Machines Corporation
    Inventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
  • Patent number: 11809375
    Abstract: Methods and systems for multi-dimensional data labeling. A structured data set having a plurality of rows is obtained, the structured data set comprising a set of data attributes, each data attribute having a data value for each of the plurality of rows of the structured data set. The structured data set is decomposed into a plurality of dimensions, each dimension defining a proper subset of the data attributes based on coherence criterion. A dimension label is obtained for each dimension of at least a portion of the plurality of rows of the structured data set and the dimension labels for a given one of the rows of the structured data set are consolidated into at least one row label for the given one of the rows.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: November 7, 2023
    Assignee: International Business Machines Corporation
    Inventors: Michael Desmond, Evelyn Duesterwald
  • Patent number: 11783226
    Abstract: Systems, computer-implemented methods, and computer program products to facilitate model transfer learning across evolving processes are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a condition definition component that defines one or more conditions associated with use of a model trained on first traces of a first process to make a prediction on one or more second traces of a second process. The computer executable components can further comprise a guardrail component that determines whether to use the model to make the prediction.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: October 10, 2023
    Assignee: International Business Machines Corporation
    Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
  • Publication number: 20230231875
    Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.
    Type: Application
    Filed: March 22, 2023
    Publication date: July 20, 2023
    Inventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
  • Patent number: 11689566
    Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.
    Type: Grant
    Filed: July 10, 2018
    Date of Patent: June 27, 2023
    Assignee: International Business Machines Corporation
    Inventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
  • Publication number: 20230196178
    Abstract: A method of using a computing device to manage a lifecycle of machine learning models includes receiving, by a computing device, multiple pre-defined machine learning lifecycle tasks. The computing device manages executing a management-layer software layer for the multiple pre-defined machine learning lifecycle tasks. The computing device further generates and updates a machine learning pipeline using the management-layer software layer.
    Type: Application
    Filed: December 17, 2021
    Publication date: June 22, 2023
    Inventors: Benjamin Herta, Darrell Christopher Reimer, EVELYN DUESTERWALD, Gaodan Fang, Punleuk Oum, Debashish Saha, Archit Verma
  • Patent number: 11645372
    Abstract: A system, method, and computer program product for verifying signatures. The system includes at least one processing component, at least one memory component, and a reference storage comprising a set of reference signatures. The system also includes a model generator configured to generate a signature model based on the set of reference signatures. Further, the system includes a verification component configured to receive a signature, and determine whether the signature is valid.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: May 9, 2023
    Assignee: International Business Machines Corporation
    Inventors: Michael S. Gordon, Evelyn Duesterwald, Valentina Salapura, Komminist Weldemariam
  • Publication number: 20230009237
    Abstract: Methods and systems for multi-dimensional data labeling. A structured data set having a plurality of rows is obtained, the structured data set comprising a set of data attributes, each data attribute having a data value for each of the plurality of rows of the structured data set. The structured data set is decomposed into a plurality of dimensions, each dimension defining a proper subset of the data attributes based on coherence criterion. A dimension label is obtained for each dimension of at least a portion of the plurality of rows of the structured data set and the dimension labels for a given one of the rows of the structured data set are consolidated into at least one row label for the given one of the rows.
    Type: Application
    Filed: July 6, 2021
    Publication date: January 12, 2023
    Inventors: Michael Desmond, EVELYN DUESTERWALD
  • Patent number: 11500671
    Abstract: In an embodiment, a method for inspecting and transforming a machine learning model includes receiving a request that includes the machine learning model and a configuration object that provides an indication of a selected strategy. In the embodiment, the method includes creating a partially specified task graph that includes a first placeholder node for a future expanded task node. In the embodiment, the method includes performing a dynamic expansion and execution phase that includes, repeatedly (a) using a cognitive engine to evaluate whether to revise the partially specified task graph based at least in part on the selected strategy, and (b) using a processor-based execution engine to perform an action specified by the complete node. In an embodiment, the dynamic expansion and execution phase repeats until after the cognitive engine adds a consolidated results node.
    Type: Grant
    Filed: July 12, 2019
    Date of Patent: November 15, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Evelyn Duesterwald, Anupama Murthi, Deepak Vijaykeerthy, Vijay Arya, Ganesh Venkataraman
  • Patent number: 11501114
    Abstract: The generating of actionable recommendations for tuning model metrics of an Artificial Intelligence (AI) system includes partitioning a key performance indicator (KPI) range associated with a target system into a plurality of buckets. Log data including at least one KPI of the target system and one or more AI model metrics is partitioned and distributed across the plurality of buckets. For each bucket, an aggregate value of the one or more AI model metrics across the log data is computed and weighted according to the volume of log data in that bucket. A correlation factor between the aggregate value and a representative KPI value for each bucket is determined. A model tuning recommendation to increase ranking of the AI model metrics according to the determined correlation factor is provided to an output device and/or to the AI system for updating the one or more AI model.
    Type: Grant
    Filed: December 2, 2019
    Date of Patent: November 15, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Matthew Arnold, Evelyn Duesterwald, Darrell Reimer, Michael Desmond, Harold Leon Ossher, Robert Yates
  • Patent number: 11487847
    Abstract: Techniques that facilitate matrix factorization associated with graphics processing units are provided. In one example, a system includes a first graphics processing unit, a second graphics processing unit and a central processing unit. The first graphics processing unit processes a first data block of a data matrix associated with a matrix factorization system to generate first information for the matrix factorization system. The second graphics processing unit processes a first portion of a second data block of the data matrix separate from a second portion of the second data block to generate second information for the matrix factorization system. The central processing unit processes a machine learning model for the matrix factorization system based on at least the first information provided by the first graphics processing unit and the second information provided by the second graphics processing unit.
    Type: Grant
    Filed: May 6, 2021
    Date of Patent: November 1, 2022
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Evelyn Duesterwald, Liana Liyow Fong, Wei Tan, Xiaolong Xie
  • Publication number: 20220198641
    Abstract: An approach to tree fall risk management. This approach may identify a tree in a given location. Historical data associated with the geographic location may be received in the approach. A current condition or status of the tree may be identified by the approach. The approach may analyze the foreseeable weather forecast or weather conditions in conjunction with the status of the identified tree. The approach may generate a risk score based on the information received and analyzed. The risk score may indicate the tree is likely to fall and cause damage. The approach may result in tree fall mitigation action can be generated based on the risk score.
    Type: Application
    Filed: December 23, 2020
    Publication date: June 23, 2022
    Inventors: Michael S. Gordon, Evelyn Duesterwald, Valentina Salapura, Komminist Weldemariam
  • Publication number: 20220180230
    Abstract: Techniques are provided for decision making tasks using a hybrid approach where cooperation between an AI assessor and a human labeler controls automation of the process. In one aspect, a method for hybrid decision making automation includes: monitoring interactions between an AI assistant and a human decision maker; tracking, from the interactions, agreement of the human decision maker with decision predictions made by the AI assistant; determining a predicted performance of data tasks by the AI assistant on unseen data based on the agreement of the human decision maker with the decision predictions over time; and assessing delegation of remaining data tasks on the unseen data to the AI assistant using the predicted performance.
    Type: Application
    Filed: December 7, 2020
    Publication date: June 9, 2022
    Inventors: EVELYN DUESTERWALD, Michael Desmond, Kristina Marie Brimijoin
  • Publication number: 20220172109
    Abstract: A computer implemented method of performing large-scale machine learning experiments includes expanding on one or more input datasets by systematically generating several data set drift splits. A set of experimental jobs corresponding to the generated data set drift splits are executed to generate experimental results. The experimental results are processed, consolidated, and clustered according to the generated data set drift splits.
    Type: Application
    Filed: December 2, 2020
    Publication date: June 2, 2022
    Inventors: Evelyn Duesterwald, Anupama Murthi, Michael Hind, Matthew Richard Arnold, Benjamin Tyler Elder, Jiri Navratil
  • Patent number: 11294759
    Abstract: A computer-implemented method includes obtaining data associated with execution of a model deployed in a computing environment. At least a portion of the obtained data is analyzed to detect one or more failure conditions associated with the model. One or more restoration operations are executed to generate one or more restoration results to address one or more detected failure conditions. At least a portion of the one or more restoration results is sent to the computing environment in which the model is deployed.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: April 5, 2022
    Assignee: International Business Machines Corporation
    Inventors: Evelyn Duesterwald, Punleuk Oum, Gaodan Fang, Debashish Saha, Anupama Murthi, Waldemar Hummer
  • Publication number: 20210406760
    Abstract: Systems, computer-implemented methods, and computer program products to facilitate model transfer learning across evolving processes are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a condition definition component that defines one or more conditions associated with use of a model trained on first traces of a first process to make a prediction on one or more second traces of a second process. The computer executable components can further comprise a guardrail component that determines whether to use the model to make the prediction.
    Type: Application
    Filed: June 25, 2020
    Publication date: December 30, 2021
    Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
  • Patent number: 11206228
    Abstract: Aspects of the present invention disclose a method, computer program product, and system for detecting and mitigating adversarial virtual interactions. The method includes one or more processors initiating a mitigation protocol on interactions between the user and the virtual agent, wherein the mitigation protocol is based on the actions performed by the user while interacting with the virtual agent. The method further includes one or more processors, in response to initiating the mitigation protocol on interactions between the user and the virtual agent, generating a lower fidelity response from the virtual agent to the user, wherein the lower fidelity response is a progressive dilution of the precision of language of an original response from the virtual agent to the user prior to the user exceeding the risk level threshold.
    Type: Grant
    Filed: January 20, 2020
    Date of Patent: December 21, 2021
    Assignee: International Business Machines Corporation
    Inventors: Guillaume A. Baudart, Julian T. Dolby, Evelyn Duesterwald, David J. Piorkowski
  • Patent number: 11175935
    Abstract: Embodiments include method, systems and computer program products for a path-sensitive contextual help system. In some embodiments, user actions are obtained from a user session of a user. A concrete user action trace is captured using the obtained user actions, wherein the concrete user action trace is a subset of user actions from the user session. An abstract user action trace is generated using the concrete user action trace. A help action corresponding to the abstract user action trace is identified and, in some embodiments, is presented to the user.
    Type: Grant
    Filed: January 14, 2020
    Date of Patent: November 16, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Evelyn Duesterwald, John C. Thomas, Patrick A. Wagstrom
  • Patent number: 11146471
    Abstract: A process trace updating method, system, and computer program product include retrieving, by a computing device, one or more historical executions of a process, receiving, by the computing device, a proposed incremental change, with regard to the process, for a proposed process, updating, by the computing device, the historical execution to build a machine learning model, and generating, by the computing device, a decision and a prediction about execution of the proposed process based upon the machine-learning model.
    Type: Grant
    Filed: February 28, 2020
    Date of Patent: October 12, 2021
    Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
    Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
  • Publication number: 20210273871
    Abstract: A process trace updating method, system, and computer program product include retrieving, by a computing device, one or more historical executions of a process, receiving, by the computing device, a proposed incremental change, with regard to the process, for a proposed process, updating, by the computing device, the historical execution to build a machine learning model, and generating, by the computing device, a decision and a prediction about execution of the proposed process based upon the machine-learning model.
    Type: Application
    Filed: February 28, 2020
    Publication date: September 2, 2021
    Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy