Patents by Inventor Evelyn Duesterwald
Evelyn Duesterwald has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11856021Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.Type: GrantFiled: March 22, 2023Date of Patent: December 26, 2023Assignee: International Business Machines CorporationInventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
-
Patent number: 11809375Abstract: Methods and systems for multi-dimensional data labeling. A structured data set having a plurality of rows is obtained, the structured data set comprising a set of data attributes, each data attribute having a data value for each of the plurality of rows of the structured data set. The structured data set is decomposed into a plurality of dimensions, each dimension defining a proper subset of the data attributes based on coherence criterion. A dimension label is obtained for each dimension of at least a portion of the plurality of rows of the structured data set and the dimension labels for a given one of the rows of the structured data set are consolidated into at least one row label for the given one of the rows.Type: GrantFiled: July 6, 2021Date of Patent: November 7, 2023Assignee: International Business Machines CorporationInventors: Michael Desmond, Evelyn Duesterwald
-
Patent number: 11783226Abstract: Systems, computer-implemented methods, and computer program products to facilitate model transfer learning across evolving processes are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a condition definition component that defines one or more conditions associated with use of a model trained on first traces of a first process to make a prediction on one or more second traces of a second process. The computer executable components can further comprise a guardrail component that determines whether to use the model to make the prediction.Type: GrantFiled: June 25, 2020Date of Patent: October 10, 2023Assignee: International Business Machines CorporationInventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
-
Publication number: 20230231875Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.Type: ApplicationFiled: March 22, 2023Publication date: July 20, 2023Inventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
-
Patent number: 11689566Abstract: Computer-implemented methods, program products, and systems for provenance-based defense against poison attacks are disclosed. In one approach, a method includes: receiving observations and corresponding provenance data from data sources; determining whether the observations are poisoned based on the corresponding provenance data; and removing the poisoned observation(s) from a final training dataset used to train a final prediction model. Another implementation involves provenance-based defense against poison attacks in a fully untrusted data environment. Untrusted data points are grouped according to provenance signature, and the groups are used to train learning algorithms and generate complete and filtered prediction models. The results of applying the prediction models to an evaluation dataset are compared, and poisoned data points identified where the performance of the filtered prediction model exceeds the performance of the complete prediction model.Type: GrantFiled: July 10, 2018Date of Patent: June 27, 2023Assignee: International Business Machines CorporationInventors: Nathalie Baracaldo-Angel, Bryant Chen, Evelyn Duesterwald, Heiko H. Ludwig
-
Publication number: 20230196178Abstract: A method of using a computing device to manage a lifecycle of machine learning models includes receiving, by a computing device, multiple pre-defined machine learning lifecycle tasks. The computing device manages executing a management-layer software layer for the multiple pre-defined machine learning lifecycle tasks. The computing device further generates and updates a machine learning pipeline using the management-layer software layer.Type: ApplicationFiled: December 17, 2021Publication date: June 22, 2023Inventors: Benjamin Herta, Darrell Christopher Reimer, EVELYN DUESTERWALD, Gaodan Fang, Punleuk Oum, Debashish Saha, Archit Verma
-
Patent number: 11645372Abstract: A system, method, and computer program product for verifying signatures. The system includes at least one processing component, at least one memory component, and a reference storage comprising a set of reference signatures. The system also includes a model generator configured to generate a signature model based on the set of reference signatures. Further, the system includes a verification component configured to receive a signature, and determine whether the signature is valid.Type: GrantFiled: January 22, 2020Date of Patent: May 9, 2023Assignee: International Business Machines CorporationInventors: Michael S. Gordon, Evelyn Duesterwald, Valentina Salapura, Komminist Weldemariam
-
Publication number: 20230009237Abstract: Methods and systems for multi-dimensional data labeling. A structured data set having a plurality of rows is obtained, the structured data set comprising a set of data attributes, each data attribute having a data value for each of the plurality of rows of the structured data set. The structured data set is decomposed into a plurality of dimensions, each dimension defining a proper subset of the data attributes based on coherence criterion. A dimension label is obtained for each dimension of at least a portion of the plurality of rows of the structured data set and the dimension labels for a given one of the rows of the structured data set are consolidated into at least one row label for the given one of the rows.Type: ApplicationFiled: July 6, 2021Publication date: January 12, 2023Inventors: Michael Desmond, EVELYN DUESTERWALD
-
Patent number: 11500671Abstract: In an embodiment, a method for inspecting and transforming a machine learning model includes receiving a request that includes the machine learning model and a configuration object that provides an indication of a selected strategy. In the embodiment, the method includes creating a partially specified task graph that includes a first placeholder node for a future expanded task node. In the embodiment, the method includes performing a dynamic expansion and execution phase that includes, repeatedly (a) using a cognitive engine to evaluate whether to revise the partially specified task graph based at least in part on the selected strategy, and (b) using a processor-based execution engine to perform an action specified by the complete node. In an embodiment, the dynamic expansion and execution phase repeats until after the cognitive engine adds a consolidated results node.Type: GrantFiled: July 12, 2019Date of Patent: November 15, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Evelyn Duesterwald, Anupama Murthi, Deepak Vijaykeerthy, Vijay Arya, Ganesh Venkataraman
-
Patent number: 11501114Abstract: The generating of actionable recommendations for tuning model metrics of an Artificial Intelligence (AI) system includes partitioning a key performance indicator (KPI) range associated with a target system into a plurality of buckets. Log data including at least one KPI of the target system and one or more AI model metrics is partitioned and distributed across the plurality of buckets. For each bucket, an aggregate value of the one or more AI model metrics across the log data is computed and weighted according to the volume of log data in that bucket. A correlation factor between the aggregate value and a representative KPI value for each bucket is determined. A model tuning recommendation to increase ranking of the AI model metrics according to the determined correlation factor is provided to an output device and/or to the AI system for updating the one or more AI model.Type: GrantFiled: December 2, 2019Date of Patent: November 15, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Matthew Arnold, Evelyn Duesterwald, Darrell Reimer, Michael Desmond, Harold Leon Ossher, Robert Yates
-
Patent number: 11487847Abstract: Techniques that facilitate matrix factorization associated with graphics processing units are provided. In one example, a system includes a first graphics processing unit, a second graphics processing unit and a central processing unit. The first graphics processing unit processes a first data block of a data matrix associated with a matrix factorization system to generate first information for the matrix factorization system. The second graphics processing unit processes a first portion of a second data block of the data matrix separate from a second portion of the second data block to generate second information for the matrix factorization system. The central processing unit processes a machine learning model for the matrix factorization system based on at least the first information provided by the first graphics processing unit and the second information provided by the second graphics processing unit.Type: GrantFiled: May 6, 2021Date of Patent: November 1, 2022Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Evelyn Duesterwald, Liana Liyow Fong, Wei Tan, Xiaolong Xie
-
Publication number: 20220198641Abstract: An approach to tree fall risk management. This approach may identify a tree in a given location. Historical data associated with the geographic location may be received in the approach. A current condition or status of the tree may be identified by the approach. The approach may analyze the foreseeable weather forecast or weather conditions in conjunction with the status of the identified tree. The approach may generate a risk score based on the information received and analyzed. The risk score may indicate the tree is likely to fall and cause damage. The approach may result in tree fall mitigation action can be generated based on the risk score.Type: ApplicationFiled: December 23, 2020Publication date: June 23, 2022Inventors: Michael S. Gordon, Evelyn Duesterwald, Valentina Salapura, Komminist Weldemariam
-
Publication number: 20220180230Abstract: Techniques are provided for decision making tasks using a hybrid approach where cooperation between an AI assessor and a human labeler controls automation of the process. In one aspect, a method for hybrid decision making automation includes: monitoring interactions between an AI assistant and a human decision maker; tracking, from the interactions, agreement of the human decision maker with decision predictions made by the AI assistant; determining a predicted performance of data tasks by the AI assistant on unseen data based on the agreement of the human decision maker with the decision predictions over time; and assessing delegation of remaining data tasks on the unseen data to the AI assistant using the predicted performance.Type: ApplicationFiled: December 7, 2020Publication date: June 9, 2022Inventors: EVELYN DUESTERWALD, Michael Desmond, Kristina Marie Brimijoin
-
Publication number: 20220172109Abstract: A computer implemented method of performing large-scale machine learning experiments includes expanding on one or more input datasets by systematically generating several data set drift splits. A set of experimental jobs corresponding to the generated data set drift splits are executed to generate experimental results. The experimental results are processed, consolidated, and clustered according to the generated data set drift splits.Type: ApplicationFiled: December 2, 2020Publication date: June 2, 2022Inventors: Evelyn Duesterwald, Anupama Murthi, Michael Hind, Matthew Richard Arnold, Benjamin Tyler Elder, Jiri Navratil
-
Patent number: 11294759Abstract: A computer-implemented method includes obtaining data associated with execution of a model deployed in a computing environment. At least a portion of the obtained data is analyzed to detect one or more failure conditions associated with the model. One or more restoration operations are executed to generate one or more restoration results to address one or more detected failure conditions. At least a portion of the one or more restoration results is sent to the computing environment in which the model is deployed.Type: GrantFiled: December 5, 2019Date of Patent: April 5, 2022Assignee: International Business Machines CorporationInventors: Evelyn Duesterwald, Punleuk Oum, Gaodan Fang, Debashish Saha, Anupama Murthi, Waldemar Hummer
-
Publication number: 20210406760Abstract: Systems, computer-implemented methods, and computer program products to facilitate model transfer learning across evolving processes are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a condition definition component that defines one or more conditions associated with use of a model trained on first traces of a first process to make a prediction on one or more second traces of a second process. The computer executable components can further comprise a guardrail component that determines whether to use the model to make the prediction.Type: ApplicationFiled: June 25, 2020Publication date: December 30, 2021Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
-
Patent number: 11206228Abstract: Aspects of the present invention disclose a method, computer program product, and system for detecting and mitigating adversarial virtual interactions. The method includes one or more processors initiating a mitigation protocol on interactions between the user and the virtual agent, wherein the mitigation protocol is based on the actions performed by the user while interacting with the virtual agent. The method further includes one or more processors, in response to initiating the mitigation protocol on interactions between the user and the virtual agent, generating a lower fidelity response from the virtual agent to the user, wherein the lower fidelity response is a progressive dilution of the precision of language of an original response from the virtual agent to the user prior to the user exceeding the risk level threshold.Type: GrantFiled: January 20, 2020Date of Patent: December 21, 2021Assignee: International Business Machines CorporationInventors: Guillaume A. Baudart, Julian T. Dolby, Evelyn Duesterwald, David J. Piorkowski
-
Patent number: 11175935Abstract: Embodiments include method, systems and computer program products for a path-sensitive contextual help system. In some embodiments, user actions are obtained from a user session of a user. A concrete user action trace is captured using the obtained user actions, wherein the concrete user action trace is a subset of user actions from the user session. An abstract user action trace is generated using the concrete user action trace. A help action corresponding to the abstract user action trace is identified and, in some embodiments, is presented to the user.Type: GrantFiled: January 14, 2020Date of Patent: November 16, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Evelyn Duesterwald, John C. Thomas, Patrick A. Wagstrom
-
Patent number: 11146471Abstract: A process trace updating method, system, and computer program product include retrieving, by a computing device, one or more historical executions of a process, receiving, by the computing device, a proposed incremental change, with regard to the process, for a proposed process, updating, by the computing device, the historical execution to build a machine learning model, and generating, by the computing device, a decision and a prediction about execution of the proposed process based upon the machine-learning model.Type: GrantFiled: February 28, 2020Date of Patent: October 12, 2021Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy
-
Publication number: 20210273871Abstract: A process trace updating method, system, and computer program product include retrieving, by a computing device, one or more historical executions of a process, receiving, by the computing device, a proposed incremental change, with regard to the process, for a proposed process, updating, by the computing device, the historical execution to build a machine learning model, and generating, by the computing device, a decision and a prediction about execution of the proposed process based upon the machine-learning model.Type: ApplicationFiled: February 28, 2020Publication date: September 2, 2021Inventors: Evelyn Duesterwald, Vatche Isahagian, Vinod Muthusamy