Patents by Inventor Neil R. Mallinar
Neil R. Mallinar has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11568856Abstract: A combination of propagation operations and learning algorithms is applied, using a selected set of labeled conversational logs retrieved from a subset of a plurality of conversational logs, to a remaining corpus of the plurality of conversational logs to train an automated response system according to an intent associated with each of the conversational logs. The combination of propagation operations and learning algorithms may include defining the labels by a user for the selected set of the subset of the plurality of conversational logs; training a probabilistic classifier using the defined labels of features of the selected set, wherein the probabilistic classifier produces labeling decisions for the subset of conversational logs; weighting the features of the selected set in a model optimization process; and/or training an additional classifier using the weighted features of the selected set and applying the additional classifier to the remaining corpus.Type: GrantFiled: October 21, 2020Date of Patent: January 31, 2023Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tin Kam Ho, Robert L. Yates, Blake McGregor, Rajendra G. Ugrani, Neil R. Mallinar, Abhishek Shah, Ayush Gupta
-
Patent number: 11455981Abstract: A method, apparatus, and system are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: GrantFiled: January 15, 2020Date of Patent: September 27, 2022Assignee: International Business Machines CorporationInventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar
-
Patent number: 11182557Abstract: Embodiments provide for driving intent expansion via anomaly detection by ranking, according to anomaly scores, a plurality of historic utterances that have been associated by a classifier with a given intent of a plurality of predefined intents; identifying a given utterance from the plurality of historic utterances having a given anomaly score greater than an anomaly threshold; in response to verifying that the given utterance is associated with the given intent, adding the given utterance to a training dataset as a positive example for the given intent; and in response to verifying that the given utterance is not associated with the given intent, adding the given utterance to the training dataset as a complement example for the given intent. A complement example for one intent may be added as a positive example for a different intent. The training dataset may be used to train or retrain an intent classifier.Type: GrantFiled: November 5, 2018Date of Patent: November 23, 2021Assignee: International Business Machines CorporationInventors: Neil R. Mallinar, Tin Kam Ho
-
Publication number: 20210035557Abstract: A combination of propagation operations and learning algorithms is applied, using a selected set of labeled conversational logs retrieved from a subset of a plurality of conversational logs, to a remaining corpus of the plurality of conversational logs to train an automated response system according to an intent associated with each of the conversational logs. The combination of propagation operations and learning algorithms may include defining the labels by a user for the selected set of the subset of the plurality of conversational logs; training a probabilistic classifier using the defined labels of features of the selected set, wherein the probabilistic classifier produces labeling decisions for the subset of conversational logs; weighting the features of the selected set in a model optimization process; and/or training an additional classifier using the weighted features of the selected set and applying the additional classifier to the remaining corpus.Type: ApplicationFiled: October 21, 2020Publication date: February 4, 2021Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tin Kam HO, Robert L. YATES, Blake MCGREGOR, Rajendra G. UGRANI, Neil R. MALLINAR, Abhishek SHAH, Ayush GUPTA
-
Patent number: 10832659Abstract: Embodiments for training an automated response system using weak supervision and co-training in a computing environment are provided. A plurality of conversational logs comprising interactive dialog sessions between agents and clients for a given product or service are received. A subset of the plurality of conversational logs are retrieved according to a defined criterion, and a selected set of the subset of the plurality of retrieved conversational logs are labeled by a user. The labeling is associated with a semantic scope of intent considered by the clients. A combination of propagation operations and learning algorithms using the selected set of labeled conversational logs are applied to a remaining corpus of the plurality of conversational logs to train the automated response system according to the semantic scope of intent.Type: GrantFiled: August 31, 2018Date of Patent: November 10, 2020Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tin Kam Ho, Robert L. Yates, Blake McGregor, Rajendra G. Ugrani, Neil R. Mallinar, Abhishek Shah, Ayush Gupta
-
Publication number: 20200152174Abstract: A method, apparatus, and system are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: ApplicationFiled: January 15, 2020Publication date: May 14, 2020Inventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar
-
Publication number: 20200142959Abstract: Embodiments provide for driving intent expansion via anomaly detection by ranking, according to anomaly scores, a plurality of historic utterances that have been associated by a classifier with a given intent of a plurality of predefined intents; identifying a given utterance from the plurality of historic utterances having a given anomaly score greater than an anomaly threshold; in response to verifying that the given utterance is associated with the given intent, adding the given utterance to a training dataset as a positive example for the given intent; and in response to verifying that the given utterance is not associated with the given intent, adding the given utterance to the training dataset as a complement example for the given intent. A complement example for one intent may be added as a positive example for a different intent. The training dataset may be used to train or retrain an intent classifier.Type: ApplicationFiled: November 5, 2018Publication date: May 7, 2020Inventors: Neil R. MALLINAR, Tin Kam HO
-
Patent number: 10621976Abstract: Embodiments for training a conversational system using intent classification are provided. Example utterances recommended to be associated with a particular semantic scope of intent are received from a plurality of sources. Respective ones of the example utterances from the plurality of sources are portioned and stored in a plurality of pools. The respective example utterances from the plurality of pools are collated into a unified pool according to weighting assigned to each one of the plurality of pools, the weighting associated with user actions taken on the respective example utterances. A unified set of the example utterances from the unified pool is output for selection by the user to train an intent classifier associated with the semantic scope of intent for the conversational system.Type: GrantFiled: September 18, 2018Date of Patent: April 14, 2020Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Rajendra G. Ugrani, Neil R. Mallinar
-
Publication number: 20200090638Abstract: Embodiments for training a conversational system using intent classification are provided. Example utterances recommended to be associated with a particular semantic scope of intent are received from a plurality of sources. Respective ones of the example utterances from the plurality of sources are portioned and stored in a plurality of pools. The respective example utterances from the plurality of pools are collated into a unified pool according to weighting assigned to each one of the plurality of pools, the weighting associated with user actions taken on the respective example utterances. A unified set of the example utterances from the unified pool is output for selection by the user to train an intent classifier associated with the semantic scope of intent for the conversational system.Type: ApplicationFiled: September 18, 2018Publication date: March 19, 2020Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Rajendra G. UGRANI, Neil R. MALLINAR
-
Publication number: 20200074984Abstract: Embodiments for training an automated response system using weak supervision and co-training in a computing environment are provided. A plurality of conversational logs comprising interactive dialog sessions between agents and clients for a given product or service are received. A subset of the plurality of conversational logs are retrieved according to a defined criterion, and a selected set of the subset of the plurality of retrieved conversational logs are labeled by a user. The labeling is associated with a semantic scope of intent considered by the clients. A combination of propagation operations and learning algorithms using the selected set of labeled conversational logs are applied to a remaining corpus of the plurality of conversational logs to train the automated response system according to the semantic scope of intent.Type: ApplicationFiled: August 31, 2018Publication date: March 5, 2020Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATIONInventors: Tin Kam HO, Robert L. YATES, Blake MCGREGOR, Rajendra G. UGRANI, Neil R. MALLINAR, Abhishek SHAH, Ayush GUPTA
-
Patent number: 10553202Abstract: A method, apparatus, and system are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: GrantFiled: October 31, 2017Date of Patent: February 4, 2020Assignee: International Business Machines CorporationInventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar
-
Patent number: 10510336Abstract: A method, system, and apparatus are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: GrantFiled: June 12, 2017Date of Patent: December 17, 2019Assignee: International Business Machines CorporationInventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar
-
Publication number: 20180358001Abstract: A method, apparatus, and system are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: ApplicationFiled: October 31, 2017Publication date: December 13, 2018Inventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar
-
Publication number: 20180358000Abstract: A method, system, and apparatus are provided for resolving conflicts between training data conflicts by retrieving independent training data sets, each comprising a plurality of intents and end-user utterances for use in training one or more classifiers to recognize a corresponding intent from one or more of the end-user utterances, providing a first test end-user utterance associated with a first intent from the first independent training data set to the one or more classifiers to select an output intent generated by the one or more classifiers; identifying a first conflict when the first intent does not match the output intent, and automatically generating, by the system, one or more conflict resolution recommendations for display and selection by an end user to resolve the first conflict.Type: ApplicationFiled: June 12, 2017Publication date: December 13, 2018Inventors: David Amid, David Boaz, Tin Kam Ho, Amir Kantor, Luis A. Lastras-Montano, Neil R. Mallinar