Patents by Inventor Jalal Mahmud
Jalal Mahmud has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230334375Abstract: A system includes a memory having instructions therein and at least one processor in communication with the memory. The at least one processor is configured to execute the instructions to determine a global-level importance magnitude value for a global-level importance of an explainable feature of a machine learning base model based on a first prediction of the machine learning base model. The at least one processor is also configured to execute the instructions to determine a global-level importance direction label for the global-level importance of the explainable feature based on the first prediction. The at least one processor is also configured to execute the instructions to generate a communication for presentation to a user based on a second prediction of the machine learning base model, based on the global-level importance magnitude value, and based on the global-level importance direction label.Type: ApplicationFiled: June 28, 2023Publication date: October 19, 2023Inventors: Zhe Liu, Yufan Guo, Jalal Mahmud, Rama Kalyani T. Akkiraju
-
Patent number: 11720819Abstract: A system includes a memory having instructions therein and at least one processor in communication with the memory. The at least one processor is configured to execute the instructions to determine a global-level importance magnitude value for a global-level importance of an explainable feature of a machine learning base model based on a first prediction of the machine learning base model. The at least one processor is also configured to execute the instructions to determine a global-level importance direction label for the global-level importance of the explainable feature based on the first prediction. The at least one processor is also configured to execute the instructions to generate a communication for presentation to a user based on a second prediction of the machine learning base model, based on the global-level importance magnitude value, and based on the global-level importance direction label.Type: GrantFiled: May 29, 2020Date of Patent: August 8, 2023Assignee: International Business Machines, IncorporatedInventors: Zhe Liu, Yufan Guo, Jalal Mahmud, Rama Kalyani T. Akkiraju
-
Patent number: 11568307Abstract: A cognitive system (artificial intelligence) is optimized by assessing different data augmentation methods used to augment training data, and then training the system using a training set augmented by the best identified method. The augmentation methods are assessed by applying them to the same set of training data to generate different augmented training data sets. Respective instances of the cognitive system are trained with the augmented sets, and each instance is subjected to validation testing to assess its goodness. The validation testing can include multiple validation tests leading to component scores, and a combined validation score is computed as a weighted average of the component scores using respective weights for each validation test. The augmentation method corresponding to the instance having the highest combined validation score is selected as the optimum augmentation method for the particular cognitive system at hand.Type: GrantFiled: May 20, 2019Date of Patent: January 31, 2023Assignee: International Business Machines CorporationInventors: Jalal Mahmud, Zhe Liu
-
Patent number: 11556705Abstract: An input text that is also transmitted to a text processing service (e.g., a cloud based text processing service) is received. Characterizing information (e.g., contiguous parts of speech, terms used per part of speech, payload length, etc.) is extracted from the input text. A text payload is generated using the characterizing information. A performance test is run on the text payload. The performance test can include performing at least one selected from a group consisting of: sentiment analysis on the text payload, entity analysis on the text payload, content classification on the text payload, and syntax analysis on the text payload. The performance test can yield a processing time required to perform the performance test. Memory and processing power resource allocation to the text processing service can be altered based on the processing time of the performance test.Type: GrantFiled: October 29, 2020Date of Patent: January 17, 2023Assignee: International Business Machines CorporationInventors: Alexander Brooks, Gabriel Goodhart, Sukriti Sharma, Nhan Hoang, Jalal Mahmud, Gaurav Kumbhat, Amita Misra, Zachary Branson
-
Patent number: 11556842Abstract: A cognitive system (artificial intelligence) is optimized by assessing different data augmentation methods used to augment training data, and then training the system using a training set augmented by the best identified method. The augmentation methods are assessed by applying them to the same set of training data to generate different augmented training data sets. Respective instances of the cognitive system are trained with the augmented sets, and each instance is subjected to validation testing to assess its goodness. The validation testing can include multiple validation tests leading to component scores, and a combined validation score is computed as a weighted average of the component scores using respective weights for each validation test. The augmentation method corresponding to the instance having the highest combined validation score is selected as the optimum augmentation method for the particular cognitive system at hand.Type: GrantFiled: July 14, 2019Date of Patent: January 17, 2023Assignee: International Business Machines CorporationInventors: Jalal Mahmud, Zhe Liu
-
Patent number: 11526802Abstract: A method and a system for model training are provided. The method can include training a first classifier, a second classifier, and a third classifier with subsets of a labeled dataset. The method can also include predicting a pseudo labeled dataset from an unlabeled dataset using the first classifier, the second classifier, and the third classifier. The method further includes assigning a role to the first classifier, to the second classifier, and to the third classifier. The method can further include selecting a teaching sample dataset from the pseudo labeled dataset based on the role assigned to the third classifier, wherein the third classifier is assigned a role of a student. The method can also include retraining the third classifier with the teaching sample dataset in conjunction with a subset of the labeled dataset.Type: GrantFiled: June 25, 2019Date of Patent: December 13, 2022Assignee: International Business Machines CorporationInventors: Zhe Liu, Amita Misra, Pritam Gundecha, Jalal Mahmud, Yash Bhalgat
-
Patent number: 11461376Abstract: Embodiments provide a computer implemented method of evaluating one or more IR systems, the method including: providing, by a processor, a pre-indexed knowledge-based document to a pre-trained sentence identification model; identifying, by the sentence identification model, a predetermined number of query-worthy sentences from the pre-indexed knowledge-based document, wherein the query-worthy sentences are ranked based on a prediction probability value of each query-worthy sentence; providing, by the sentence identification model, the query-worthy sentences to a pre-trained query generation model; generating, by the query generation model, a query for each query-worthy sentence; and evaluating, by the processor, the one or more IR systems using the generated queries, wherein one or more searches are performed via the one or more IR systems, and the one or more searches are performed in a set of knowledge-based documents including the pre-indexed knowledge-based document.Type: GrantFiled: July 10, 2019Date of Patent: October 4, 2022Assignee: International Business Machines CorporationInventors: Zhe Liu, Peifeng Yin, Jalal Mahmud, Rama Kalyani T. Akkiraju, Yufan Guo
-
Patent number: 11443209Abstract: A method, system, and a computer program product automatically select training data for updating a model by applying human-annotated training data to a model to generate results that are evaluated to identify correct case results and false case results that are categorized into error type categories for use in building error models corresponding to the error type categories, where each error model is built from at least failed case results belonging to a corresponding error type, and where unlabeled data samples are applied to each error model to compute an error likelihood for each unlabeled data sample with respect to each error type category, thereby enabling the selection and display of unlabeled data samples for annotation by a subject matter expert based on a computed error likelihood for the one or more unlabeled data samples in a specified error type category meeting or exceeding an error threshold requirement.Type: GrantFiled: April 16, 2020Date of Patent: September 13, 2022Assignee: International Business Machines CorporationInventors: Jalal Mahmud, Amita Misra, Pritam Gundecha, Zhe Liu, Rama Kalyani T. Akkiraju, Xiaotong Liu, Anbang Xu
-
Patent number: 11430426Abstract: An enhanced information retrieval system takes a customer utterance and constructs a contextually-enriched content-based query allowing the system to retrieve the most relevant documents to assist an agent in a real-time conversation with the customer. Phrases in the utterance are classified as informational or non-informational using a machine learning system trained with phrases from prior conversations of multiple users. Content phrases are extracted from the informational phrases using keyword extraction (ranking noun phrases), intent/action extraction (semantic role labeling), and topic label extraction (clustering of historical logs). Emotional content is identified using a sequence tagging model and removed. Contextual information from prior conversations with this user is combined with the updated content phrases to create the contextually-enhanced content-based query, which can then be submitted to the information retrieval system.Type: GrantFiled: April 1, 2020Date of Patent: August 30, 2022Assignee: International Business Machines CorporationInventors: Rupaningal Sarasi Sarangi Lalithsena, Jalal Mahmud, Rama Kalyani T. Akkiraju
-
Patent number: 11386273Abstract: A method, system and computer-usable medium are disclosed for sentiment detection based on applying an antonym dictionary to a natural language processing (NLP) system. A binary classifier is trained to predict negation cues, where a constituency parse tree is used to create rules for scope detection. The trained binary classifier, a list of conversational negation terms, and a list of antonyms are used to annotate content that considers negation cues and scope for the created rules.Type: GrantFiled: November 18, 2019Date of Patent: July 12, 2022Assignee: International Business Machines CorporationInventors: Amita Misra, Jalal Mahmud, Saurabh Tripathy
-
Publication number: 20220138419Abstract: An input text that is also transmitted to a text processing service is received. Characterizing information is extracted from the input text. A text payload is generated using the characterizing information. A performance test is run on the text payload.Type: ApplicationFiled: October 29, 2020Publication date: May 5, 2022Inventors: Alexander Brooks, Gabriel Goodhart, SUKRITI SHARMA, Nhan Hoang, Jalal Mahmud, Gaurav Kumbhat, Amita Misra, Zachary Branson
-
Publication number: 20210374601Abstract: A system includes a memory having instructions therein and at least one processor in communication with the memory. The at least one processor is configured to execute the instructions to determine a global-level importance magnitude value for a global-level importance of an explainable feature of a machine learning base model based on a first prediction of the machine learning base model. The at least one processor is also configured to execute the instructions to determine a global-level importance direction label for the global-level importance of the explainable feature based on the first prediction. The at least one processor is also configured to execute the instructions to generate a communication for presentation to a user based on a second prediction of the machine learning base model, based on the global-level importance magnitude value, and based on the global-level importance direction label.Type: ApplicationFiled: May 29, 2020Publication date: December 2, 2021Inventors: Zhe Liu, Yufan Guo, Jalal Mahmud, Rama Kalyani T. Akkiraju
-
Publication number: 20210326719Abstract: A method, system, and a computer program product automatically select training data for updating a model by applying human-annotated training data to a model to generate results that are evaluated to identify correct case results and false case results that are categorized into error type categories for use in building error models corresponding to the error type categories, where each error model is built from at least failed case results belonging to a corresponding error type, and where unlabeled data samples are applied to each error model to compute an error likelihood for each unlabeled data sample with respect to each error type category, thereby enabling the selection and display of unlabeled data samples for annotation by a subject matter expert based on a computed error likelihood for the one or more unlabeled data samples in a specified error type category meeting or exceeding an error threshold requirement.Type: ApplicationFiled: April 16, 2020Publication date: October 21, 2021Inventors: Jalal Mahmud, Amita Misra, Pritam Gundecha, Zhe Liu, Rama Kalyani T. Akkiraju, Xiaotong Liu, Anbang Xu
-
Publication number: 20210312900Abstract: An enhanced information retrieval system takes a customer utterance and constructs a contextually-enriched content-based query allowing the system to retrieve the most relevant documents to assist an agent in a real-time conversation with the customer. Phrases in the utterance are classified as informational or non-informational using a machine learning system trained with phrases from prior conversations of multiple users. Content phrases are extracted from the informational phrases using keyword extraction (ranking noun phrases), intent/action extraction (semantic role labeling), and topic label extraction (clustering of historical logs). Emotional content is identified using a sequence tagging model and removed. Contextual information from prior conversations with this user is combined with the updated content phrases to create the contextually-enhanced content-based query, which can then be submitted to the information retrieval system.Type: ApplicationFiled: April 1, 2020Publication date: October 7, 2021Inventors: Rupaningal Sarasi Sarangi Lalithsena, Jalal Mahmud, Rama Kalyani T. Akkiraju
-
Patent number: 11132511Abstract: A system configured to predict fine-grained affective states. The system comprising a processor configured to execute instructions to create training data comprising content conveying emotions, and to create a trained model by performing an emotion vector space model training process using the training data to train a model using a feed forward neural network that converts discrete emotions into emotion vector representations. The system uses the trained model to predict fine-grained affective states for text conveying an emotion.Type: GrantFiled: February 5, 2019Date of Patent: September 28, 2021Assignee: International Business Machines CorporationInventors: Zhe Liu, Jalal Mahmud, Anbang Xu, Yufan Guo, Haibin Liu, Rama Kalyani T. Akkiraju
-
Patent number: 11134201Abstract: A method, a device, a system, a computer program product, and a computer system drives a vehicle with vision assistance. The device includes an imager vertically extendable from a surface of a vehicle from a retracted position to an extended position. The imager is configured to capture images from a predetermined height above the vehicle while the imager is in the extended position. The images capture a field of view including a predetermined distance from the vehicle. The device includes a mount coupled to the imager and having an extendable length to position the imager in the retracted position and the extended position. The device includes a processor configured to process the images to determine a recommendation for driving the vehicle based on driving conditions present at the predetermined distance based on the images.Type: GrantFiled: August 20, 2019Date of Patent: September 28, 2021Assignee: International Business Machines CorporationInventors: Luna Xu, Jalal Mahmud
-
Publication number: 20210149995Abstract: A method, system and computer-usable medium are disclosed for sentiment detection based on applying an antonym dictionary to a natural language processing (NLP) system. A binary classifier is trained to predict negation cues, where a constituency parse tree is used to create rules for scope detection. The trained binary classifier, a list of conversational negation terms, and a list of antonyms are used to annotate content that considers negation cues and scope for the created rules.Type: ApplicationFiled: November 18, 2019Publication date: May 20, 2021Inventors: Amita Misra, Jalal Mahmud, Saurabh Tripathy
-
Patent number: 11010564Abstract: A computer-implemented method for fine-grained affective states prediction. The computer-implemented method creates training data comprising content conveying emotions. The method creates a trained model by performing an emotion vector space model training process using the training data to train a model using a feed forward neural network that converts discrete emotions into emotion vector representations. The trained model can be used to predict fine-grained affective states for text conveying an emotion.Type: GrantFiled: July 10, 2019Date of Patent: May 18, 2021Assignee: International Business Machines CorporationInventors: Zhe Liu, Jalal Mahmud, Anbang Xu, Yufan Guo, Haibin Liu, Rama Kalyani T. Akkiraju
-
Publication number: 20210058555Abstract: A method, a device, a system, a computer program product, and a computer system drives a vehicle with vision assistance. The device includes an imager vertically extendable from a surface of a vehicle from a retracted position to an extended position. The imager is configured to capture images from a predetermined height above the vehicle while the imager is in the extended position. The images capture a field of view including a predetermined distance from the vehicle. The device includes a mount coupled to the imager and having an extendable length to position the imager in the retracted position and the extended position. The device includes a processor configured to process the images to determine a recommendation for driving the vehicle based on driving conditions present at the predetermined distance based on the images.Type: ApplicationFiled: August 20, 2019Publication date: February 25, 2021Inventors: Luna Xu, Jalal Mahmud
-
Publication number: 20210011933Abstract: Embodiments provide a computer implemented method of evaluating one or more IR systems, the method including: providing, by a processor, a pre-indexed knowledge-based document to a pre-trained sentence identification model; identifying, by the sentence identification model, a predetermined number of query-worthy sentences from the pre-indexed knowledge-based document, wherein the query-worthy sentences are ranked based on a prediction probability value of each query-worthy sentence; providing, by the sentence identification model, the query-worthy sentences to a pre-trained query generation model; generating, by the query generation model, a query for each query-worthy sentence; and evaluating, by the processor, the one or more IR systems using the generated queries, wherein one or more searches are performed via the one or more IR systems, and the one or more searches are performed in a set of knowledge-based documents including the pre-indexed knowledge-based document.Type: ApplicationFiled: July 10, 2019Publication date: January 14, 2021Inventors: Zhe Liu, Peifeng Yin, Jalal Mahmud, Rama Kalyani T. Akkiraju, Yufan Guo