Patents by Inventor Jonathan Herzig
Jonathan Herzig has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20240086436Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.Type: ApplicationFiled: November 20, 2023Publication date: March 14, 2024Inventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
-
Patent number: 11868381Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.Type: GrantFiled: March 29, 2021Date of Patent: January 9, 2024Assignee: Google LLCInventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
-
Publication number: 20220309087Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.Type: ApplicationFiled: March 29, 2021Publication date: September 29, 2022Inventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
-
Patent number: 11270061Abstract: Embodiments may provide techniques to generate training data for summarization of complex documents, such as scientific papers, articles, etc., that are scalable to provide large scale training data. For example, in an embodiment, a method may be implemented in a computer system and may comprise collecting a plurality of video and audio recordings of presentations of documents, collecting a plurality of documents corresponding to the video and audio recordings, converting the plurality of video and audio recordings of presentations of documents into transcripts of the plurality of presentations, generating a summary of each document by selecting a plurality of sentences from each document using the transcript of the that document, generating a dataset comprising a plurality of the generated summaries, and training a machine learning model using the generated dataset.Type: GrantFiled: February 25, 2020Date of Patent: March 8, 2022Assignee: International Business Machines CorporationInventors: Jonathan Herzig, Achiya Jerbi, David Konopnicki, Guy Lev, Michal Shmueli-Scheuer
-
Patent number: 11188809Abstract: A method, computer system, and a computer program product for optimizing a plurality of personality traits of a virtual agent based on a predicted customer satisfaction value is provided. The present invention may include identifying a customer. The present invention may also include retrieving a plurality of data associated with the customer. The present invention may then include analyzing the received plurality of data using a customer satisfaction prediction model. The present invention may further include generating a plurality of analyzed data from the customer satisfaction prediction model based on the analyzed plurality of data. The present invention may also include generating a plurality of personality traits for a virtual agent from the generated plurality of analyzed data.Type: GrantFiled: June 27, 2017Date of Patent: November 30, 2021Assignee: International Business Machines CorporationInventors: Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
-
Patent number: 11183203Abstract: Embodiments of the present systems and methods may provide techniques by which bots may be analyzed using improved representations of bot structure and a means of assessing conversational quality that may provide improved efficiency. For example a method may comprise training, at a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, a neural network model to learn representations that capture characteristics of the graphs of chatbots, wherein the captured characteristics include at least a content-based representation based on user utterances that are relevant to the nodes and based on the chatbot response for the nodes.Type: GrantFiled: April 16, 2019Date of Patent: November 23, 2021Assignee: International Business Machines CorporationInventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Publication number: 20210264097Abstract: Embodiments may provide techniques to generate training data for summarization of complex documents, such as scientific papers, articles, etc., that are scalable to provide large scale training data. For example, in an embodiment, a method may be implemented in a computer system and may comprise collecting a plurality of video and audio recordings of presentations of documents, collecting a plurality of documents corresponding to the video and audio recordings, converting the plurality of video and audio recordings of presentations of documents into transcripts of the plurality of presentations, generating a summary of each document by selecting a plurality of sentences from each document using the transcript of the that document, generating a dataset comprising a plurality of the generated summaries, and training a machine learning model using the generated dataset.Type: ApplicationFiled: February 25, 2020Publication date: August 26, 2021Inventors: JONATHAN HERZIG, ACHIYA JERBI, DAVID KONOPNICKI, GUY LEV, MICHAL SHMUELI-SCHEUER
-
Publication number: 20200335124Abstract: Embodiments of the present systems and methods may provide techniques by which bots may be analyzed using improved representations of bot structure and a means of assessing conversational quality that may provide improved efficiency. For example a method may comprise training, at a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, a neural network model to learn representations that capture characteristics of the graphs of chatbots, wherein the captured characteristics include at least a content-based representation based on user utterances that are relevant to the nodes and based on the chatbot response for the nodes.Type: ApplicationFiled: April 16, 2019Publication date: October 22, 2020Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Patent number: 10733384Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.Type: GrantFiled: June 7, 2019Date of Patent: August 4, 2020Assignee: International Business Machines CorporationInventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Publication number: 20190286705Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.Type: ApplicationFiled: June 7, 2019Publication date: September 19, 2019Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Patent number: 10372825Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.Type: GrantFiled: December 18, 2017Date of Patent: August 6, 2019Assignee: International Business Machines CorporationInventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Publication number: 20190188261Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.Type: ApplicationFiled: December 18, 2017Publication date: June 20, 2019Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
-
Publication number: 20180374000Abstract: A method, computer system, and a computer program product for optimizing a plurality of personality traits of a virtual agent based on a predicted customer satisfaction value is provided. The present invention may include identifying a customer. The present invention may also include retrieving a plurality of data associated with the customer. The present invention may then include analyzing the received plurality of data using a customer satisfaction prediction model. The present invention may further include generating a plurality of analyzed data from the customer satisfaction prediction model based on the analyzed plurality of data. The present invention may also include generating a plurality of personality traits for a virtual agent from the generated plurality of analyzed data.Type: ApplicationFiled: June 27, 2017Publication date: December 27, 2018Inventors: Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
-
Publication number: 20180012230Abstract: Embodiments of the present invention provide systems and methods for detecting emotions with social media settings. Integral-based, emotion-based, and temporal-based features are used to assess the context of a dialogue between two parties. Social media features and textual features are also considered in order to detect the emotions of a party by assessing the popularity of the party and non-contextual factors within the dialogue, respectively.Type: ApplicationFiled: July 11, 2016Publication date: January 11, 2018Inventors: Guy Feigenblat, Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
-
Patent number: 9852478Abstract: Identifying influencers in a computer network by adjusting influence weights of corresponding participants of a computer network, where the influence weights relate to a topic, where each of the influence weights is adjusted in accordance with a predefined adjustment function, and where the predefined adjustment function uses a) the influence weight of any of the participants that disseminated content via the computer network, where the content relates to the participant whose influence weight is being adjusted, b) a participant topic similarity value of any of the participants that disseminated the content, where the participant topic similarity value relates to the topic, and c) a relationship topic similarity value of any relationship between the participants that disseminated the content and the participant whose influence weight is being adjusted, where the relationship topic similarity value relates to the topic, and then ranking the participants by their influence weights.Type: GrantFiled: August 20, 2014Date of Patent: December 26, 2017Assignee: International Business Machines CorporationInventors: Jonathan Herzig, Yosi Mass, Haggai Roitman
-
Publication number: 20160055253Abstract: Identifying influencers in a computer network by adjusting influence weights of corresponding participants of a computer network, where the influence weights relate to a topic, where each of the influence weights is adjusted in accordance with a predefined adjustment function, and where the predefined adjustment function uses a) the influence weight of any of the participants that disseminated content via the computer network, where the content relates to the participant whose influence weight is being adjusted, b) a participant topic similarity value of any of the participants that disseminated the content, where the participant topic similarity value relates to the topic, and c) a relationship topic similarity value of any relationship between the participants that disseminated the content and the participant whose influence weight is being adjusted, where the relationship topic similarity value relates to the topic, and then ranking the participants by their influence weights.Type: ApplicationFiled: August 20, 2014Publication date: February 25, 2016Inventors: Jonathan Herzig, Yosi Mass, HAGGAI ROITMAN