Patents by Inventor Jonathan Herzig

Jonathan Herzig has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240086436
    Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.
    Type: Application
    Filed: November 20, 2023
    Publication date: March 14, 2024
    Inventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
  • Patent number: 11868381
    Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.
    Type: Grant
    Filed: March 29, 2021
    Date of Patent: January 9, 2024
    Assignee: Google LLC
    Inventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
  • Publication number: 20220309087
    Abstract: Systems and methods for pre-training and fine-tuning of neural-network-based language models to reason directly over tables without generating logical forms. In some examples, a language model can be pre-trained using masked-language modeling tasks synthetically generated from tables pulled from a knowledge corpus. In some examples, the language model may be further pre-trained using pairs of counterfactual statements generated from those tables, and/or one or more statements that compare selected data from those tables. The language model may then be fine-tuned using examples that include only a question, an answer, and a table, allowing fine-tuning examples to be harvested directly from existing benchmark datasets or synthetically generated.
    Type: Application
    Filed: March 29, 2021
    Publication date: September 29, 2022
    Inventors: Thomas Müller, Jonathan Herzig, Pawel Nowak, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene
  • Patent number: 11270061
    Abstract: Embodiments may provide techniques to generate training data for summarization of complex documents, such as scientific papers, articles, etc., that are scalable to provide large scale training data. For example, in an embodiment, a method may be implemented in a computer system and may comprise collecting a plurality of video and audio recordings of presentations of documents, collecting a plurality of documents corresponding to the video and audio recordings, converting the plurality of video and audio recordings of presentations of documents into transcripts of the plurality of presentations, generating a summary of each document by selecting a plurality of sentences from each document using the transcript of the that document, generating a dataset comprising a plurality of the generated summaries, and training a machine learning model using the generated dataset.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: March 8, 2022
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, Achiya Jerbi, David Konopnicki, Guy Lev, Michal Shmueli-Scheuer
  • Patent number: 11188809
    Abstract: A method, computer system, and a computer program product for optimizing a plurality of personality traits of a virtual agent based on a predicted customer satisfaction value is provided. The present invention may include identifying a customer. The present invention may also include retrieving a plurality of data associated with the customer. The present invention may then include analyzing the received plurality of data using a customer satisfaction prediction model. The present invention may further include generating a plurality of analyzed data from the customer satisfaction prediction model based on the analyzed plurality of data. The present invention may also include generating a plurality of personality traits for a virtual agent from the generated plurality of analyzed data.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: November 30, 2021
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
  • Patent number: 11183203
    Abstract: Embodiments of the present systems and methods may provide techniques by which bots may be analyzed using improved representations of bot structure and a means of assessing conversational quality that may provide improved efficiency. For example a method may comprise training, at a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, a neural network model to learn representations that capture characteristics of the graphs of chatbots, wherein the captured characteristics include at least a content-based representation based on user utterances that are relevant to the nodes and based on the chatbot response for the nodes.
    Type: Grant
    Filed: April 16, 2019
    Date of Patent: November 23, 2021
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Publication number: 20210264097
    Abstract: Embodiments may provide techniques to generate training data for summarization of complex documents, such as scientific papers, articles, etc., that are scalable to provide large scale training data. For example, in an embodiment, a method may be implemented in a computer system and may comprise collecting a plurality of video and audio recordings of presentations of documents, collecting a plurality of documents corresponding to the video and audio recordings, converting the plurality of video and audio recordings of presentations of documents into transcripts of the plurality of presentations, generating a summary of each document by selecting a plurality of sentences from each document using the transcript of the that document, generating a dataset comprising a plurality of the generated summaries, and training a machine learning model using the generated dataset.
    Type: Application
    Filed: February 25, 2020
    Publication date: August 26, 2021
    Inventors: JONATHAN HERZIG, ACHIYA JERBI, DAVID KONOPNICKI, GUY LEV, MICHAL SHMUELI-SCHEUER
  • Publication number: 20200335124
    Abstract: Embodiments of the present systems and methods may provide techniques by which bots may be analyzed using improved representations of bot structure and a means of assessing conversational quality that may provide improved efficiency. For example a method may comprise training, at a computer system comprising a processor, memory accessible by the processor, and computer program instructions stored in the memory and executable by the processor, a neural network model to learn representations that capture characteristics of the graphs of chatbots, wherein the captured characteristics include at least a content-based representation based on user utterances that are relevant to the nodes and based on the chatbot response for the nodes.
    Type: Application
    Filed: April 16, 2019
    Publication date: October 22, 2020
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Patent number: 10733384
    Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: August 4, 2020
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Publication number: 20190286705
    Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.
    Type: Application
    Filed: June 7, 2019
    Publication date: September 19, 2019
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Patent number: 10372825
    Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.
    Type: Grant
    Filed: December 18, 2017
    Date of Patent: August 6, 2019
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Publication number: 20190188261
    Abstract: Utilizing a computing device to detect and respond to emotion in dialog systems. The computing device receives a dialog structure comprising a plurality of dialog nodes. The computing device determines a node emotion level for each of the dialog nodes in the dialog structure based on analysis of one or more intents of each of the dialog nodes in the dialog structure. The computing device determines emotional hotspot nodes in the dialog structure, the node emotion level for each of the emotional hotspot nodes exceeding an emotional threshold. The computing device generates one or more responses modifying the node emotion level of each of the emotional hotspot nodes.
    Type: Application
    Filed: December 18, 2017
    Publication date: June 20, 2019
    Inventors: Jonathan Herzig, David Konopnicki, Tommy Sandbank, Michal Shmueli-Scheuer
  • Publication number: 20180374000
    Abstract: A method, computer system, and a computer program product for optimizing a plurality of personality traits of a virtual agent based on a predicted customer satisfaction value is provided. The present invention may include identifying a customer. The present invention may also include retrieving a plurality of data associated with the customer. The present invention may then include analyzing the received plurality of data using a customer satisfaction prediction model. The present invention may further include generating a plurality of analyzed data from the customer satisfaction prediction model based on the analyzed plurality of data. The present invention may also include generating a plurality of personality traits for a virtual agent from the generated plurality of analyzed data.
    Type: Application
    Filed: June 27, 2017
    Publication date: December 27, 2018
    Inventors: Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
  • Publication number: 20180012230
    Abstract: Embodiments of the present invention provide systems and methods for detecting emotions with social media settings. Integral-based, emotion-based, and temporal-based features are used to assess the context of a dialogue between two parties. Social media features and textual features are also considered in order to detect the emotions of a party by assessing the popularity of the party and non-contextual factors within the dialogue, respectively.
    Type: Application
    Filed: July 11, 2016
    Publication date: January 11, 2018
    Inventors: Guy Feigenblat, Jonathan Herzig, David Konopnicki, Michal Shmueli-Scheuer
  • Patent number: 9852478
    Abstract: Identifying influencers in a computer network by adjusting influence weights of corresponding participants of a computer network, where the influence weights relate to a topic, where each of the influence weights is adjusted in accordance with a predefined adjustment function, and where the predefined adjustment function uses a) the influence weight of any of the participants that disseminated content via the computer network, where the content relates to the participant whose influence weight is being adjusted, b) a participant topic similarity value of any of the participants that disseminated the content, where the participant topic similarity value relates to the topic, and c) a relationship topic similarity value of any relationship between the participants that disseminated the content and the participant whose influence weight is being adjusted, where the relationship topic similarity value relates to the topic, and then ranking the participants by their influence weights.
    Type: Grant
    Filed: August 20, 2014
    Date of Patent: December 26, 2017
    Assignee: International Business Machines Corporation
    Inventors: Jonathan Herzig, Yosi Mass, Haggai Roitman
  • Publication number: 20160055253
    Abstract: Identifying influencers in a computer network by adjusting influence weights of corresponding participants of a computer network, where the influence weights relate to a topic, where each of the influence weights is adjusted in accordance with a predefined adjustment function, and where the predefined adjustment function uses a) the influence weight of any of the participants that disseminated content via the computer network, where the content relates to the participant whose influence weight is being adjusted, b) a participant topic similarity value of any of the participants that disseminated the content, where the participant topic similarity value relates to the topic, and c) a relationship topic similarity value of any relationship between the participants that disseminated the content and the participant whose influence weight is being adjusted, where the relationship topic similarity value relates to the topic, and then ranking the participants by their influence weights.
    Type: Application
    Filed: August 20, 2014
    Publication date: February 25, 2016
    Inventors: Jonathan Herzig, Yosi Mass, HAGGAI ROITMAN