Patents by Inventor Julien KLOETZER

Julien KLOETZER has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230385558
    Abstract: A text classifier 90 for answer identification is capable of highly accurate identification of an answer candidate to a question, by effectively using background knowledge related to the question, in order to extract an answer candidate to the question, the text classifier including: a BERT (Bidirectional Encoder Representation from Transformers) receiving a question and an answer candidate as inputs; a knowledge integration transformer receiving the output of BERT as an input; a background knowledge representation generator receiving a question and an answer as inputs and generating a group of background knowledge representation vectors for the question; and a vector converter respectively converting the question and the answer candidate to embedded vectors and inputting the same to the background knowledge representation generator.
    Type: Application
    Filed: October 13, 2021
    Publication date: November 30, 2023
    Inventors: Jonghoon OH, Kentaro TORISAWA, Julien KLOETZER, Ryu IIDA
  • Publication number: 20220253599
    Abstract: A program for training a representation generator generating a representation representing an answer part included in a passage to classify whether the passage is related to an answer or not. The program causes a computer to operate as: a fake representation generator responsive to a question and a passage for outputting a fake representation representing an answer part of the passage; a real representation generator for outputting, for the question and a core answer, a real representation representing the core answer, in the same format as fake representation; a discriminator for discriminating whether fake representation and real representation are a real or fake representation; and a generative adversarial network unit training the discriminator and fake representation generator through generative adversarial network such that error determination of fake representation is maximized and error determination of real representation is minimized.
    Type: Application
    Filed: July 6, 2020
    Publication date: August 11, 2022
    Inventors: Jonghoon OH, Kazuma KADOWAKI, Julien KLOETZER, Ryu IIDA, Kentaro TORISAWA
  • Patent number: 11256658
    Abstract: A causality recognizing apparatus includes a candidate vector generating unit configured to receive a causality candidate for generating a candidate vector representing a word sequence forming the candidate; a context vector generating unit generating a context vector representing a context in which noun-phrases of cause and effect parts of the causality candidate appear; a binary pattern vector generating unit, an answer vector generating unit and a related passage vector generating unit, generating a word vector representing background knowledge for determining whether or not there is causality between the noun-phrase included in the cause part and the noun-phrase included in the effect part; and a multicolumn convolutional neural network learned in advance to receive these word vectors and to determine whether or not the causality candidate has causality.
    Type: Grant
    Filed: September 28, 2017
    Date of Patent: February 22, 2022
    Assignee: NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY
    Inventors: Canasai Kruengkrai, Chikara Hashimoto, Kentaro Torisawa, Julien Kloetzer, Jonghoon Oh, Masahiro Tanaka
  • Patent number: 11176328
    Abstract: A question answering device includes: a general word vector converter converting a question and an answer to semantic vectors in accordance with general context; a general sentence level CNN 214, in response to similarities of semantic vectors between words in question and answer and to strength of causality between the words, for weighting each semantic vector to calculate sentence level representations of the question and the answer; a general passage level CNN 218, in response to similarity between sentence level representations of question and answer, and to strength of relation of vectors in the sentence level representations viewed from causality, for weighting the sentence level representation to calculate a passage level representation for the question and answer passage; and a classifier determining whether or not an answer is a correct answer, based on the similarities between outputs from CNNs 214 and 218.
    Type: Grant
    Filed: June 14, 2018
    Date of Patent: November 16, 2021
    Assignee: National Institute of Information and Communications Technology
    Inventors: Jonghoon Oh, Kentaro Torisawa, Canasai Kruengkrai, Ryu Iida, Julien Kloetzer
  • Publication number: 20210326675
    Abstract: A memory for a question-answering device that reduces influence of noise on answer generation and is capable of generating highly accurate answers includes: a memory configured to normalize vector expressions of answers included in a set of answers extracted from a prescribed background knowledge source for each of a plurality of mutually different questions and to store the results as normalized vectors; and a key-value memory access unit responsive to application of a question vector derived from a question for accessing the memory and for updating the question vector by using a degree of relatedness between the question vector and the plurality of questions and using the normalized vectors corresponding to respective ones of the plurality of questions.
    Type: Application
    Filed: June 18, 2019
    Publication date: October 21, 2021
    Inventors: Jonghoon OH, Kentaro TORISAWA, Canasai KRUENGKRAI, Julien KLOETZER, Ryu IIDA, Ryo ISHIDA, Yoshihiko ASAO
  • Publication number: 20210286948
    Abstract: A causality recognizing apparatus includes a candidate vector generating unit configured to receive a causality candidate for generating a candidate vector representing a word sequence forming the candidate; a context vector generating unit generating a context vector representing a context in which noun-phrases of cause and effect parts of the causality candidate appear; a binary pattern vector generating unit, an answer vector generating unit and a related passage vector generating unit, generating a word vector representing background knowledge for determining whether or not there is causality between the noun-phrase included in the cause part and the noun-phrase included in the effect part; and a multicolumn convolutional neural network learned in advance to receive these word vectors and to determine whether or not the causality candidate has causality.
    Type: Application
    Filed: September 28, 2017
    Publication date: September 16, 2021
    Inventors: Canasai KRUENGKRAI, Chikara HASHIMOTO, Kentaro TORISAWA, Julien KLOETZER, Jonghoon OH, Masahiro TANAKA
  • Patent number: 11106714
    Abstract: A summary generating apparatus includes a text storage device storing text with information indicating a portion to be focused on; word vector converters vectorizing each word of the text and adding an element indicating whether the word is focused on or not to the vector and thereby converting the text to a word vector sequence; an LSTM implemented by a neural network performing sequence-to-sequence type conversion, pre-trained by machine learning to output, in response to each of the word vectors of the word vector sequence input in a prescribed order, a summary of the text consisting of the words represented by the word sequence; and input units inputting each of the word vectors of the word vector sequence in the prescribed order to the neural network.
    Type: Grant
    Filed: May 7, 2018
    Date of Patent: August 31, 2021
    Assignee: National Institute of Information and Communications Technology
    Inventors: Ryu Iida, Kentaro Torisawa, Jonghoon Oh, Canasai Kruengkrai, Yoshihiko Asao, Noriyuki Abe, Junta Mizuno, Julien Kloetzer
  • Publication number: 20200202233
    Abstract: [Object] An object is to provide a future scenario generating device capable of generating a huge number of appropriate future scenarios. [Solution] A future scenario generating device 272 includes: phrase pair DB 92 storing a large number of causality phrase pairs; a causality network building device 290 building a causality network by linking, of the phrases stored in causality phrase pair DB 92, phrases connectable as causality, using as a start point a phrase forming a main part of a question received by a question input unit 280; a community detecting device 294 detecting a community in the causality network; and a future scenario generating unit 298 generating a future scenario by linking phrases connectable as causality and belonging to the same community as the phrase as the start point until a predetermined end condition is satisfied.
    Type: Application
    Filed: July 29, 2016
    Publication date: June 25, 2020
    Inventors: Chikara HASHIMOTO, Kentaro TORISAWA, Julien KLOETZER, Jonghoon OH, Masahiro TANAKA, Wushouer MAIRIDAN
  • Publication number: 20200159755
    Abstract: A summary generating apparatus includes; a text storage device storing text with information indicating a portion to be focused on; word vector converters vectorizing each word of the text and adding an element indicating whether the word is focused on or not to the vector and thereby converting the text to a word vector sequence; an LSTM implemented by a neural network performing sequence-to-sequence type conversion, pre-trained by machine learning to output, in response to each of the word vectors of the word vector sequence input in a prescribed order, a summary of the text consisting of the words represented by the word sequence; and input units inputting each of the word vectors of the word vector sequence in the prescribed order to the neural network.
    Type: Application
    Filed: May 7, 2018
    Publication date: May 21, 2020
    Inventors: Ryu IIDA, Kentaro TORISAWA, Jonghoon OH, Canasai KRUENGKRAI, Yoshihiko ASAO, Noriyuki ABE, Junta MIZUNO, Julien KLOETZER
  • Publication number: 20200134263
    Abstract: A question answering device includes: a general word vector converter converting a question and an answer to semantic vectors in accordance with general context; a general sentence level CNN 214, in response to similarities of semantic vectors between words in question and answer and to strength of causality between the words, for weighting each semantic vector to calculate sentence level representations of the question and the answer; a general passage level CNN 218, in response to similarity between sentence level representations of question and answer, and to strength of relation of vectors in the sentence level representations viewed from causality, for weighting the sentence level representation to calculate a passage level representation for the question and answer passage; and a classifier determining whether or not an answer is a correct answer, based on the similarities between outputs from CNNs 214 and 218.
    Type: Application
    Filed: June 14, 2018
    Publication date: April 30, 2020
    Inventors: Jonghoon OH, Kentaro TORISAWA, Canasai KRUENGKRAI, Ryu IIDA, Julien KLOETZER
  • Publication number: 20200034722
    Abstract: A question-answering system includes a storage unit storing expressions representing causality; an answer receiving unit receiving a question and answer passages each including an answer candidate to the question; a causality expression extracting unit extracting a causality expression from each of the answer passages; a relevant causality expression extracting unit selecting, for a combination of the question and an answer passage, an expression most relevant to the combination, from the storage unit; and a neural network receiving the question, the answer passages, semantic relation expressions related to the answer passages, and one of the relevant expressions for the combination of the question and the answer passages, and selecting an answer to the question from the answer passages.
    Type: Application
    Filed: October 2, 2017
    Publication date: January 30, 2020
    Inventors: Jonghoon OH, Kentaro TORISAWA, Canasai KRUENGKRAI, Ryu IIDA, Julien KLOETZER
  • Patent number: 10380149
    Abstract: [Object] To provide a device assisting a user to easily generate, in relation to an issue of interest to the user, a question sentence guaranteed to have an answer of a certain accuracy or higher in a question-answering system. [Solution] A question sentence generating device is used with a question-answering system, and it includes: word receiving means for receiving a word 480 as a source for generating a question sentence; and question sentence generating database 502 comprised of a plurality of entries for generating a question sentence. Each of the plurality of entries has a word as a key and includes an answer sentence pattern co-occurring with the word, used in the question-answering system.
    Type: Grant
    Filed: August 10, 2015
    Date of Patent: August 13, 2019
    Assignee: National Institute of Information and Communications Technology
    Inventors: Kentaro Torisawa, Jun Goto, Julien Kloetzer, Takuya Kawada
  • Patent number: 10380250
    Abstract: An entailment pattern pair extension apparatus 50 extends entailment pairs by generating an n-term entailment pair from an m-term entailment pair, where m and n are integers not smaller than 0 and satisfying m<n. Each entailment pair includes a first language pattern and a second language pattern entailed by the first language pattern. Entailment pattern pair extension apparatus 50 includes: a generation rule storage unit 110 storing generation rules for generating n-term entailment pairs from m-term entailment pairs, and a binary pair adding unit 112 receiving m-term entailment pair, determining, for each generation rule stored in the generation rule storage unit 110, whether its condition is satisfied by the m-term pair, and if the condition is satisfied, applying a modification rule of the generation rule to each language pattern constituting the m-term entailment pair.
    Type: Grant
    Filed: February 9, 2016
    Date of Patent: August 13, 2019
    Assignee: National Institute of Information and Communications Technology
    Inventors: Takuya Kawada, Julien Kloetzer, Kentaro Torisawa
  • Publication number: 20190188257
    Abstract: A context analysis apparatus includes an analysis control unit for detecting a predicate of which subject is omitted and antecedent candidates thereof, and an anaphora/ellipsis analysis unit determining a word to be identified. The anaphora/ellipsis analysis unit includes: word vector generating units generating a plurality of different types of word vectors from sentences for the antecedent candidates; a convolutional neural network receiving as an input a word vector and trained to output a score indicating the probability of each antecedent candidate being the omitted word; and a list storage unit and a identification unit determining a antecedent candidate having the highest score. The word vectors include a plurality of word vectors each extracted at least by using the object of analysis and character sequences of the entire sentences other than the candidates. Similar processing is also possible on other words such as a referring expression.
    Type: Application
    Filed: August 30, 2017
    Publication date: June 20, 2019
    Inventors: Ryu IIDA, Kentaro TORISAWA, Canasai KRUENGKRAI, Jonghoon OH, Julien KLOETZER
  • Publication number: 20180246953
    Abstract: A training device includes: a question issuing unit issuing a question stored in a question and expected answer storage unit to a question answering system; an answer candidate filtering unit, an answer candidate determining unit, training data generating/labeling unit, and a training data selecting unit, generating and adding to a training data storage unit training data for a ranking unit of question answering system, from pairs of a question and each of a plurality of answer candidates output with scores from why-question answering system; and an iteration control unit controlling question issuing unit, answer candidate filtering unit, answer candidate determining unit, training data generating/labeling unit and training data selecting unit such that training of the training device, issuance of question and addition of training data are repeated until an end condition is satisfied.
    Type: Application
    Filed: August 26, 2016
    Publication date: August 30, 2018
    Inventors: Jonghoon OH, Kentaro TORISAWA, Chikara HASHIMOTO, Ryu IIDA, Masahiro TANAKA, Julien KLOETZER
  • Publication number: 20180067922
    Abstract: An entailment pattern pair extension apparatus 50 extends entailment pairs by generating an n-term entailment pair from an m-term entailment pair, where m and n are integers not smaller than 0 and satisfying m<n. Each entailment pair includes a first language pattern and a second language pattern entailed by the first language pattern. Entailment pattern pair extension apparatus 50 includes: a generation rule storage unit 110 storing generation rules for generating n-term entailment pairs from m-term entailment pairs, and a binary pair adding unit 112 receiving m-term entailment pair, determining, for each generation rule stored in the generation rule storage unit 110, whether its condition is satisfied by the m-term pair, and if the condition is satisfied, applying a modification rule of the generation rule to each language pattern constituting the m-term entailment pair.
    Type: Application
    Filed: February 9, 2016
    Publication date: March 8, 2018
    Inventors: Takuya KAWADA, Julien KLOETZER, Kentaro TORISAWA
  • Publication number: 20170242915
    Abstract: [Object] To provide a device assisting a user to easily generate, in relation to an issue of interest to the user, a question sentence guaranteed to have an answer of a certain accuracy or higher in a question-answering system. [Solution] A question sentence generating device is used with a question-answering system, and it includes: word receiving means for receiving a word 480 as a source for generating a question sentence; and question sentence generating database 502 comprised of a plurality of entries for generating a question sentence. Each of the plurality of entries has a word as a key and includes an answer sentence pattern co-occurring with the word, used in the question-answering system.
    Type: Application
    Filed: August 10, 2015
    Publication date: August 24, 2017
    Inventors: Kentaro TORISAWA, Jun GOTO, Julien KLOETZER, Takuya KAWADA
  • Publication number: 20160260026
    Abstract: [Object] An object is to provide a device capable of efficiently collecting contradictory expressions in units smaller than a sentence.
    Type: Application
    Filed: October 6, 2014
    Publication date: September 8, 2016
    Applicant: NATIONAL INSTITUTE OF INFORMATION AND COMMUNICATIONS TECHNOLOGY
    Inventors: Julien KLOETZER, Kentaro TORISAWA, Chikara HASHIMOTO, Motoki SANO, Jonghoon OH, Kiyonori OOTAKE