Abstract: A learning device includes a memory; and a processor configured to execute answer generation means for taking data including text, and a question text related to the data as inputs; creating, by using a model parameter of a neural network, a token sequence that takes visual information in the data into consideration, and generating an answer text to the question text, based on the created token sequence; and learning means for learning the model parameter by using the answer text and a correct answer text to the question text.

Abstract: A computer performs an encoding step of receiving, as inputs, a source text and an instruction related to a summary of the source text, generating first features, which are a sequence of vectors for respective tokens constituting one of the instruction and the source text, and generating text features, which are a sequence of vectors for respective tokens of the instruction and the source text, based on another of the instruction and the source text and the first features, a decoding step of receiving the text features as an input and outputting probability distribution of a text, and a parameter update step of updating parameters of the encoding step and the decoding step based on a loss between the probability distribution and a text as a correct answer regarding the summary.

Abstract: A text generation training apparatus includes: a learning unit configured to train a model, receiving, as input, information included in each of a plurality of document images, constraint information related to generation of a sentence based on the information, and a page number of each of the plurality of document images, based on an estimation result of an output sequence output from the model and a correct output sequence for the input, and thus can generate a sentence based on the plurality of document images.

Abstract: A summary generation device includes: an image processing unit that receives an input of an image related to a moving image, and extracts at least a text from the image; a sound processing unit that receives an input of sound in the moving image, and extracts at least a text from the sound; and a summary generation unit that generates a summary text of the moving image from information extracted from the image and information extracted from the sound, using a trained summary model.

Abstract: A learning apparatus includes a memory and at least one processor connected to the memory, wherein the processor configured to: convert input text data into a feature amount sequence based on a language model; and update parameters of the language model based on the text data, the feature amount sequence, and a word vector learned in advance.

Abstract: A generation unit that takes a question Qi that is a word sequence representing a current question in a dialogue, a document P used to generate an answer Ai to the question Qi, a question history {Qi-1, . . . , Qi-k} that is a set of word sequences representing k past questions, and an answer history {Ai-1, . . . , Ai-k} that is a set of word sequences representing answers to the k questions as inputs, and generates the answer Ai by machine reading comprehension in an extractive mode or a generative mode using pre-trained model parameters is provided.

Abstract: A learning apparatus executes receiving a text and a question associated with the text, and calculating an evidence score expressing a likelihood of a character string included in the text as evidence for an answer to the question by using a model parameter of a first neural network; extracting, by sampling from a predetermined distribution having the evidence score as a parameter, a first set indicating a set of the character strings as the evidence for the answer from the text; receiving the question and the first set and extracting the answer from the first set by using a model parameter of a second neural network; and learning the model parameters of the first and second neural networks by calculating a gradient through error back propagation by using a continuous relaxation and a first loss between the answer and a true answer to the question.

Abstract: A text generation apparatus includes a memory and a processor configured to, based on learned parameters of neural networks, acquire, as a reference text, a predetermined number of two or more sentences having a relatively high relevance to an input sentence from a set of sentences different from the input sentence and generate text based on the input sentence and the reference text, such that information to be considered when generating text can be added as text.

Abstract: A text generation apparatus includes a content selection unit that acquires a reference text based on an input text and information different from the input text and a generation unit that generates a text based on the input text and the reference text, wherein the content selection unit and the generation unit are neural networks based on learned parameters, so that information to be considered when generating a text can be added as text.

Abstract: A dialogue processing apparatus includes one or more computers each including a memory and a processor configured to receive a question Qi as a word string representing a current question in an interactive machine reading comprehension task, a question history {Q1, . . . , Qi?1} as a set of word strings representing previous questions, and an answer history {A1, . . . , Ai?1} as a set of word strings representing previous answers to the previous questions, and use a pre-learned first model parameter, to generate an encoded context vector reflecting an attribute or an importance degree of each of the previous questions and the previous answers; and receive a document P to be used to generate an answer Ai to the question Qi and the encoded context vector, and use a pre-learned second model parameter, to perform matching between the document and the previous questions and previous answers, to generate the answer.

Abstract: A nonverbal information generation apparatus includes a nonverbal information generation unit that generates time-information-stamped nonverbal information that corresponds to time-information-stamped text feature quantities on the basis of the time-information-stamped text feature quantities and a learned nonverbal information generation model. The time-information-stamped text feature quantities are configured to include feature quantities that have been extracted from text and time information representing times assigned to predetermined units of the text. The nonverbal information is information for controlling an expression unit that expresses behavior that corresponds to the text.

Abstract: An encoding unit transforms a piece of text divided into a plurality of spans that are subdivided units of the piece of text and a question which have been input into a vector representation sequence representing a meaning of a span and the question based on the piece of text and the question which have been input using a pre-trained encoding model for transforming input text into a vector representation sequence representing a meaning of the input text. For each of the spans, an evidence extraction unit estimates an evidence score indicating the degree to which the span is suitable as the evidence for extracting the answer using a pre-trained extraction model for calculating the evidence score based on the vector representation sequence.

Abstract: A sentence generation device has: an estimation unit for receiving input of a first sentence and an output length, and estimating importance of each word constituting the first sentence using a pre-trained model; and a generation unit for generating a second sentence based on the importance, and thus makes it possible to evaluate importance of a constituent element of an input sentence, in correspondence with a designated output length.

Abstract: A sentence generation device has: an estimation unit for receiving input of a first sentence and a focus point related to generation of a second sentence to be generated based on the first sentence, and estimating importance of each word constituting the first sentence using a pre-trained model; and a generation unit for generating the second sentence based on the importance, and thus makes it possible to evaluate importance of a constituent element of an input sentence in correspondence with a designated focus point.

Abstract: A language processing device includes a hardware processor configured to extract a feature amount from text data based on model parameters of a neural network; output an answer start point score, an answer end point score, and an answer possibility score using the feature amount as an input, based on model parameters of the neural network; extract predetermined n answer suitability scores based on the answer start point score and the answer end point score; obtain n adjusted answer suitability scores from the n answer suitability scores and obtain an adjusted answer possibility score from the answer possibility score, based on model parameters of the neural network; and lean the model parameters based on the n adjusted answer suitability scores, the adjusted answer possibility score, a correct answer section, and a correct answer possibility.

Abstract: A language processing device includes circuitry configured to generate an error sentence corresponding to an original sentence based on pronunciation corresponding to text data indicating the original sentence; use a language model based on a neural network model to generate a prediction sentence from the error sentence based on a language model parameter of the language model; and update the language model parameter based on a difference between the original sentence and the prediction sentence.

Abstract: Therefore, an image processing apparatus according to the present disclosure is an image processing apparatus for extracting a feature amount of image data, the image processing apparatus including: an image understanding unit 41 that vectorizes an image pattern of the image data to extract an image feature amount; a text understanding unit 43 that vectorizes a text pattern of attached text data attached to the image data to extract a text feature amount; and a feature amount mixing unit 44 that generates a mixed feature amount as the feature amount by projecting the image feature amount extracted by the image understanding unit 41 and the text feature amount extracted by the text understanding unit 43 onto the same vector space and mixing the image feature amount and the text feature amount.

Abstract: A nonverbal information generation apparatus includes a display unit that partitions text into predetermined units, displays the text partitioned into the predetermined units, and makes nonverbal information that represents information about behavior of a verbal output agent or nonverbal information that represents information about behavior of a receiver of verbal information of the verbal output agent that corresponds to the text when the verbal output agent outputs the verbal information visible in association with the predetermined units of the text.

Abstract: There is provided a learning device for learning a neural network used for search of external knowledge in order to increase search accuracy of external knowledge required for arithmetic processing. With an input sentence Q as an input, an external knowledge search unit 22 selects pieces of external knowledge based on similarity degrees between pieces of external knowledge included in an external knowledge database 2 and the input sentence Q, using a neural network, and causes the selected pieces of external knowledge to be search results R2. A processing unit 14 acquires a response sentence A to the input sentence Q by arithmetic processing with the input sentence Q and the selected pieces of external knowledge as an input. A consideration calculation unit 23 calculates a consideration v determined from an index indicating correctness of the response sentence A based on a true output T given to the input sentence Q in advance and an index indicating quality of the selected pieces of external knowledge.

Abstract: A generation unit that takes a question Qi that is a word sequence representing a current question in a dialogue, a document P used to generate an answer Ai to the question Qi, a question history {Qi-1, . . . , Qi-k} that is a set of word sequences representing k past questions, and an answer history {Ai-1, . . . , Ai-k} that is a set of word sequences representing answers to the k questions as inputs, and generates the answer Ai by machine reading comprehension in an extractive mode or a generative mode using pre-trained model parameters is provided.