Patents by Inventor Julien Perez
Julien Perez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11934782Abstract: A question answering system includes: a neural network tokenizer module configured to determine a token representation of a question to be answered and token representations of candidate paragraphs of a present reasoning path for the question, respectively; a neural network module configured to: transform the token representation of the question and the token representations of the candidate paragraphs of the present reasoning path into vector representations; and append a first variable to the vector representations to produce a second variable; a search module configured to: select the candidate paragraphs from a knowledge database to extend a present reasoning path based on lexical relevance of the candidate paragraphs to the question; and selectively add ones of the candidate paragraphs to the present reasoning path; and an answer inference network module configured to selectively determine an answer to the question based on multiple different portions of the present reasoning path.Type: GrantFiled: October 21, 2021Date of Patent: March 19, 2024Assignee: NAVER CORPORATIONInventors: Julien Perez, Arnaud Sors
-
Patent number: 11912645Abstract: The invention is based on the discovery of a new bacterial compound with analgesic properties which could be used as a new tool for the treatment of pain disorders such as visceral pain. Studying the mechanisms implicated in analgesic properties of the probiotic Escherichia coli strain Nissle 1917 (EcN), inventors characterized, the amino fatty acids produced by EcN, which display the Ecn analgesic properties. One of these compounds inhibits the hypersensitivity to colorectal distension induced by capsaicin, which is a very powerful nociceptive compound and acts via the GABA B receptor. Furthermore, inventors demonstrate that this compound is able to cross the cellular epithelial barrier (such as the intestinal epithelium). Thus, the invention relates to a lipopetide compound, derived from gamma-aminobutyric acid. The invention also relates to a lipopeptide compound according to the invention for the treatment of treating pain disorder, such as somatic pain and visceral pain.Type: GrantFiled: April 27, 2018Date of Patent: February 27, 2024Assignees: INSERM (INSTITUT NATIONAL DE LA SANTÉ ET DE LA RECHERCHE MÉDICALE), CENTRE HOSPITALIER UNIVERSITAIRE DE TOULOUSE, CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE—CNRS—, ECOLE NATIONALE VETERINAIRE DE TOULOUSE, UNIVERSITE PAUL SABATIER TOULOUSE III, INSTITUT NATIONAL DE RECHERCHE POUR L'AGRICULTURE, L'ALIMENTATION ET L'ENVIRONNEMENT, UNIVERSITE DE MONTPELLIER, ECOLE NATIONALE SUPERIEURE DE CHIMIE DE MONTPELLIERInventors: Nicolas Cenac, Justine Bertrand-Michel, Teresa Perez-Berezo, Thierry Durand, Jean-Marie Galano, Julien Pujo, Eric Oswald, Patricia Martin, Pauline Le Faouder, Alexandre Guy
-
Patent number: 11893060Abstract: A question answering system includes: a first encoder module configured to receive a question, the question including a first plurality of words, and encode the question into a first vector representation; a second encoder module configured to encode a document into a second vector representation, the document including a second plurality of words; a first reading module configured to generate a third vector representation based on the first and second vector representations; a first reformulation module configured to generate a first reformulated vector representation based on the first vector representation; a second reading module configured to generate a fifth vector representation based on the second vector representation and the first reformulated vector representation; a second reformulation module configured to generate a second reformulated vector representation based on first reformulated vector representation; and an answer module configured to determine an answer to the question based on the seconType: GrantFiled: September 9, 2020Date of Patent: February 6, 2024Assignee: NAVER CORPORATIONInventors: Quentin Grail, Julien Perez, Eric Jacques Guy Gaussier
-
Publication number: 20230334267Abstract: A confidence estimation system includes: a neural network including at least one an attention module including N heads configured to: generate attention matrices based on interactions between tokens for words in an input sequence of words, the input sequence of words including a word that is obscured; and determine the word that is obscured in the input sequence; and a confidence module configured to determine a confidence value indicative of a probability of the neural network correctly determining the word that is obscured, the confidence module determining the confidence value of the word that is obscured using a convolutional neural network that projects the attention matrices generated by the attention module over a multi-dimensional space, the attention matrices recording interactions between the tokens in the input sequence of words without information regarding the tokens for the words and the word that is obscured.Type: ApplicationFiled: April 14, 2022Publication date: October 19, 2023Applicant: NAVER CORPORATIONInventors: Julien PEREZ, Denys Proux, Michael Niemaz
-
Publication number: 20230244706Abstract: A summarization system includes: K embedding modules configured to: receive K blocks of text, respectively, of a document to be summarized; and generate K first representations based on the K blocks of text, respectively, where K is an integer greater than 2; a first propagation module configured to generate second representations based on the K first representations; a second propagation module configured to generate third representations based on the second representations; an output module configured to select ones of the K blocks based on the third representations; and a summary module configured to generate a summary of the document from text of the selected ones of the K blocks.Type: ApplicationFiled: February 3, 2022Publication date: August 3, 2023Applicant: NAVER CORPORATIONInventors: Julien Perez, Quentin Grail, Eric Jacques Guy Gaussier
-
Patent number: 11610069Abstract: There is disclosed a computer implemented method that includes accessing a dataset having (1) a first set of questions including at least one pair of relational questions that correspond respectively with a pair of binary answers and (2) a second set of questions including at least another pair of relational questions that correspond respectively with a binary answer and a scalar answer. A question answering network is used to compute both a relational loss for the at least one pair of relational questions, and a relational loss for the at least another pair of relational questions. Both the relational loss for the at least one pair of relational questions and the relational loss for the at least another pair of relational questions are optimized, and a neural network model is trained with the optimized relational losses.Type: GrantFiled: June 2, 2020Date of Patent: March 21, 2023Inventors: Quentin Grail, Julien Perez
-
Publication number: 20220402122Abstract: A robot system includes a selection module configured to select a stored demonstration for a robot from a database of stored demonstrations for different tasks of the robot; an encoder module of an attention model, the encoder module configured to determine a similarity value reflecting a similarity between: a user input demonstration for the robot; and the stored demonstration for the robot; and an indicator module configured to indicate whether the stored demonstration is the same as the user input demonstration and belongs to the same task based on the similarity value.Type: ApplicationFiled: June 18, 2021Publication date: December 22, 2022Applicants: NAVER LABS CORPORATION, NAVER CORPORATIONInventors: Julien PEREZ, Theo CACHET
-
Publication number: 20220395975Abstract: A computer-implemented method for performing few-shot imitation is disclosed. The method comprises obtaining at least one set of training data, wherein each set of training data is associated with a task and comprises (i) one of samples of rewards and a reward function, (ii) one of samples of state transitions and a transition distribution, and (iii) a set of first demonstrations, training a policy network embodied in an agent using reinforcement learning by inputting at least one set of first demonstrations of the at least one set of training data into the policy network, and by maximizing a risk measure or an average return over the at least one set of first demonstrations of the at least one set of training data based on respective one or more reward functions or respective samples of rewards, obtaining a set of second demonstrations associated with a new task, and inputting the set of second demonstrations and an observation of a state into the trained policy network for performing the new task.Type: ApplicationFiled: April 8, 2022Publication date: December 15, 2022Applicants: NAVER CORPORATION, NAVER LABS CORPORATIONInventors: Theo CACHET, Christopher DANCE, Julien PEREZ
-
Patent number: 11526678Abstract: A training system includes: a first training dataset including first entries, wherein each of the first entries includes: a first sentence; a second sentence; and an indicator of a relationship between the first and second sentences; a training module configured to: generate a second dataset including second entries based on the first entries, respectively, wherein each of the second entries includes: the first sentence of one of the first entries; the second sentence of the one of the first entries; a first surface realization corresponding to first facts regarding the first sentence; the indicator of the one of the first entries; and train a model using the second dataset and store the model in memory.Type: GrantFiled: May 14, 2020Date of Patent: December 13, 2022Assignee: NAVER CORPORATIONInventor: Julien Perez
-
Patent number: 11526676Abstract: A method includes: initializing a list of token embeddings, each of the token embeddings corresponding to a tokenized word from text in a corpus of text; generating a graph for a group of consecutive words s from the text, said graph including binary relations between pairs of tokenized words of the group of consecutive words; selecting the token embeddings representing the words of the group of consecutive words from the list of token embeddings; computing a tensor of binary relations as the product between a matrix of the selected token embeddings and a tensor representing discourse relations, the computed tensor representing the binary relations between the pairs of tokenized words; computing a loss using the computed tensor; optimizing the list of token embeddings using the computed loss. The above may be repeated until the computed loss is within a predetermined range.Type: GrantFiled: March 13, 2020Date of Patent: December 13, 2022Assignee: NAVER CORPORATIONInventors: Julien Perez, Eric Jacques Guy Gaussier, Diana Nicoleta Popa, James Henderson
-
Patent number: 11461613Abstract: A computer implemented method for multi-document question answering is performed on a server communicating with a client device over a network. The method includes receiving a runtime question from a client device and retrieving runtime documents concerning the runtime question using a search engine. Runtime answer samples are identified in the retrieved runtime documents. A neural network model, trained using distant supervision and distance based ranking loss, is used to compute runtime scores from runtime question data representing the runtime question and from a runtime answer sample representing a first portion of text from the corpus of documents, where each runtime score represents a probability an answer to the runtime question is present in the runtime answer samples. A runtime answer is selected from the runtime answer samples corresponding to the highest runtime score sent to the client device.Type: GrantFiled: December 5, 2019Date of Patent: October 4, 2022Assignee: NAVER CORPORATIONInventors: Julien Perez, Arnaud Sors
-
Publication number: 20220305649Abstract: A system includes: a first module configured to, based on a set of target robot joint angles, generate a first estimated end effector pose and a first estimated latent variable that is a first intermediate variable between the set of target robot joint angles and the first estimated end effector pose; a second module configured to determine a set of estimated robot joint angles based on the first estimated latent variable and a target end effector pose; a third module configured to determine joint probabilities for the robot based on the first estimated latent variable and the target end effector pose; and a fourth module configured to, based on the set of estimated robot joint angles, determine a second estimated end effector pose and a second estimated latent variable that is a second intermediate variable between the set of estimated robot joint angles and the second estimated end effector pose.Type: ApplicationFiled: September 28, 2021Publication date: September 29, 2022Applicants: NAVER CORPORATION, NAVER LABS CORPORATIONInventors: Julien PEREZ, Seungsu KIM
-
Patent number: 11454978Abstract: A training system for training a trained model for use by a navigating robot to perform visual navigation includes memory including N base virtual training environments, each of the N base virtual training environments including a field of view at a location within an indoor space, where N is an integer greater than 1. A randomization module is configured to generate N varied virtual training environments based on the N base virtual training environments, respectively, by varying at least one characteristic of the respective N base virtual training environments. A training module is configured to train the trained model for use by the navigating robot to perform visual navigation based on a training set including: the N base virtual training environments; and the N varied virtual training environments.Type: GrantFiled: November 7, 2019Date of Patent: September 27, 2022Assignees: NAVER CORPORATION, NAVER LABS CORPORATIONInventors: Tomi Silander, Michel Aractingi, Christopher Dance, Julien Perez
-
Publication number: 20220222436Abstract: A question answering system includes: a neural network tokenizer module configured to determine a token representation of a question to be answered and token representations of candidate paragraphs of a present reasoning path for the question, respectively; a neural network module configured to: transform the token representation of the question and the token representations of the candidate paragraphs of the present reasoning path into vector representations; and append a first variable to the vector representations to produce a second variable; a search module configured to: select the candidate paragraphs from a knowledge database to extend a present reasoning path based on lexical relevance of the candidate paragraphs to the question; and selectively add ones of the candidate paragraphs to the present reasoning path; and an answer inference network module configured to selectively determine an answer to the question based on multiple different portions of the present reasoning path.Type: ApplicationFiled: October 21, 2021Publication date: July 14, 2022Applicant: NAVER CORPORATIONInventors: Julien PEREZ, Arnaud SORS
-
Publication number: 20220161423Abstract: A training system for a robot includes: a model having a transformer architecture and configured to determine how to actuate at least one of arms and an end effector of the robot; a training dataset including sets of demonstrations for the robot to perform training tasks, respectively; and a training module configured to: meta-train a policy of the model using first ones of the sets of demonstrations for first ones of the training tasks, respectively; and optimize the policy of the model using second ones of the sets of demonstrations for second ones of the training tasks, respectively, where the sets of demonstrations for the training tasks each include more than one demonstration and less than a first predetermined number of demonstrations.Type: ApplicationFiled: March 3, 2021Publication date: May 26, 2022Applicants: NAVER CORPORATION, NAVER LABS CORPORATIONInventors: Julien PEREZ, Seungsu KIM, Theo CACHET
-
Patent number: 11263753Abstract: A method and system pre-trains a convolutional neural network for image recognition based upon masked language modeling by inputting, to the convolutional neural network, an image; outputting, from the convolutional neural network, a visual embedding tensor of visual embedding vectors; tokenizing a caption to create a list of tokens, at least one token having visual correspondence to the image received by the convolutional neural network; randomly selecting one of the tokens in the list of tokens to be masked, the selected token being taken as ground truth; computing, using a language model neural network, hidden representations of the tokens; using the hidden representation of the masked token, as a query vector, to pool the visual embedding vectors in the visual embedding tensor, attentively; predicting the masked token by mapping the pooled visual embedding vectors to the tokens; determining a prediction loss associated with the masked token; and back-propagating the prediction loss to the convolutional neType: GrantFiled: April 7, 2020Date of Patent: March 1, 2022Inventors: Diane Larlus-Larrondo, Julien Perez, Mert Bulent Sariyildiz
-
Patent number: 11250841Abstract: A method and method for natural language generation employ a natural language generation model which has been trained to assign an utterance label to a new text sequence, based on features extracted from the text sequence, such as parts-of-speech. The model assigns an utterance label to the new text sequence, based on the extracted features. The utterance label is used to guide the generation of a natural language utterance, such as a question, from the new text sequence. The system and method find application in dialog systems for generating utterances, to be sent to a user, from brief descriptions of problems or solutions in a knowledge base.Type: GrantFiled: June 10, 2016Date of Patent: February 15, 2022Assignee: CONDUENT BUSINESS SERVICES, LLCInventors: Claude Roux, Julien Perez
-
Patent number: 11222262Abstract: A system and method for predicting a sequence of actions employ a Gated End-to-End Memory Policy Network (GMemN2NP), which includes a sequence of hop(s). Supporting memories of the hops include memory cells generated from observations made at different times. A sequence of actions is predicted, based on input agent-specific variables. For each action, the model, at each hop, outputs an updated controller state which is used as input to the next hop or, for the terminal hop, for computing the respective action. Each hop includes a transform gate mechanism which is used to control the influence of output of the supporting memories on the updated controller state. For the second and subsequent hops, respective actions are predicted, after using any intervening observations to update the supporting memories. The model is learned, on a training set of observations, to optimize the cumulative reward of a sequence of two or more actions.Type: GrantFiled: May 30, 2017Date of Patent: January 11, 2022Assignee: Xerox CorporationInventors: Julien Perez, Tomi Silander
-
Publication number: 20210357595Abstract: A training system includes: a first training dataset including first entries, wherein each of the first entries includes: a first sentence; a second sentence; and an indicator of a relationship between the first and second sentences; a training module configured to: generate a second dataset including second entries based on the first entries, respectively, wherein each of the second entries includes: the first sentence of one of the first entries; the second sentence of the one of the first entries; a first surface realization corresponding to first facts regarding the first sentence; the indicator of the one of the first entries; and train a model using the second dataset and store the model in memory.Type: ApplicationFiled: May 14, 2020Publication date: November 18, 2021Applicant: NAVER CORPORATIONInventor: Julien PEREZ
-
Publication number: 20210319314Abstract: A natural language sentence includes a sequence of tokens. A system for entering information provided in the natural language sentence to a computing device includes a processor and memory coupled to the processor, the memory including instructions executable by the processor implementing: a contextualization layer configured to generate a contextualized representation of the sequence of tokens; a dimension-preserving convolutional neural network configured to generate an output matrix from the contextualized representation; and a graph convolutional neural network configured to: use the matrix to form a set of adjacency matrices; and generate a label for each token in the sequence of tokens based on hidden states for that token in a last layer of the graph convolutional neural network.Type: ApplicationFiled: February 12, 2021Publication date: October 14, 2021Applicant: NAVER CORPORATIONInventors: Julien PEREZ, Morgan FUNTOWICZ