Patents by Inventor Julien Perez

Julien Perez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11934782
    Abstract: A question answering system includes: a neural network tokenizer module configured to determine a token representation of a question to be answered and token representations of candidate paragraphs of a present reasoning path for the question, respectively; a neural network module configured to: transform the token representation of the question and the token representations of the candidate paragraphs of the present reasoning path into vector representations; and append a first variable to the vector representations to produce a second variable; a search module configured to: select the candidate paragraphs from a knowledge database to extend a present reasoning path based on lexical relevance of the candidate paragraphs to the question; and selectively add ones of the candidate paragraphs to the present reasoning path; and an answer inference network module configured to selectively determine an answer to the question based on multiple different portions of the present reasoning path.
    Type: Grant
    Filed: October 21, 2021
    Date of Patent: March 19, 2024
    Assignee: NAVER CORPORATION
    Inventors: Julien Perez, Arnaud Sors
  • Patent number: 11912645
    Abstract: The invention is based on the discovery of a new bacterial compound with analgesic properties which could be used as a new tool for the treatment of pain disorders such as visceral pain. Studying the mechanisms implicated in analgesic properties of the probiotic Escherichia coli strain Nissle 1917 (EcN), inventors characterized, the amino fatty acids produced by EcN, which display the Ecn analgesic properties. One of these compounds inhibits the hypersensitivity to colorectal distension induced by capsaicin, which is a very powerful nociceptive compound and acts via the GABA B receptor. Furthermore, inventors demonstrate that this compound is able to cross the cellular epithelial barrier (such as the intestinal epithelium). Thus, the invention relates to a lipopetide compound, derived from gamma-aminobutyric acid. The invention also relates to a lipopeptide compound according to the invention for the treatment of treating pain disorder, such as somatic pain and visceral pain.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: February 27, 2024
    Assignees: INSERM (INSTITUT NATIONAL DE LA SANTÉ ET DE LA RECHERCHE MÉDICALE), CENTRE HOSPITALIER UNIVERSITAIRE DE TOULOUSE, CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE—CNRS—, ECOLE NATIONALE VETERINAIRE DE TOULOUSE, UNIVERSITE PAUL SABATIER TOULOUSE III, INSTITUT NATIONAL DE RECHERCHE POUR L'AGRICULTURE, L'ALIMENTATION ET L'ENVIRONNEMENT, UNIVERSITE DE MONTPELLIER, ECOLE NATIONALE SUPERIEURE DE CHIMIE DE MONTPELLIER
    Inventors: Nicolas Cenac, Justine Bertrand-Michel, Teresa Perez-Berezo, Thierry Durand, Jean-Marie Galano, Julien Pujo, Eric Oswald, Patricia Martin, Pauline Le Faouder, Alexandre Guy
  • Patent number: 11893060
    Abstract: A question answering system includes: a first encoder module configured to receive a question, the question including a first plurality of words, and encode the question into a first vector representation; a second encoder module configured to encode a document into a second vector representation, the document including a second plurality of words; a first reading module configured to generate a third vector representation based on the first and second vector representations; a first reformulation module configured to generate a first reformulated vector representation based on the first vector representation; a second reading module configured to generate a fifth vector representation based on the second vector representation and the first reformulated vector representation; a second reformulation module configured to generate a second reformulated vector representation based on first reformulated vector representation; and an answer module configured to determine an answer to the question based on the secon
    Type: Grant
    Filed: September 9, 2020
    Date of Patent: February 6, 2024
    Assignee: NAVER CORPORATION
    Inventors: Quentin Grail, Julien Perez, Eric Jacques Guy Gaussier
  • Publication number: 20230334267
    Abstract: A confidence estimation system includes: a neural network including at least one an attention module including N heads configured to: generate attention matrices based on interactions between tokens for words in an input sequence of words, the input sequence of words including a word that is obscured; and determine the word that is obscured in the input sequence; and a confidence module configured to determine a confidence value indicative of a probability of the neural network correctly determining the word that is obscured, the confidence module determining the confidence value of the word that is obscured using a convolutional neural network that projects the attention matrices generated by the attention module over a multi-dimensional space, the attention matrices recording interactions between the tokens in the input sequence of words without information regarding the tokens for the words and the word that is obscured.
    Type: Application
    Filed: April 14, 2022
    Publication date: October 19, 2023
    Applicant: NAVER CORPORATION
    Inventors: Julien PEREZ, Denys Proux, Michael Niemaz
  • Publication number: 20230244706
    Abstract: A summarization system includes: K embedding modules configured to: receive K blocks of text, respectively, of a document to be summarized; and generate K first representations based on the K blocks of text, respectively, where K is an integer greater than 2; a first propagation module configured to generate second representations based on the K first representations; a second propagation module configured to generate third representations based on the second representations; an output module configured to select ones of the K blocks based on the third representations; and a summary module configured to generate a summary of the document from text of the selected ones of the K blocks.
    Type: Application
    Filed: February 3, 2022
    Publication date: August 3, 2023
    Applicant: NAVER CORPORATION
    Inventors: Julien Perez, Quentin Grail, Eric Jacques Guy Gaussier
  • Patent number: 11610069
    Abstract: There is disclosed a computer implemented method that includes accessing a dataset having (1) a first set of questions including at least one pair of relational questions that correspond respectively with a pair of binary answers and (2) a second set of questions including at least another pair of relational questions that correspond respectively with a binary answer and a scalar answer. A question answering network is used to compute both a relational loss for the at least one pair of relational questions, and a relational loss for the at least another pair of relational questions. Both the relational loss for the at least one pair of relational questions and the relational loss for the at least another pair of relational questions are optimized, and a neural network model is trained with the optimized relational losses.
    Type: Grant
    Filed: June 2, 2020
    Date of Patent: March 21, 2023
    Inventors: Quentin Grail, Julien Perez
  • Publication number: 20220402122
    Abstract: A robot system includes a selection module configured to select a stored demonstration for a robot from a database of stored demonstrations for different tasks of the robot; an encoder module of an attention model, the encoder module configured to determine a similarity value reflecting a similarity between: a user input demonstration for the robot; and the stored demonstration for the robot; and an indicator module configured to indicate whether the stored demonstration is the same as the user input demonstration and belongs to the same task based on the similarity value.
    Type: Application
    Filed: June 18, 2021
    Publication date: December 22, 2022
    Applicants: NAVER LABS CORPORATION, NAVER CORPORATION
    Inventors: Julien PEREZ, Theo CACHET
  • Publication number: 20220395975
    Abstract: A computer-implemented method for performing few-shot imitation is disclosed. The method comprises obtaining at least one set of training data, wherein each set of training data is associated with a task and comprises (i) one of samples of rewards and a reward function, (ii) one of samples of state transitions and a transition distribution, and (iii) a set of first demonstrations, training a policy network embodied in an agent using reinforcement learning by inputting at least one set of first demonstrations of the at least one set of training data into the policy network, and by maximizing a risk measure or an average return over the at least one set of first demonstrations of the at least one set of training data based on respective one or more reward functions or respective samples of rewards, obtaining a set of second demonstrations associated with a new task, and inputting the set of second demonstrations and an observation of a state into the trained policy network for performing the new task.
    Type: Application
    Filed: April 8, 2022
    Publication date: December 15, 2022
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Theo CACHET, Christopher DANCE, Julien PEREZ
  • Patent number: 11526678
    Abstract: A training system includes: a first training dataset including first entries, wherein each of the first entries includes: a first sentence; a second sentence; and an indicator of a relationship between the first and second sentences; a training module configured to: generate a second dataset including second entries based on the first entries, respectively, wherein each of the second entries includes: the first sentence of one of the first entries; the second sentence of the one of the first entries; a first surface realization corresponding to first facts regarding the first sentence; the indicator of the one of the first entries; and train a model using the second dataset and store the model in memory.
    Type: Grant
    Filed: May 14, 2020
    Date of Patent: December 13, 2022
    Assignee: NAVER CORPORATION
    Inventor: Julien Perez
  • Patent number: 11526676
    Abstract: A method includes: initializing a list of token embeddings, each of the token embeddings corresponding to a tokenized word from text in a corpus of text; generating a graph for a group of consecutive words s from the text, said graph including binary relations between pairs of tokenized words of the group of consecutive words; selecting the token embeddings representing the words of the group of consecutive words from the list of token embeddings; computing a tensor of binary relations as the product between a matrix of the selected token embeddings and a tensor representing discourse relations, the computed tensor representing the binary relations between the pairs of tokenized words; computing a loss using the computed tensor; optimizing the list of token embeddings using the computed loss. The above may be repeated until the computed loss is within a predetermined range.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: December 13, 2022
    Assignee: NAVER CORPORATION
    Inventors: Julien Perez, Eric Jacques Guy Gaussier, Diana Nicoleta Popa, James Henderson
  • Patent number: 11461613
    Abstract: A computer implemented method for multi-document question answering is performed on a server communicating with a client device over a network. The method includes receiving a runtime question from a client device and retrieving runtime documents concerning the runtime question using a search engine. Runtime answer samples are identified in the retrieved runtime documents. A neural network model, trained using distant supervision and distance based ranking loss, is used to compute runtime scores from runtime question data representing the runtime question and from a runtime answer sample representing a first portion of text from the corpus of documents, where each runtime score represents a probability an answer to the runtime question is present in the runtime answer samples. A runtime answer is selected from the runtime answer samples corresponding to the highest runtime score sent to the client device.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: October 4, 2022
    Assignee: NAVER CORPORATION
    Inventors: Julien Perez, Arnaud Sors
  • Publication number: 20220305649
    Abstract: A system includes: a first module configured to, based on a set of target robot joint angles, generate a first estimated end effector pose and a first estimated latent variable that is a first intermediate variable between the set of target robot joint angles and the first estimated end effector pose; a second module configured to determine a set of estimated robot joint angles based on the first estimated latent variable and a target end effector pose; a third module configured to determine joint probabilities for the robot based on the first estimated latent variable and the target end effector pose; and a fourth module configured to, based on the set of estimated robot joint angles, determine a second estimated end effector pose and a second estimated latent variable that is a second intermediate variable between the set of estimated robot joint angles and the second estimated end effector pose.
    Type: Application
    Filed: September 28, 2021
    Publication date: September 29, 2022
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Julien PEREZ, Seungsu KIM
  • Patent number: 11454978
    Abstract: A training system for training a trained model for use by a navigating robot to perform visual navigation includes memory including N base virtual training environments, each of the N base virtual training environments including a field of view at a location within an indoor space, where N is an integer greater than 1. A randomization module is configured to generate N varied virtual training environments based on the N base virtual training environments, respectively, by varying at least one characteristic of the respective N base virtual training environments. A training module is configured to train the trained model for use by the navigating robot to perform visual navigation based on a training set including: the N base virtual training environments; and the N varied virtual training environments.
    Type: Grant
    Filed: November 7, 2019
    Date of Patent: September 27, 2022
    Assignees: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Tomi Silander, Michel Aractingi, Christopher Dance, Julien Perez
  • Publication number: 20220222436
    Abstract: A question answering system includes: a neural network tokenizer module configured to determine a token representation of a question to be answered and token representations of candidate paragraphs of a present reasoning path for the question, respectively; a neural network module configured to: transform the token representation of the question and the token representations of the candidate paragraphs of the present reasoning path into vector representations; and append a first variable to the vector representations to produce a second variable; a search module configured to: select the candidate paragraphs from a knowledge database to extend a present reasoning path based on lexical relevance of the candidate paragraphs to the question; and selectively add ones of the candidate paragraphs to the present reasoning path; and an answer inference network module configured to selectively determine an answer to the question based on multiple different portions of the present reasoning path.
    Type: Application
    Filed: October 21, 2021
    Publication date: July 14, 2022
    Applicant: NAVER CORPORATION
    Inventors: Julien PEREZ, Arnaud SORS
  • Publication number: 20220161423
    Abstract: A training system for a robot includes: a model having a transformer architecture and configured to determine how to actuate at least one of arms and an end effector of the robot; a training dataset including sets of demonstrations for the robot to perform training tasks, respectively; and a training module configured to: meta-train a policy of the model using first ones of the sets of demonstrations for first ones of the training tasks, respectively; and optimize the policy of the model using second ones of the sets of demonstrations for second ones of the training tasks, respectively, where the sets of demonstrations for the training tasks each include more than one demonstration and less than a first predetermined number of demonstrations.
    Type: Application
    Filed: March 3, 2021
    Publication date: May 26, 2022
    Applicants: NAVER CORPORATION, NAVER LABS CORPORATION
    Inventors: Julien PEREZ, Seungsu KIM, Theo CACHET
  • Patent number: 11263753
    Abstract: A method and system pre-trains a convolutional neural network for image recognition based upon masked language modeling by inputting, to the convolutional neural network, an image; outputting, from the convolutional neural network, a visual embedding tensor of visual embedding vectors; tokenizing a caption to create a list of tokens, at least one token having visual correspondence to the image received by the convolutional neural network; randomly selecting one of the tokens in the list of tokens to be masked, the selected token being taken as ground truth; computing, using a language model neural network, hidden representations of the tokens; using the hidden representation of the masked token, as a query vector, to pool the visual embedding vectors in the visual embedding tensor, attentively; predicting the masked token by mapping the pooled visual embedding vectors to the tokens; determining a prediction loss associated with the masked token; and back-propagating the prediction loss to the convolutional ne
    Type: Grant
    Filed: April 7, 2020
    Date of Patent: March 1, 2022
    Inventors: Diane Larlus-Larrondo, Julien Perez, Mert Bulent Sariyildiz
  • Patent number: 11250841
    Abstract: A method and method for natural language generation employ a natural language generation model which has been trained to assign an utterance label to a new text sequence, based on features extracted from the text sequence, such as parts-of-speech. The model assigns an utterance label to the new text sequence, based on the extracted features. The utterance label is used to guide the generation of a natural language utterance, such as a question, from the new text sequence. The system and method find application in dialog systems for generating utterances, to be sent to a user, from brief descriptions of problems or solutions in a knowledge base.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: February 15, 2022
    Assignee: CONDUENT BUSINESS SERVICES, LLC
    Inventors: Claude Roux, Julien Perez
  • Patent number: 11222262
    Abstract: A system and method for predicting a sequence of actions employ a Gated End-to-End Memory Policy Network (GMemN2NP), which includes a sequence of hop(s). Supporting memories of the hops include memory cells generated from observations made at different times. A sequence of actions is predicted, based on input agent-specific variables. For each action, the model, at each hop, outputs an updated controller state which is used as input to the next hop or, for the terminal hop, for computing the respective action. Each hop includes a transform gate mechanism which is used to control the influence of output of the supporting memories on the updated controller state. For the second and subsequent hops, respective actions are predicted, after using any intervening observations to update the supporting memories. The model is learned, on a training set of observations, to optimize the cumulative reward of a sequence of two or more actions.
    Type: Grant
    Filed: May 30, 2017
    Date of Patent: January 11, 2022
    Assignee: Xerox Corporation
    Inventors: Julien Perez, Tomi Silander
  • Publication number: 20210357595
    Abstract: A training system includes: a first training dataset including first entries, wherein each of the first entries includes: a first sentence; a second sentence; and an indicator of a relationship between the first and second sentences; a training module configured to: generate a second dataset including second entries based on the first entries, respectively, wherein each of the second entries includes: the first sentence of one of the first entries; the second sentence of the one of the first entries; a first surface realization corresponding to first facts regarding the first sentence; the indicator of the one of the first entries; and train a model using the second dataset and store the model in memory.
    Type: Application
    Filed: May 14, 2020
    Publication date: November 18, 2021
    Applicant: NAVER CORPORATION
    Inventor: Julien PEREZ
  • Publication number: 20210319314
    Abstract: A natural language sentence includes a sequence of tokens. A system for entering information provided in the natural language sentence to a computing device includes a processor and memory coupled to the processor, the memory including instructions executable by the processor implementing: a contextualization layer configured to generate a contextualized representation of the sequence of tokens; a dimension-preserving convolutional neural network configured to generate an output matrix from the contextualized representation; and a graph convolutional neural network configured to: use the matrix to form a set of adjacency matrices; and generate a label for each token in the sequence of tokens based on hidden states for that token in a last layer of the graph convolutional neural network.
    Type: Application
    Filed: February 12, 2021
    Publication date: October 14, 2021
    Applicant: NAVER CORPORATION
    Inventors: Julien PEREZ, Morgan FUNTOWICZ