Patents by Inventor Nikola Mrksic

Nikola Mrksic has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11861521
    Abstract: A computer-implemented method comprising: obtaining, by way of an input, input data relating to speech provided by a user; deriving one or more hypotheses for each of a plurality of user data fields from the input data; obtaining one or more reference values for each of the plurality of user data fields for each of one or more candidate users; calculating a score for at least one candidate user of the one or more candidate users, calculating the score comprising: calculating a plurality of user data field scores comprising, for each of the plurality of user data fields, a respective user data field score using the one or more hypotheses and the one or more reference values for the candidate user for the respective user data field; performing one or more fuzzy logic operations on the plurality of user data field scores; using the score for a candidate user of the one or more candidate users to perform a verification or identification process for the user.
    Type: Grant
    Filed: January 19, 2022
    Date of Patent: January 2, 2024
    Assignee: PolyAI Limited
    Inventors: Georgios Spithourakis, Pawel Franciszek Budzianowski, Michal Lis, Avishek Mondal, Ivan Vulic, Nikola Mrksic, Eshan Singhal, Benjamin Peter Levin, Pei-Hao Su, Tsung-Hsien Wen
  • Patent number: 11741109
    Abstract: A method of obtaining a response to a query inputted by a user, the method comprising: receiving a user inputted query; representing the user inputted query as a sequence of embedding vectors using a first model; encoding the sequence of embedding vectors to produce a context vector using a second model; retrieving responses with associated response vectors; scoring response vectors against the context vector, wherein the scoring is a measure of the similarity between the context vector and a response vector; and outputting the responses with the closest response vectors, wherein the first model is configured to segment a user inputted query into a sequence of units from a vocabulary of units and represent each unit in the sequence as an embedding vector, wherein at least one of the units in the vocabulary is an incomplete word, and wherein the first model comprises parameters that are stored using eight bits per parameter; and wherein the second model has been trained using corresponding queries and response
    Type: Grant
    Filed: December 10, 2019
    Date of Patent: August 29, 2023
    Assignee: PolyAI Limited
    Inventors: Ivan Vulic, Matthew Steedman Henderson, Pei-Hao Su, Tsung-Hsien Wen, Inigo Casanueva Perez, Nikola Mrksic, Samuel John Coope
  • Publication number: 20230196151
    Abstract: A computer-implemented method comprising: obtaining, by way of an input, input data relating to speech provided by a user; deriving one or more hypotheses for each of a plurality of user data fields from the input data; obtaining one or more reference values for each of the plurality of user data fields for each of one or more candidate users; calculating a score for at least one candidate user of the one or more candidate users, calculating the score comprising: calculating a plurality of user data field scores comprising, for each of the plurality of user data fields, a respective user data field score using the one or more hypotheses and the one or more reference values for the candidate user for the respective user data field; performing one or more fuzzy logic operations on the plurality of user data field scores; using the score for a candidate user of the one or more candidate users to perform a verification or identification process for the user.
    Type: Application
    Filed: January 19, 2022
    Publication date: June 22, 2023
    Inventors: Georgios SPITHOURAKIS, Pawel Franciszek BUDZIANOWSKI, Michal LIS, Avishek MONDAL, Ivan VULIC, Nikola MRKSIC, Eshan SINGHAL, Benjamin Peter LEVIN, Pei-Hao SU, Tsung-Hsien WEN
  • Patent number: 11430446
    Abstract: There is provided a dialogue system comprising: an input for obtaining an input signal relating to speech or text input provided by a user; an output for outputting speech or text information specified by a determined dialogue act; and a processor configured to: determine dialogue information from the input signal; determine the dialogue act based on the determined dialogue information, wherein determining the dialogue act comprises: selecting a next state from a plurality of states, wherein each of the plurality of states comprises information specifying a dialogue act and transition information specifying a transition to another state, the transitions defining one or more dialogue pathways, wherein selecting the next state comprises selecting a state which is specified by the transition information in a current state or selecting a state which is specified by a rule in a first set of one or more rules.
    Type: Grant
    Filed: August 12, 2021
    Date of Patent: August 30, 2022
    Assignee: PolyAI Limited
    Inventors: Tsung-Hsien Wen, Razvan-Emanuel Kusztos, Inigo Casanueva-Perez, Pei-Hao Su, Ivan Vulic, Nikola Mrksic, Daniela Susanne Gerz, Aditya Agarwal, Pawel Franciszek Budzianowski
  • Patent number: 11210306
    Abstract: A method of obtaining a response to a query inputted by a user, the method comprising: receiving a user inputted query; representing the user inputted query as a sequence of embedding vectors using a first model; encoding the sequence of embedding vectors to produce a context vector using a second model; retrieving responses with associated response vectors; scoring response vectors against the context vector, wherein the scoring is a measure of the similarity between the context vector and a response vector; and outputting the responses with the closest response vectors, wherein the first model is configured to segment a user inputted query into a sequence of units from a vocabulary of units and represent each unit in the sequence as an embedding vector, wherein at least one of the units in the vocabulary is an incomplete word, and wherein the first model comprises parameters that are stored using eight bits per parameter; and wherein the second model has been trained using corresponding queries and response
    Type: Grant
    Filed: December 30, 2020
    Date of Patent: December 28, 2021
    Assignee: PolyAI Limited
    Inventors: Matthew Steedman Henderson, Pei-Hao Su, Tsung-Hsien Wen, Inigo Casanueva Perez, Nikola Mrksic, Samuel John Coope, Ivan Vulic
  • Patent number: 11132988
    Abstract: A computer implemented method comprising: receiving input data relating to a speech or text signal originating from a user; representing the input data as a first sequence of first representations, each representing a unit of the input data; representing the input data as a second sequence of second representations, each representing one of the units of the input data; using a model to determine a tag sequence from the first sequence of first representations, wherein the model comprises an attention layer using the second sequence of second representations, wherein the tag sequence comprises one or more tags from a set of tags comprising a first tag; if one or more units of the input data correspond to the first tag, determining a system dialogue act based on the part of the input data corresponding to the first tag; and outputting speech or text information specified by the determined dialogue act.
    Type: Grant
    Filed: October 22, 2020
    Date of Patent: September 28, 2021
    Assignee: PolyAI Limited
    Inventors: Matthew Steedman Henderson, Pei-Hao Su, Tsung-Hsien Wen, Inigo Casanueva Perez, Nikola Mrksic, Ivan Vulic
  • Patent number: 10885906
    Abstract: A dialogue system comprising: an input for receiving input data relating to a speech or text signal originating from a user; an output for outputting speech or text information specified by a dialogue act; and a processor configured to: generate features from the input signal; for each of a plurality of classifier models, each classifier model corresponding to a dialogue slot, and for one or more values corresponding to the dialogue slot, input features generated from the input signal, the classifier model outputting a probability corresponding to each of three or more relations, wherein the relations specify the relation of the value to the dialogue slot; update a belief state based on the outputs of the classifier models; determine a system dialogue act by inputting information relating to the belief state into a policy model; output speech or text information specified by the determined dialogue act at the output.
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: January 5, 2021
    Assignee: PolyAI Limited
    Inventors: Matthew Steedman Henderson, Tsung-Hsien Wen, Pei-Hao Su, Nikola Mrksic, Ivan Vulic
  • Patent number: 10847141
    Abstract: A dialogue system comprising: an input for receiving input data relating to a speech or text signal originating from a user; an output for outputting speech or text information specified by a dialogue act; and a processor configured to: update a belief state, the belief state comprising information corresponding to one or more dialogue options, each dialogue option comprising a slot and a corresponding slot value, based on the input signal; determine a dialogue act, wherein a dialogue act is determined by applying one or more rules to world state information, the world state comprising information relating to the dialogue, wherein rules are applied in two or more ordered stages for each dialogue turn, wherein one of the stages is a first update stage, comprising applying one or more further rules controlling updating of the world state information based on the belief state information, and another of the stages is an act selection stage, comprising determining the dialogue act by applying the one or more rule
    Type: Grant
    Filed: November 8, 2019
    Date of Patent: November 24, 2020
    Assignee: PolyAI Limited
    Inventors: Matthew Steedman Henderson, Tsung-Hsien Wen, Pei-Hao Su, Nikola Mrksic, Ivan Vulic, Inigo Casanueva-Perez
  • Patent number: 10664527
    Abstract: A method of obtaining a response to a query inputted by a user, the method comprising: receiving a user inputted query; encoding said query to produce a context vector; retrieving responses with associated response vectors; scoring response vectors in the database against the context vector wherein the scoring is a measure of the similarity between the context vector and a response vector; and outputting the responses with the closest response vectors, wherein encoding said query to produce a context vector comprises using a pre-trained model, wherein said pre-trained model has been trained using corresponding queries and responses such that an encoding is used that maximises the similarity between the response vector and context vector for a corresponding query and response.
    Type: Grant
    Filed: January 18, 2019
    Date of Patent: May 26, 2020
    Assignee: PolyAI Limited
    Inventors: Matthew Steedman Henderson, Pei-Hao Su, Nikola Mrksic, Tsung-Hsien Wen, Inigo Casanueva Perez, Ivan Vulic, Georgios Spithourakis, Samuel John Coope, Pawel Budzianowski, Daniela Susanne Gerz
  • Publication number: 20200152182
    Abstract: A dialogue system comprising: an input for receiving input data relating to a speech or text signal originating from a user; an output for outputting speech or text information specified by a dialogue act; and a processor configured to: update a belief state, the belief state comprising information corresponding to one or more dialogue options, each dialogue option comprising a slot and a corresponding slot value, based on the input signal; determine a dialogue act, wherein a dialogue act is determined by applying one or more rules to world state information, the world state comprising information relating to the dialogue, wherein rules are applied in two or more ordered stages for each dialogue turn, wherein one of the stages is a first update stage, comprising applying one or more further rules controlling updating of the world state information based on the belief state information, and another of the stages is an act selection stage, comprising determining the dialogue act by applying the one or more rule
    Type: Application
    Filed: November 8, 2019
    Publication date: May 14, 2020
    Inventors: Matthew Steedman Henderson, Tsung-Hsien Wen, Pei-Hao Su, Nikola Mrksic, Ivan Vulic, Inigo Casanueva-Perez
  • Publication number: 20200152184
    Abstract: A dialogue system comprising: an input for receiving input data relating to a speech or text signal originating from a user; an output for outputting speech or text information specified by a dialogue act; and a processor configured to: generate features from the input signal; for each of a plurality of classifier models, each classifier model corresponding to a dialogue slot, and for one or more values corresponding to the dialogue slot, input features generated from the input signal, the classifier model outputting a probability corresponding to each of three or more relations, wherein the relations specify the relation of the value to the dialogue slot; update a belief state based on the outputs of the classifier models; determine a system dialogue act by inputting information relating to the belief state into a policy model; output speech or text information specified by the determined dialogue act at the output.
    Type: Application
    Filed: November 8, 2019
    Publication date: May 14, 2020
    Inventors: Matthew Steedman Henderson, Tsung-Hsien Wen, Pei-Hao Su, Nikola Mrksic, Ivan Vulic