Patents by Inventor Jason E. Weston

Jason E. Weston has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11599566
    Abstract: In one embodiment, a method includes receiving, from a client system, a text input comprising one or more n-grams, determining, using a deep-learning model, a vector representation of the text input based on the one or more n-grams, determining an embedding of the vector representation of the text input in a d-dimensional embedding space, identifying one or more labels based on, for each of the one or more labels, a respective similarity of an embedding of a vector representation of the label in the embedding space to the embedding of the vector representation of the text input, and sending, to the client system in response to the received text input, instructions for presenting a user interface comprising one or more of the identified labels as suggested labels.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: March 7, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Patent number: 11461388
    Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.
    Type: Grant
    Filed: August 20, 2018
    Date of Patent: October 4, 2022
    Assignee: Google LLC
    Inventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
  • Patent number: 10762300
    Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.
    Type: Grant
    Filed: December 20, 2018
    Date of Patent: September 1, 2020
    Assignee: FACEBOOK, INC.
    Inventors: Jason E Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
  • Patent number: 10664744
    Abstract: Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.
    Type: Grant
    Filed: March 28, 2017
    Date of Patent: May 26, 2020
    Assignee: Facebook, Inc.
    Inventors: Jason E. Weston, Arthur David Szlam, Robert D. Fergus, Sainbayar Sukhbaatar
  • Patent number: 10489701
    Abstract: Embodiments are disclosed for providing a machine-generated response (e.g., answer) to an input (e.g., question) based on long-term memory information. A method according to some embodiments include receiving an input; converting the input into an input feature vector in an internal feature representation space; updating a memory data structure by incorporating the input feature vector into the memory data structure; generating an output feature vector in the internal feature representation space, based on the updated memory data structure and the input feature vector; converting the output feature vector into an output object; and providing an output based on the output object as a response to the input.
    Type: Grant
    Filed: October 13, 2015
    Date of Patent: November 26, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason E. Weston, Sumit Chopra, Antoine Bordes
  • Publication number: 20190340538
    Abstract: In one embodiment, a method includes retrieving a first vector representation of a first entity, with which a user has interacted, and a second vector representation of a second entity, with which the user has not interacted. The first and second vector representations are determined using an initial deep-learning model. A first similarity score is computed between a vector representation of the user and the first vector representation, and a second similarity score is computed between the vector representation of the user and the second vector representation. The second vector representation is updated if the second similarity score is greater than the first similarity score using the initial deep-learning model. An updated deep-learning model is generated based on the initial deep-learning model and on the updated second vector representation.
    Type: Application
    Filed: July 15, 2019
    Publication date: November 7, 2019
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Publication number: 20190332617
    Abstract: In one embodiment, a method includes receiving, from a client system, a text input comprising one or more n-grams, determining, using a deep-learning model, a vector representation of the text input based on the one or more n-grams, determining an embedding of the vector representation of the text input in a d-dimensional embedding space, identifying one or more labels based on, for each of the one or more labels, a respective similarity of an embedding of a vector representation of the label in the embedding space to the embedding of the vector representation of the text input, and sending, to the client system in response to the received text input, instructions for presenting a user interface comprising one or more of the identified labels as suggested labels.
    Type: Application
    Filed: July 8, 2019
    Publication date: October 31, 2019
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Patent number: 10402750
    Abstract: In one embodiment, a method includes accessing a first set of entities, with which a user has interacted, and a second set of entities in a social-networking system. A first set of vector representations of the first set of entities are determined using a deep-learning model. A target entity is selected from the first set of entities, and the vector representation of the target entity is removed from the first set. The remaining vector representations in the first set are combined to determine a vector representation of the user. A second set of vector representations of the second set of entities are determined using the deep-learning model. Similarity scores are computed between the user and each of the target entity and the entities in the second set of entities. Vector representations of entities in the second set of entities are updated based on the similarity scores using the deep-learning model.
    Type: Grant
    Filed: December 30, 2015
    Date of Patent: September 3, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Patent number: 10387464
    Abstract: In one embodiment, a method includes receiving text query that includes n-grams. A vector representation of each n-gram is determined using a deep-learning model. A nonlinear combination of the vector representations of the n-grams is determined, and an embedding of the text query is determined based on the nonlinear combination. The embedding of the text query corresponds to a point in an embedding space, and the embedding space includes a plurality of points corresponding to a plurality of label embeddings. Each label embedding is based on a vector representation of a respective label determined using the deep-learning model. Label embeddings are identified as being relevant to the text query by applying a search algorithm to the embedding space. Points corresponding to the identified label embeddings are within a threshold distance of the point corresponding to the embedding of the text query in the embedding space.
    Type: Grant
    Filed: November 23, 2015
    Date of Patent: August 20, 2019
    Assignee: Facebook, Inc.
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Patent number: 10198433
    Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.
    Type: Grant
    Filed: March 22, 2016
    Date of Patent: February 5, 2019
    Assignee: FACEBOOK, INC.
    Inventors: Jason E Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
  • Publication number: 20180357240
    Abstract: In one embodiment, a computing system may generate a query vector representation of an input (e.g., a question). The system may generate relevance measures associated with a set of key-value memories based on comparisons between the query vector representation and key vector representations of the keys in the memories. The system may generate an aggregated result based on the relevance measures and value vector representations of the values in the memories. Through an iterative process that iteratively updates the query vector representation used in each iteration, the system may generate a final aggregated result using a final query vector representation. A combined feature representation may be generated based on the final aggregated result and the final query vector representation. The system may select an output (e.g., an answer to the question) in response to the input based on comparisons between the combined feature representation and a set of candidate outputs.
    Type: Application
    Filed: June 7, 2018
    Publication date: December 13, 2018
    Inventors: Alexander Holden Miller, Adam Joshua Fisch, Jesse Dean Dodge, Amir-Hossein Karimi, Antoine Bordes, Jason E. Weston
  • Publication number: 20180357312
    Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.
    Type: Application
    Filed: August 20, 2018
    Publication date: December 13, 2018
    Inventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
  • Patent number: 10055493
    Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.
    Type: Grant
    Filed: May 9, 2011
    Date of Patent: August 21, 2018
    Assignee: Google LLC
    Inventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
  • Publication number: 20170277667
    Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.
    Type: Application
    Filed: March 22, 2016
    Publication date: September 28, 2017
    Applicant: Facebook, Inc.
    Inventors: Jason E. Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
  • Publication number: 20170200077
    Abstract: Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.
    Type: Application
    Filed: March 28, 2017
    Publication date: July 13, 2017
    Inventors: Jason E. Weston, Arthur David Szlam, Robert D. Fergus, Sainbayar Sukhbaatar
  • Publication number: 20170193390
    Abstract: In one embodiment, a method includes accessing a first set of entities, with which a user has interacted, and a second set of entities in a social-networking system. A first set of vector representations of the first set of entities are determined using a deep-learning model. A target entity is selected from the first set of entities, and the vector representation of the target entity is removed from the first set. The remaining vector representations in the first set are combined to determine a vector representation of the user. A second set of vector representations of the second set of entities are determined using the deep-learning model. Similarity scores are computed between the user and each of the target entity and the entities in the second set of entities. Vector representations of entities in the second set of entities are updated based on the similarity scores using the deep-learning model.
    Type: Application
    Filed: December 30, 2015
    Publication date: July 6, 2017
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Publication number: 20170103324
    Abstract: Embodiments are disclosed for providing a machine-generated response (e.g., answer) to an input (e.g., question) based on long-term memory information. A method according to some embodiments include receiving an input; converting the input into an input feature vector in an internal feature representation space; updating a memory data structure by incorporating the input feature vector into the memory data structure; generating an output feature vector in the internal feature representation space, based on the updated memory data structure and the input feature vector; converting the output feature vector into an output object; and providing an output based on the output object as a response to the input.
    Type: Application
    Filed: October 13, 2015
    Publication date: April 13, 2017
    Inventors: Jason E. Weston, Sumit Chopra, Antoine Bordes
  • Publication number: 20170061294
    Abstract: In one embodiment, a method includes receiving text query that includes n-grams. A vector representation of each n-gram is determined using a deep-learning model. A nonlinear combination of the vector representations of the n-grams is determined, and an embedding of the text query is determined based on the nonlinear combination. The embedding of the text query corresponds to a point in an embedding space, and the embedding space includes a plurality of points corresponding to a plurality of label embeddings. Each label embedding is based on a vector representation of a respective label determined using the deep-learning model. Label embeddings are identified as being relevant to the text query by applying a search algorithm to the embedding space. Points corresponding to the identified label embeddings are within a threshold distance of the point corresponding to the embedding of the text query in the embedding space.
    Type: Application
    Filed: November 23, 2015
    Publication date: March 2, 2017
    Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
  • Patent number: 9454600
    Abstract: Methods, systems and apparatus for refining image relevance models. In general, one aspect includes receiving a trained image relevance model that generates relevance measures of content feature values of images to a query, identifying a first threshold number of common content feature values for the set of training images, the common content feature values being identified as a set of content feature values that are each shared by at least a portion of the training images, identifying a subset of the set of training images having a quantity of the common content feature values greater than a second threshold number of content features values, and generating a re-trained image relevance model based on content feature values of the set of training images, wherein content feature values of the subset of training images are weighted higher than content feature values of the training images not in the subset.
    Type: Grant
    Filed: February 1, 2012
    Date of Patent: September 27, 2016
    Assignee: Google Inc.
    Inventors: Thomas J. Duerig, Jason E. Weston, Charles J. Rosenberg, Kunlong Gu, Samy Bengio
  • Publication number: 20160188592
    Abstract: Systems, methods, and non-transitory computer-readable media can create, in a training phase, a first content item representation of a first content item based on a first content item transformation. The first content item can comprise one or more of images and video. A first user metadata representation of first user metadata may be created based on a first user metadata transformation. The first content item representation and the first user metadata representation can be combined to produce a first combined representation. The first combined representation and a first tag representation of a first tag can be embedded in an embedding space within a first threshold distance from one another.
    Type: Application
    Filed: December 24, 2014
    Publication date: June 30, 2016
    Inventors: Robert D. Fergus, Lubomir Bourdev, Emily Lynn Denton, Jason E. Weston