Patents by Inventor Jason E. Weston
Jason E. Weston has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11599566Abstract: In one embodiment, a method includes receiving, from a client system, a text input comprising one or more n-grams, determining, using a deep-learning model, a vector representation of the text input based on the one or more n-grams, determining an embedding of the vector representation of the text input in a d-dimensional embedding space, identifying one or more labels based on, for each of the one or more labels, a respective similarity of an embedding of a vector representation of the label in the embedding space to the embedding of the vector representation of the text input, and sending, to the client system in response to the received text input, instructions for presenting a user interface comprising one or more of the identified labels as suggested labels.Type: GrantFiled: July 8, 2019Date of Patent: March 7, 2023Assignee: Meta Platforms, Inc.Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Patent number: 11461388Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.Type: GrantFiled: August 20, 2018Date of Patent: October 4, 2022Assignee: Google LLCInventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
-
Patent number: 10762300Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.Type: GrantFiled: December 20, 2018Date of Patent: September 1, 2020Assignee: FACEBOOK, INC.Inventors: Jason E Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
-
Patent number: 10664744Abstract: Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.Type: GrantFiled: March 28, 2017Date of Patent: May 26, 2020Assignee: Facebook, Inc.Inventors: Jason E. Weston, Arthur David Szlam, Robert D. Fergus, Sainbayar Sukhbaatar
-
Patent number: 10489701Abstract: Embodiments are disclosed for providing a machine-generated response (e.g., answer) to an input (e.g., question) based on long-term memory information. A method according to some embodiments include receiving an input; converting the input into an input feature vector in an internal feature representation space; updating a memory data structure by incorporating the input feature vector into the memory data structure; generating an output feature vector in the internal feature representation space, based on the updated memory data structure and the input feature vector; converting the output feature vector into an output object; and providing an output based on the output object as a response to the input.Type: GrantFiled: October 13, 2015Date of Patent: November 26, 2019Assignee: Facebook, Inc.Inventors: Jason E. Weston, Sumit Chopra, Antoine Bordes
-
Publication number: 20190340538Abstract: In one embodiment, a method includes retrieving a first vector representation of a first entity, with which a user has interacted, and a second vector representation of a second entity, with which the user has not interacted. The first and second vector representations are determined using an initial deep-learning model. A first similarity score is computed between a vector representation of the user and the first vector representation, and a second similarity score is computed between the vector representation of the user and the second vector representation. The second vector representation is updated if the second similarity score is greater than the first similarity score using the initial deep-learning model. An updated deep-learning model is generated based on the initial deep-learning model and on the updated second vector representation.Type: ApplicationFiled: July 15, 2019Publication date: November 7, 2019Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Publication number: 20190332617Abstract: In one embodiment, a method includes receiving, from a client system, a text input comprising one or more n-grams, determining, using a deep-learning model, a vector representation of the text input based on the one or more n-grams, determining an embedding of the vector representation of the text input in a d-dimensional embedding space, identifying one or more labels based on, for each of the one or more labels, a respective similarity of an embedding of a vector representation of the label in the embedding space to the embedding of the vector representation of the text input, and sending, to the client system in response to the received text input, instructions for presenting a user interface comprising one or more of the identified labels as suggested labels.Type: ApplicationFiled: July 8, 2019Publication date: October 31, 2019Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Patent number: 10402750Abstract: In one embodiment, a method includes accessing a first set of entities, with which a user has interacted, and a second set of entities in a social-networking system. A first set of vector representations of the first set of entities are determined using a deep-learning model. A target entity is selected from the first set of entities, and the vector representation of the target entity is removed from the first set. The remaining vector representations in the first set are combined to determine a vector representation of the user. A second set of vector representations of the second set of entities are determined using the deep-learning model. Similarity scores are computed between the user and each of the target entity and the entities in the second set of entities. Vector representations of entities in the second set of entities are updated based on the similarity scores using the deep-learning model.Type: GrantFiled: December 30, 2015Date of Patent: September 3, 2019Assignee: Facebook, Inc.Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Patent number: 10387464Abstract: In one embodiment, a method includes receiving text query that includes n-grams. A vector representation of each n-gram is determined using a deep-learning model. A nonlinear combination of the vector representations of the n-grams is determined, and an embedding of the text query is determined based on the nonlinear combination. The embedding of the text query corresponds to a point in an embedding space, and the embedding space includes a plurality of points corresponding to a plurality of label embeddings. Each label embedding is based on a vector representation of a respective label determined using the deep-learning model. Label embeddings are identified as being relevant to the text query by applying a search algorithm to the embedding space. Points corresponding to the identified label embeddings are within a threshold distance of the point corresponding to the embedding of the text query in the embedding space.Type: GrantFiled: November 23, 2015Date of Patent: August 20, 2019Assignee: Facebook, Inc.Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Patent number: 10198433Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.Type: GrantFiled: March 22, 2016Date of Patent: February 5, 2019Assignee: FACEBOOK, INC.Inventors: Jason E Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
-
Publication number: 20180357240Abstract: In one embodiment, a computing system may generate a query vector representation of an input (e.g., a question). The system may generate relevance measures associated with a set of key-value memories based on comparisons between the query vector representation and key vector representations of the keys in the memories. The system may generate an aggregated result based on the relevance measures and value vector representations of the values in the memories. Through an iterative process that iteratively updates the query vector representation used in each iteration, the system may generate a final aggregated result using a final query vector representation. A combined feature representation may be generated based on the final aggregated result and the final query vector representation. The system may select an output (e.g., an answer to the question) in response to the input based on comparisons between the combined feature representation and a set of candidate outputs.Type: ApplicationFiled: June 7, 2018Publication date: December 13, 2018Inventors: Alexander Holden Miller, Adam Joshua Fisch, Jesse Dean Dodge, Amir-Hossein Karimi, Antoine Bordes, Jason E. Weston
-
Publication number: 20180357312Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.Type: ApplicationFiled: August 20, 2018Publication date: December 13, 2018Inventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
-
Patent number: 10055493Abstract: Generating a playlist may include designating a seed track in an audio library; identifying audio tracks in the audio library having constructs that are within a range of a corresponding construct of the seed track, where the constructs for the audio tracks are derived from frequency representations of the audio tracks, and the corresponding construct for the seed track is derived from a frequency representation of the seed track; and generating the playlist using at least some of the audio tracks that were identified.Type: GrantFiled: May 9, 2011Date of Patent: August 21, 2018Assignee: Google LLCInventors: Geremy A. Heitz, III, Adam Berenzweig, Jason E. Weston, Ron J. Weiss, Sally A. Goldman, Thomas Walters, Samy Bengio, Douglas Eck, Jay M. Ponte, Ryan M. Rifkin
-
Publication number: 20170277667Abstract: Techniques to predictively respond to user requests using natural language processing are described. In one embodiment, an apparatus may comprise a client communication component operative to receive a user service request from a user client; an interaction processing component operative to submit the user service request to a memory-based natural language processing component; generate a series of user interaction exchanges with the user client based on output from the memory-based natural language processing component, wherein the series of user interaction exchanges are represented in a memory component of the memory-based natural language processing component; and receive one or more operator instructions for the performance of the user service request from the memory-based natural language processing component; and a user interface component operative to display the one or more operator instructions in an operator console. Other embodiments are described and claimed.Type: ApplicationFiled: March 22, 2016Publication date: September 28, 2017Applicant: Facebook, Inc.Inventors: Jason E. Weston, Antoine Bordes, Alexandre Lebrun, Martin Jean Raison
-
Publication number: 20170200077Abstract: Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.Type: ApplicationFiled: March 28, 2017Publication date: July 13, 2017Inventors: Jason E. Weston, Arthur David Szlam, Robert D. Fergus, Sainbayar Sukhbaatar
-
Publication number: 20170193390Abstract: In one embodiment, a method includes accessing a first set of entities, with which a user has interacted, and a second set of entities in a social-networking system. A first set of vector representations of the first set of entities are determined using a deep-learning model. A target entity is selected from the first set of entities, and the vector representation of the target entity is removed from the first set. The remaining vector representations in the first set are combined to determine a vector representation of the user. A second set of vector representations of the second set of entities are determined using the deep-learning model. Similarity scores are computed between the user and each of the target entity and the entities in the second set of entities. Vector representations of entities in the second set of entities are updated based on the similarity scores using the deep-learning model.Type: ApplicationFiled: December 30, 2015Publication date: July 6, 2017Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Publication number: 20170103324Abstract: Embodiments are disclosed for providing a machine-generated response (e.g., answer) to an input (e.g., question) based on long-term memory information. A method according to some embodiments include receiving an input; converting the input into an input feature vector in an internal feature representation space; updating a memory data structure by incorporating the input feature vector into the memory data structure; generating an output feature vector in the internal feature representation space, based on the updated memory data structure and the input feature vector; converting the output feature vector into an output object; and providing an output based on the output object as a response to the input.Type: ApplicationFiled: October 13, 2015Publication date: April 13, 2017Inventors: Jason E. Weston, Sumit Chopra, Antoine Bordes
-
Publication number: 20170061294Abstract: In one embodiment, a method includes receiving text query that includes n-grams. A vector representation of each n-gram is determined using a deep-learning model. A nonlinear combination of the vector representations of the n-grams is determined, and an embedding of the text query is determined based on the nonlinear combination. The embedding of the text query corresponds to a point in an embedding space, and the embedding space includes a plurality of points corresponding to a plurality of label embeddings. Each label embedding is based on a vector representation of a respective label determined using the deep-learning model. Label embeddings are identified as being relevant to the text query by applying a search algorithm to the embedding space. Points corresponding to the identified label embeddings are within a threshold distance of the point corresponding to the embedding of the text query in the embedding space.Type: ApplicationFiled: November 23, 2015Publication date: March 2, 2017Inventors: Jason E. Weston, Keith Adams, Sumit Chopra
-
Patent number: 9454600Abstract: Methods, systems and apparatus for refining image relevance models. In general, one aspect includes receiving a trained image relevance model that generates relevance measures of content feature values of images to a query, identifying a first threshold number of common content feature values for the set of training images, the common content feature values being identified as a set of content feature values that are each shared by at least a portion of the training images, identifying a subset of the set of training images having a quantity of the common content feature values greater than a second threshold number of content features values, and generating a re-trained image relevance model based on content feature values of the set of training images, wherein content feature values of the subset of training images are weighted higher than content feature values of the training images not in the subset.Type: GrantFiled: February 1, 2012Date of Patent: September 27, 2016Assignee: Google Inc.Inventors: Thomas J. Duerig, Jason E. Weston, Charles J. Rosenberg, Kunlong Gu, Samy Bengio
-
Publication number: 20160188592Abstract: Systems, methods, and non-transitory computer-readable media can create, in a training phase, a first content item representation of a first content item based on a first content item transformation. The first content item can comprise one or more of images and video. A first user metadata representation of first user metadata may be created based on a first user metadata transformation. The first content item representation and the first user metadata representation can be combined to produce a first combined representation. The first combined representation and a first tag representation of a first tag can be embedded in an embedding space within a first threshold distance from one another.Type: ApplicationFiled: December 24, 2014Publication date: June 30, 2016Inventors: Robert D. Fergus, Lubomir Bourdev, Emily Lynn Denton, Jason E. Weston