Abstract: This document relates to natural language processing using a framework such as a neural network. One example method involves obtaining a first document and a second document and propagating attention from the first document to the second document. The example method also involves producing contextualized semantic representations of individual words in the second document based at least on the propagating. The contextualized semantic representations can provide a basis for performing one or more natural language processing operations.

Abstract: This document relates to natural language processing using a framework such as a neural network. One example method involves obtaining a first document and a second document and propagating attention from the first document to the second document. The example method also involves producing contextualized semantic representations of individual words in the second document based at least on the propagating. The contextualized semantic representations can provide a basis for performing one or more natural language processing operations.

Abstract: Described herein is a mechanism for utilizing a neural network to identify and rank search results. A machine learning model is trained by converting training data comprising query-document entries into query term-document entries. The query term-document entries are utilized to train the machine learning model. A set of query terms are identified. The query terms can be derived from a query history. The trained machine learning model is used to calculate document ranking scores for the query terms and the resultant scores are stored in a pre-calculated term-document index. A query to search the document index is broken down into its constituent terms and an aggregate document ranking score is calculated from a weighted sum of the document ranking scores corresponding to the individual query terms. Because the term-document index can be pre-calculated, it can be downloaded to provide deep learning search capabilities in a computationally limited environment.

Abstract: Described herein is a mechanism for utilizing a neural network to identify and rank search results. A machine learning model is trained by converting training data comprising query-document entries into query term-document entries. The query term-document entries are utilized to train the machine learning model. A set of query terms are identified. The query terms can be derived from a query history. The trained machine learning model is used to calculate document ranking scores for the query terms and the resultant scores are stored in a pre-calculated term-document index. A query to search the document index is broken down into its constituent terms and an aggregate document ranking score is calculated from a weighted sum of the document ranking scores corresponding to the individual query terms. Because the term-document index can be pre-calculated, it can be downloaded to provide deep learning search capabilities in a computationally limited environment.

Abstract: This document relates to natural language processing using a framework such as a neural network. One example method involves obtaining a first document and a second document and propagating attention from the first document to the second document. The example method also involves producing contextualized semantic representations of individual words in the second document based at least on the propagating. The contextualized semantic representations can provide a basis for performing one or more natural language processing operations.

Abstract: This document relates to natural language processing using a framework such as a neural network. One example method involves obtaining a first document and a second document and propagating attention from the first document to the second document. The example method also involves producing contextualized semantic representations of individual words in the second document based at least on the propagating. The contextualized semantic representations can provide a basis for performing one or more natural language processing operations.

Abstract: A computer-implemented technique receives an input expression that a user submits with an intent to accomplish some objective. The technique then uses a machine-trained intent encoder component to map the input expression into an input expression intent vector (IEIV). The IEIV corresponds to a distributed representation of the intent associated with the input expression, within a vector intent vector space. The technique then leverages the intent vector to facilitate some downstream application task, such as the retrieval of information. Some application tasks also use a neighbor search component to find expressions that express an intent similar to that of the input expression. A training system trains the intent encoder component based on the nexus between queries and user clicks, as recorded in a search engine's search log.

Abstract: This document relates to natural language processing using a framework such as a neural network. One example method involves obtaining a first document and a second document and propagating attention from the first document to the second document. The example method also involves producing contextualized semantic representations of individual words in the second document based at least on the propagating. The contextualized semantic representations can provide a basis for performing one or more natural language processing operations.

Abstract: Described herein is a mechanism for utilizing a neural network to identify and rank search results. A machine learning model is trained by converting training data comprising query-document entries into query term-document entries. The query term-document entries are utilized to train the machine learning model. A set of query terms are identified. The query terms can be derived from a query history. The trained machine learning model is used to calculate document ranking scores for the query terms and the resultant scores are stored in a pre-calculated term-document index. A query to search the document index is broken down into its constituent terms and an aggregate document ranking score is calculated from a weighted sum of the document ranking scores corresponding to the individual query terms. Because the term-document index can be pre-calculated, it can be downloaded to provide deep learning search capabilities in a computationally limited environment.

Abstract: A computer-implemented technique is described herein that receives an input expression that a user submits with an intent to accomplish some objective. The technique then uses a machine-trained intent encoder component to map the input expression into an input expression intent vector (IEIV). The IEIV corresponds to a distributed representation of the intent associated with the input expression, within a vector intent vector space. The technique then leverages the intent vector to facilitate some downstream application task, such as the retrieval of information. Some application tasks also use a neighbor search component to find expressions that express an intent similar to that of the input expression. A training system trains the intent encoder component based on the nexus between queries and user clicks, as recorded in a search engine's search log.