Abstract: A system is provided for natural language processing. In some embodiments, the system includes an encoder for generating context-specific word vectors for at least one input sequence of words. The encoder is pre-trained using training data for performing a first natural language processing task. A neural network performs a second natural language processing task on the at least one input sequence of words using the context-specific word vectors. The first natural language process task is different from the second natural language processing task and the neural network is separately trained from the encoder.
Type:
Application
Filed:
May 17, 2018
Publication date:
December 27, 2018
Applicant:
salesforce.come, inc,
Inventors:
Bryan McCann, Caiming Xiong, Richard Socher