Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a set of words. The program further retrieves an entry from a knowledge base comprising a plurality of entries. Each entry includes a text description of a concept. The program also determines an embedding for the entry based on the text description of the concept. The program further iteratively determines an embedding for a word in the set of words, increasing a size of a window of words in the set of words, and calculating a confidence score for the entry with respect to the word based on the embedding for the entry and the embedding for the word until a successive calculated confidence score decreases below a previous calculated confidence score. The program also determines that a window of words in the set of words having a previous size represents an entity.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a plurality of sets of words. Each set of words in the plurality of sets of words includes a word annotated as being an entity having a same custom entity type. The program further determines a plurality of word embeddings in a word embedding space for the plurality of annotated words. The program also defines a region in the word embedding space based on the received plurality of word embeddings. The program further receives a set of words. The program also determines a word embedding for a subset of the set of words. The program further determines whether the word embedding falls within the defined region in the word embedding space. Upon determining that the word embedding falls within the defined region in the word embedding space, the program also determines that the subset of the set of words represents an entity having the custom entity type.

Abstract: Some embodiments provide a program that receives a set of words. The program further determines an embedding for a word in the set of words. The program also accesses a knowledge base to retrieve a plurality of entries. Each entry includes a text description of a concept. The program further determines, for each entry in the plurality of entries in the knowledge base, an embedding for the entry based on the text description of the concept. The program also calculates, for each entry in the plurality of entries in the knowledge base, a distance value between the embedding for the word in the set of words and the embedding for the entry. The program further determines an entry in the plurality of entries in the knowledge base having a text description of a concept that best represents the set of words based on the plurality of distance values.