Abstract: A system that incorporates contextual entity information when performing automatic speech processing (ASR) using a neural network architecture. The system identifies entities that may be related to the context of an utterance. Text information and pronunciation information related to those entities are encoded and used to determine biasing data that is applied to encoded audio data. The resulting adjusted encoded audio data is processed by the existing neural network architecture to determine ASR data representing a transcription of the utterance.