Abstract: A method of electroencephalography (EEG) based speech recognition includes obtaining, from a microphone, an audio signal of a speaker from a first time period, obtaining, from one or more EEG sensors, EEG signals of the speaker from the first time period, obtaining, from a first model, acoustic representations based on the EEG signals, concatenating the obtained acoustic representations with an audio input based on the audio signal to obtain concatenated features, providing the concatenated features to an automatic speech recognition model (ASR) and obtaining, from the ASR model, a text-based output.