Abstract: A system for training multilingual machine translation evaluation models and methods for making and using the same. The system can utilize a multilingual embedding space to leverage information from system inputs, including original source language, at least one machine translation of the original source language and at least one reference translation. The system can improve the accuracy of translation quality predictions by assigning a translation quality score based on the system inputs to be assigned to the machine translation. The translation quality score advantageously can demonstrate value added by using the original source language as an input to machine translation evaluation models.