Abstract: A guide track based speech synthesis system and method that uses an imitator voice and extracted parameter from the imitator voice to enhance the speech synthesized by conventional approach using the library built from an original voice with performance idiosyncrasies, emotions, and characteristics. The imitator voice reads from an input script to recorded speech in substantially the same way as the original voice. The recorded speech is stored in a guide track. Prior recordings of audio from the original voice are used to build a voice library. Context features and prosodic features are extracted from the guide track and corrected. Spectral features which align with the context features and prosodic features of the guide track are generated from the voice library. The aligned acoustic features are then converted to a speech waveform of an enhanced synthetic voice.