Abstract: A speech index for a recording or other representation of an audio signal containing speech is generated using a phonetic automatic voice recognition engine. A second speech index is also generated using a more accurate, but slower, automatic voice recognition engine such as a large vocabulary speech recognition (LVSR) engine. These two speech indexes are compared. The results of the comparison are then used to adjust certain parameters used by the phonetic engine while generating a speech index. The results may also be used to correct all or parts of the speech index generated by the phonetic automatic speech recognition engine.