Abstract: A speech dialog management system where each dialog is capable of supporting one or more turns of conversation between a user and virtual agent using any one or combination of a communications interface and data interface. The system includes compiled application libraries, which determine the recognition, response, and flow control in a dialog with a user. A process of execution of a compiled application library runs throughout the conversation, putting itself into a dormant state in between processing of the communications from the user. A script manager brokers information between the processes of execution of the compiled application libraries and many communications with users.