Abstract: A framework or system is described for testing compliance and robustness of a communication signal protocol employed by an entity which is connected to an IP based network, particularly for testing a SIP enabled entity or device. Within the framework, multiple test clients are coordinated by a centralized test controller and thus test progress and results can be controlled and monitored in a centralized manner. The framework uses simple template-based test scripts which are easy to write and does not involve complex programming constructs.