Abstract: An aspect of the present disclosure determines incompatibilities of automated test cases with modified user interfaces. In one embodiment, a mapping data between test cases in a test suite and user interface (UI) elements in the user interfaces of an application (tested using said test suite) is maintained, with mapping data indicating for each test case, the corresponding UI elements that the test case is designed to test. In response to receiving a modified (version of the) application that is to be tested with the same test suite, a set of UI elements (of the application) that are defective in the user interfaces of the modified application is found. Test cases that would fail are then identified based on the mapping data and the set of defective UI elements. The identified test cases are then reported as having incompatibility with the user interfaces of the modified application.