Abstract: Techniques are disclosed for systems and methods for learning the behavior of and/or for performing automated testing of a system under test (SUT). The learning/testing is accomplished solely via the graphical user interface (GUI) of the SUT and requires no a priori metadata/knowledge about the GUI objects. The learning engine operates by performing actions on the GUI and by observing the results of these actions. If the actions result in a change in the screen/page of the GUI then a screenshot is taken for further processing. Objects are detected from the screenshot, new actions that need to be performed on the objects are guessed, those actions are performed, the results are observed and the process repeats. Text labels on the screens are also read and are used for generating contextualized inputs for the screens. The learning process continues until any predetermined learning/testing criteria are satisfied.

Abstract: Techniques are disclosed for systems and methods for learning the behavior of and/or for performing automated testing of a system under test (SUT). The learning/testing is accomplished solely via the graphical user interface (GUI) of the SUT and requires no a priori metadata/knowledge about the GUI objects. The learning engine operates by performing actions on the GUI and by observing the results of these actions. If the actions result in a change in the screen/page of the GUI then a screenshot is taken for further processing. Objects are detected from the screenshot, new actions that need to be performed on the objects are guessed, those actions are performed, the results are observed and the process repeats. Text labels on the screens are also read and are used for generating contextualized inputs for the screens. The learning process continues until any predetermined learning/testing criteria are satisfied.