Abstract: A method of training a computer program to recognize software application controls includes: providing a controller and a memory coupled to the controller, wherein the controller is configured to: receive a plurality of images of one or more GUIs of one or more software applications, analyze the one or more GUI images via an image recognition algorithm to identify a position and associate a function for each of one or more user input controls found in the images, generate a set of execution instructions including the identified position of the input controls and their associated functions, test the accuracy of the execution instruction by executing the identified input controls in the one or more software applications and analyze one or more images captured to show the results of the execution.