Abstract: The presently disclosed inventive concepts are directed to systems, computer program products, and methods for intelligent screen automation. The inventive techniques include: identifying first and second sets of elements within one or more images of a user interface, where each of the first set of elements is independently selected from: vertical lines, horizontal lines, and rectangular elements, and each of the second set of elements is independently selected from: radio buttons, icons, and textual elements. The methods also include determining one or more logical relationships between the textual elements and non-textual elements of the image; building a hierarchy comprising some or all of the first set of elements and some or all of the second set of elements in order to form a tree-based data structure representing functionality of the user interface; and outputting the tree-based data structure to a memory.

Abstract: Determining a web page processing state of a browser, during a processing of a web page using a browser, by setting parameters in a state determiner on the basis of predefined processing events related to queued processing tasks; the state determiner determining said web page processing state on the basis of said parameters in accordance with one or more predefined criteria.