Abstract: A method for display-independent recognition of a graphical user interface (GUI) control, the method comprising capturing a screenshot of a GUI of a computerized application, determining a cursor position in the screenshot, analyzing an area surrounding the cursor position, to identify a GUI control, and storing an image of the GUI control.
Type:
Grant
Filed:
November 30, 2014
Date of Patent:
July 11, 2017
Assignee:
KRYON SYSTEMS LTD.
Inventors:
Emma Butin, Oren Keinan, Erez Keinan, Alon Rabinovich
Abstract: Device, system, and method for providing interactive guidance with execution of operations. For example, a method of providing interactive guidance to a user of a computerized application includes: receiving a user request to obtain interactive guidance with respect to the computerized application; based on the user request, selectively retrieving an interactive guidance script from a repository of previously-recorded interactive guidance scripts; playing the interactive guidance script with respect to the computerized application; and automatically executing by the interactive guidance script at least one action on behalf of the user with regard to the computerized application.
Abstract: A method for display-independent execution of a computerized guidance script, the method comprising capturing a screenshot of a graphical user interface (GUI) of a computerized application, analyzing the screenshot for matching a control of the screenshot with a control of the guidance script, and executing the guidance script, based on the matching, to operate the computerized application. Additionally, a display-independent computerized guidance engine, comprising a screenshot analysis engine and a guidance script execution engine.
Abstract: A method for recording a display-independent computerized guidance script, the method comprising capturing a screenshot of a GUI of a computerized application, analyzing an area, in the screenshot, surrounding a determined cursor position, to identify a GUI control, recording a manual operation sequence of the computerized application, and assigning the GUI control to a step of the operation sequence.
Abstract: A method for display-independent recognition of a graphical user interface (GUI) control, the method comprising capturing a screenshot of a GUI of a computerized application, determining a cursor position in the screenshot, analyzing an area surrounding the cursor position, to identify a GUI control, and storing an image of the GUI control.
Type:
Grant
Filed:
August 24, 2009
Date of Patent:
December 23, 2014
Assignee:
Kryon Systems Ltd.
Inventors:
Emma Butin, Oren Keinan, Erez Keinan, Alon Rabinovich