Abstract: A method, system and product including: obtaining a graphical user interface (GUI) element of a GUI of the end device, wherein the GUI element is associated with a text string that is included in the GUI; transforming at least a portion of the text string according to a transformation function, thereby obtaining a fully or semi-transformed text string, wherein the semi-transformed text string comprises a transformed portion and a plaintext portion; providing to a server the fully or semi-transformed text string, whereby the server is enabled to perform string-based analysis without being exposed to a content of the text string.

Abstract: A system, method and product for client-side automated application programming interface (API) mapping of a computerized system. The method comprises creating a mapping by: detecting, by a client-side agent that is operated on a client device executing a frontend of the computerized system, an invocation by a first application of the API function of a second application, wherein the API function is defined by a function prototype comprising a domain of potential values for an input or output parameter of the API function; and based on information gathered by the client-side agent, automatically determining a logical schema of the API function, wherein the logical schema defining a logical function prototype comprising a sub-domain of the domain of potential values, wherein the sub-domain restricting at least one value of the domain.

Abstract: A method, system and product for improving acquisition process of GUI elements using user input. A method comprises obtaining a digital representation of a first version of a GUI that includes a GUI element, obtaining a digital representation of a second version of the GUI, obtaining an identified element that was identified, using an acquisition process operated on the second version of the GUI, as being estimated to correspond to the GUI element in the first version of the GUI. The first version of the GUI and the second version of the GUI may be displayed in parallel to a user. User input indicative of whether the identified element corresponds to the GUI element, based on the display, may be obtained. The acquisition process may be updated based on the user input.

Abstract: A method, system and product including a browser configured to render pages, wherein the browser comprises a client-side execution engine, wherein the browser is configured to execute an extension for the browser, wherein the extension is a computer program product that has a memory storage that is external to the client-side execution engine of the browser; and a set of pages that is defined over multiple domains, wherein the set of pages comprises respective instances of an additive software layer that is configured to execute a walkthrough over the multiple domains, wherein a page of the set of one or more pages comprises an instance of the respective instances and a communication element that is configured to enable the instance of the additive software layer to communicate data to and from the extension.

Abstract: A method, apparatus and product for chat-based application interface for automation. Using a natural language interface, receiving user input. Based on the user input, determining an automation process of a computer program having a user interface (UI), to be executed. The automation process is executed by utilizing the UI to input data thereto or execute functionality thereof. Additionally or alternatively, a conversation to be implemented by a natural language interface may be defined. The conversation is configured to obtain from the user one or more values corresponding to one or more parameters. The conversation is associated with a parameterized automation process depending on the one or more parameters. The parameterized automation process is invoked automatically by a natural language interface and using one or more values provided by the user to the natural language interface for the one or more parameters.

Abstract: A product, system and method for automatic testing of walkthroughs. A test of a walkthrough of an application is executed, at least in part. The test includes a sequence of automated user actions, that is configured to invoke a sequence of steps of the walkthrough. A trace display of the test execution is generated. The trace display includes a visual display of events including both steps of the walkthrough and automated user actions of the test, so as to provide an interleaved display between a visual representation of the walkthrough and a visual representation of the test.

Abstract: A computer implemented method of editing attributes of data records presented through GUI elements by a webpage. The method including the steps of: using one or more processors of a client terminal hosting a web browser for executing a code for parsing a webpage rendered by the web browser to extract identifier information of one or more GUI elements presented in the webpage, the GUI elements presenting a value of one or more attributes of a data record extracted from a database according to the identifier information. The GUI elements are presented in a non-editable area, identifying a user selection indicative of the GUI elements, rendering an editing GUI element for editing the value, extracting a user input received from a user using the editing GUI element and forwarding to a server hosting the webpage instructions to update the value in the data record according to the user input.

Abstract: Method, system and product for automatic execution of operations sequences. An operations sequence, which includes a first operation immediately followed by a second operation, is obtained. The operations sequence or portion thereof is automatically executed, at least by performing: in response to a determination that a first element required for performing the first operation is available for user interaction in a first state of the computing device, mimicking a user interaction with the first element to perform the first operation, whereby causing a current state of the computing device to change from the first state to a second state; and in response to a determination that a second element required for performing the second operation is available for user interaction in the second state, mimicking user interaction with the second element to perform the second operation.

Abstract: A method, system and product including: obtaining a graphical user interface (GUI) element of a GUI of the end device, wherein the GUI element is associated with a text string that is included in the GUI; transforming at least a portion of the text string according to a transformation function, thereby obtaining a fully or semi-transformed text string, wherein the semi-transformed text string comprises a transformed portion and a plaintext portion; providing to a server the fully or semi-transformed text string, whereby the server is enabled to perform string-based analysis without being exposed to a content of the text string.

Abstract: A computer implemented method of adapting an application according to user interaction comprising using one or more processors for executing a code for collecting autonomously a plurality of action events describing a plurality of actions taken by a plurality of users to navigate through a plurality of pages presented by an application to accomplish one or more goals of the application, the plurality of pages are presented on a GUI at a plurality of user devices used by the plurality of users, analyzing the action events to identify one or more behavioral patterns of at least some of the users for accomplishing the goal(s) and generating automatically one or more recommended adaptations for the application according to the behavioral pattern(s) to adapt a layout of the application in order to increase a probability for one or more users to successfully accomplish the goal(s).

Abstract: A method, apparatus and product for defining an automation process to be invoked in response to a conversation of a user with a natural language interface. A conversation that is configured to obtain from a user values for parameters and is implemented by a natural language interface is defined. The conversation is associated with the automation process that is configured to utilize a user interface of a computer program to input data thereto or execute functionality thereof. The automation process is a parameterized automation process depending on parameters. The conversation is published to be made accessible to a user via the natural language interface.

Abstract: A method, system and product for improving acquisition process of GUI elements using user input. A method comprises obtaining a digital representation of a first version of a GUI that includes a GUI element, obtaining a digital representation of a second version of the GUI, obtaining an identified element that was identified, using an acquisition process operated on the second version of the GUI, as being estimated to correspond to the GUI element in the first version of the GUI. The first version of the GUI and the second version of the GUI may be displayed in parallel to a user. User input indicative of whether the identified element corresponds to the GUI element, based on the display, may be obtained. The acquisition process may be updated based on the user input.

Abstract: A method, apparatus and product for GUI element acquisition using a plurality of alternative representations of the GUI element. The method comprising: obtaining a selection of a Graphical User Interface (GUI) element; obtaining a representation set of the GUI element, wherein the representation set comprises a plurality of alternative representations, each of which provides a manner of identifying the GUI element in GUIs; applying the representation set to identify the GUI element in a GUI of a program, wherein said applying the representation set comprises, for each representation of the alternative representations, independently applying the each representation to identify one or more GUI elements corresponding the each representation; and in response to determining that said applying the representation set provides an indefinite result, obtaining a modified representation set.

Abstract: A method, apparatus and product for chat-based application interface for automation. Using a natural language interface, receiving user input. Based on the user input, determining an automation process of a computer program having a user interface (UI), to be executed. The automation process is executed by utilizing the UI to input data thereto or execute functionality thereof. Additionally or alternatively, a conversation to be implemented by a natural language interface may be defined. The conversation is configured to obtain from the user one or more values corresponding to one or more parameters. The conversation is associated with a parameterized automation process depending on the one or more parameters. The parameterized automation process is invoked automatically by a natural language interface and using one or more values provided by the user to the natural language interface for the one or more parameters.

Abstract: Method, system and product for automatic performance of user interaction operations on a computing device. A method comprising: obtaining an identifier of an operations sequence; obtaining the operations sequence by searching a repository of operations sequences using the identifier, wherein the repository of operation sequences comprises operations sequences defined based on a previous execution of one or more operations by another computing device other than the computing device on behalf of another user other than the user; and automatically executing the operations sequence or portion thereof on the computing device. Another method comprises: identifying elements in a layout of a GUI, displaying in visible proximity to each of the elements an assigned unique label; recognizing speech by a user vocally indicating a selected element by referring to the assigned label; and, automatically performing a user interaction operation on the selected element.

Abstract: A method, system and product for improving acquisition process of GUI elements using user input. A method comprises obtaining a digital representation of a first version of a GUI that includes a GUI element, obtaining a digital representation of a second version of the GUI, obtaining an identified element that was identified, using an acquisition process operated on the second version of the GUI, as being estimated to correspond to the GUI element in the first version of the GUI. The first version of the GUI and the second version of the GUI may be displayed in parallel to a user. User input indicative of whether the identified element corresponds to the GUI element, based on the display, may be obtained. The acquisition process may be updated based on the user input.

Abstract: A method, apparatus and product for GUI element acquisition using a plurality of alternative representations of the GUI element. The method comprising: obtaining a selection of a Graphical User Interface (GUI) element; obtaining a representation set of the GUI element, wherein the representation set comprises a plurality of alternative representations, each of which provides a manner of identifying the GUI element in GUIs; applying the representation set to identify the GUI element in a GUI of a program, wherein said applying the representation set comprises, for each representation of the alternative representations, independently applying the each representation to identify one or more GUI elements corresponding the each representation; and in response to determining that said applying the representation set provides an indefinite result, obtaining a modified representation set.

Abstract: A computer implemented method of adapting an application according to user interaction comprising using one or more processors for executing a code for collecting autonomously a plurality of action events describing a plurality of actions taken by a plurality of users to navigate through a plurality of pages presented by an application to accomplish one or more goals of the application, the plurality of pages are presented on a GUI at a plurality of user devices used by the plurality of users, analyzing the action events to identify one or more behavioral patterns of at least some of the users for accomplishing the goal(s) and generating automatically one or more recommended adaptations for the application according to the behavioral pattern(s) to adapt a layout of the application in order to increase a probability for one or more users to successfully accomplish the goal(s).

Abstract: A method of creating a dynamically adaptable tutorial, comprising: selecting at least one web document having a plurality of separate objects; providing by a user a plurality of descriptive elements; separately associating between each of said plurality of descriptive elements and each of said plurality of separate objects according to a user input; associating a plurality of calling scripts with said plurality of separate objects; making said at least web document available so that a loading thereof by a browser includes triggering said plurality of calling scripts for a retrieval of each of said plurality of descriptive elements; wherein said web document enables a browsing user who uses said browser to initiate a tutorial session during which at least a group of said plurality of descriptive elements are sequentially presented in accordance with a current layout of a respective group from said plurality of separate objects.