Abstract: Dynamic modification of user interfaces is disclosed, based upon identification of the current state of the user and the sensing of a particular situation in which the user is involved and/or environment in which the user is situated. In particular, emotional and mental states of a user are identified and these states are taken into consideration when creating and/or adapting an interface to be used by the user. The interface is modified/created automatically based on identified user biometrics, that is, measured physical properties of the user.

Abstract: Under the present invention, an illustrative feature is to provide a method and system/structure for remotely controlling multiple computer systems by interacting with GUIs. Specifically, the present invention allows a controlled computer/system to be remotely controlled via a controlling computer/system. To this extent, data/action capture instrumentation is provided on the controlling system for automatically creating a representation of content of the GUI of the controlling system, for automatically observing a set of actions performed by a user on the GUI of the controlling system, for automatically creating a representation of the observed actions, and for sending to the controlled system the representation of the observed actions. In addition, execution instrumentation is provided on the controlled system for receiving the representation and replicating the actions on the controlled system by interacting with a GUI of the controlled system.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: A system and method for obtaining a process definition; determining the current process; determining the current process step; determining whether a whether a user has requested creation or modification of an annotation of the current process or step; receiving information from the user for creating the annotation when a user has requested creation of an annotation; and displaying the annotation.

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: A system for and method of constructing an executable reusable procedure which includes determining an executable procedure from at least one scored trace of a procedure execution.

Abstract: A method and system for generating one or more Computer-executable procedures simultaneously learns from a collection of procedure instances recorded by different users on a variety of computers aligning multiple traces and using the aligned traces to generalize.

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: Under the present invention, an illustrative feature is to provide a method and system/structure for remotely controlling multiple computer systems by interacting with GUIs. Specifically, the present invention allows a controlled computer/system to be remotely controlled via a controlling computer/system. To this extent, data/action capture instrumentation is provided on the controlling system for automatically creating a representation of content of the GUI of the controlling system, for automatically observing a set of actions performed by a user on the GUI of the controlling system, for automatically creating a representation of the observed actions, and for sending to the controlled system the representation of the observed actions. In addition, execution instrumentation is provided on the controlled system for receiving the representation and replicating the actions on the controlled system by interacting with a GUI of the controlled system.

Abstract: As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

Abstract: A method and apparatus improve the synchronization and presentation of an exchange of messages between two or more users during an on-line Internet messaging session. This method and apparatus discriminate which messages from a sender correspond to replies from a recipient and presents these messages in an orderly, time-sequenced fashion using color schemes or separate presentation windows which improves the overall readability and efficiency of the communication. Additionally, the method and apparatus provide a level of identity security. As a user enters messages, the typing style, speech patterns, or biometrics of all the users are monitored and will issue warnings whenever a change is detected, possibly indicating someone other then the original user is now sending messages. Alternatively, or in addition, a user may be asked a series of random questions and another user will evaluate answers provided to those questions to determine whether a user's identity is false.

Abstract: A system and method for clustering user contexts in a customer self service system that performs resource search and selection. The customer self service system includes a context attribute database comprising types of user contexts and one or more context attributes associated with each user context for processing by the system, and context attribute function database comprising functions for computing values for each context attribute. The context clustering system receives user interaction data from among a database of user interaction records and a distance metric for associating closeness of the user interaction data and clusters the user interaction data according to the distance metric to determine new user contexts and associated attributes for use in subsequent resource searches initiated by users in the system. Improved user query definition and resource lookup results from the new determined user context attributes.

Abstract: A system and method for classifying user context in a customer self service system that performs resource search and selection and includes a context attribute database comprising types of user contexts and one or more context attributes associated with each user context for processing by the system, and context attribute function database comprising functions for computing values for each context attribute. The classifying system comprises a computing device for receiving a user query and a context vector comprising data associating an interaction state with the user and, processing the query and context vector against data included in the context attribute database and context attribute function database for predicting a particular user context. The classifier populates the user context vector with context parameters specifying a user interaction state for use in a subsequent resource search.