Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

Abstract: Under the present invention, an illustrative feature is to provide a method and system/structure for remotely controlling multiple computer systems by interacting with GUIs. Specifically, the present invention allows a controlled computer/system to be remotely controlled via a controlling computer/system. To this extent, data/action capture instrumentation is provided on the controlling system for automatically creating a representation of content of the GUI of the controlling system, for automatically observing a set of actions performed by a user on the GUI of the controlling system, for automatically creating a representation of the observed actions, and for sending to the controlled system the representation of the observed actions. In addition, execution instrumentation is provided on the controlled system for receiving the representation and replicating the actions on the controlled system by interacting with a GUI of the controlled system.

Abstract: Systems and methods for dynamically generating computer executable technical support procedures, as well as updating/augmenting such executable procedures, by tracking and processing sequences of actions (execution traces) that are taken by experts (or users) when performing a procedure or when executing an executable procedure.

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: A method for incrementally generating a computer-executable model of a procedure from observations of user actions is described. The method includes maintaining a collection of computer-executable procedure models consistent with observed actions of a user, and augmenting the collection when a user action is observed, wherein the user actions are performed while executing a procedure.

Abstract: A system and method for obtaining a process definition; determining the current process; determining the current process step; determining whether a whether a user has requested creation or modification of an annotation of the current process or step; receiving information from the user for creating the annotation when a user has requested creation of an annotation; and displaying the annotation.

Abstract: A method and apparatus improve the synchronization and presentation of an exchange of messages between two or more users during an on-line Internet messaging session. This method and apparatus discriminate which messages from a sender correspond to replies from a recipient and presents these messages in an orderly, time-sequenced fashion using color schemes or separate presentation windows which improves the overall readability and efficiency of the communication. Additionally, the method and apparatus provide a level of identity security. As a user enters messages, the typing style, speech patterns, or biometrics of all the users are monitored and will issue warnings whenever a change is detected, possibly indicating someone other then the original user is now sending messages. Alternatively, or in addition, a user may be asked a series of random questions and another user will evaluate answers provided to those questions to determine whether a user's identity is false.

Abstract: A system for and method of executing mixed-initiative procedures to allow at least one of a user and a computer system to take initiative of the procedure from the other at any point of the procedure, in which the mixed-initiative procedure can include a computer-based procedure in which the user and the computer system cooperate during the execution to allow each other to take the initiative at any point of the procedure.

Abstract: A system for and method of constructing an executable reusable procedure which includes determining an executable procedure from at least one scored trace of a procedure execution.

Abstract: Dynamic modification of user interfaces is disclosed, based upon identification of the current state of the user and the sensing of a particular situation in which the user is involved and/or environment in which the user is situated. In particular, emotional and mental states of a user are identified and these states are taken into consideration when creating and/or adapting an interface to be used by the user. The interface is modified/created automatically based on identified user biometrics, that is, measured physical properties of the user.

Abstract: There is provided an apparatus for aligning document actions specified in a documented procedure with demonstrated user actions. The apparatus includes an alignment device for computing an alignment between the document actions and the demonstrated user actions based on at least one similarity metric.

Abstract: A method for inducing a Hidden Markov Model (HMM) is provided. The method using a plurality of training observations and a distance function includes assigning at least one representative observation to each of a plurality of hidden states of the HMM; computing a distance between said at least one assigned representative observation and one of said training observation using the distance function, wherein said distance is computed for each assigned representative observation; and computing at least one of an E-Step and an M-Step of a Baum-Welch algorithm by incorporating said computed distance.

Abstract: (1) An approximate center-based clustering that utilizes sampling to cluster a set of n points to identify k>0 centers with quality assurance, but without the drawbacks of sample size and running time dependence on n. (2) An approximate conceptual clustering algorithm that utilizes sampling to identify k disjoint conjunctions with novel quality assurance, also without the drawbacks of sample size and running time dependence on n.

Abstract: The present invention provides a a method and system for generating one or more computer-executable procedures. It can simultaneously learn from a collection of procedure instances recorded by different users on a variety of computers. In particular, the present invention aligns multiple traces and uses the aligned traces to generalize.

Abstract: Techniques for altering application user-interface controls are provided. More particularly the customization of a new or existing user-interface control in an application user-interface is provided. In one aspect of the invention, a method for customizing user-interface controls of an existing application comprises the recording of a procedure description performed by a user in the application user-interface. A new or modified application user-interface control relating to the procedure description is then installed in the existing application.

Abstract: A system and method for clustering user contexts in a customer self service system that performs resource search and selection. The customer self service system includes a context attribute database comprising types of user contexts and one or more context attributes associated with each user context for processing by the system, and context attribute function database comprising functions for computing values for each context attribute. The context clustering system receives user interaction data from among a database of user interaction records and a distance metric for associating closeness of the user interaction data and clusters the user interaction data according to the distance metric to determine new user contexts and associated attributes for use in subsequent resource searches initiated by users in the system. Improved user query definition and resource lookup results from the new determined user context attributes.

Abstract: A system and method for classifying user context in a customer self service system that performs resource search and selection and includes a context attribute database comprising types of user contexts and one or more context attributes associated with each user context for processing by the system, and context attribute function database comprising functions for computing values for each context attribute. The classifying system comprises a computing device for receiving a user query and a context vector comprising data associating an interaction state with the user and, processing the query and context vector against data included in the context attribute database and context attribute function database for predicting a particular user context. The classifier populates the user context vector with context parameters specifying a user interaction state for use in a subsequent resource search.

Abstract: Systems and methods for dynamically generating computer executable technical support procedures, as well as updating/augmenting such executable procedures, by tracking and processing sequences of actions (execution traces) that are taken by experts (or users) when performing a procedure or when executing an executable procedure.