Abstract: The invention relates to a method for determining a time for retraining a data mining model, including the steps of: calculating multivariate statistics of a training model during a training phase; storing the multivariate statistics in the data mining model; evaluating reliability of the data mining model based on the multivariate statistics and at least one distribution parameter, and deciding to retrain the data mining model based on an arbitrary measure of one or more statistical parameters including an F-test statistical analysis.

Abstract: Provided are a method, system, and article of manufacture for using a data mining algorithm to discover data rules. A data set including multiple records is processed to generate data rules for the data set. Each record has a record format including a plurality of fields and each rule provides a predicted condition for one field based on at least one predictor condition in at least one other field. The generated data rules are provided to a user interface to enable a user to edit the generated data rules. The data rules are stored in a rule repository to be available to use to validate data sets having the record format.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for providing a visual editor allowing graphical editing of expressions in an expression language. A graphical user interface is displayed. A first user input of an expression is received. The expression is defined in a logical or textual form, and each component of the expression is represented by a graphical element on the graphical user interface. A syntax of the first user input is verified and an alert is provided to the user in response to detecting a syntax error or an inconsistency of the first user input when verifying the syntax.

Abstract: Provided are a method, system, and article of manufacture for discovering transformations applied to a source table to generate a target table. Selection is made of a source table comprising a plurality of rows and a target table resulting from a transformation applied to the rows of the source table. A first pre-processing method is applied with respect to columns in the source and target tables to produce first category pre-processing output. The first category pre-processing output is used to determine first category transformation rules with respect to at least one source table column and at least one target table column. For each unpredicted target column in the target table not predicted by the determined first category transformation rules, a second pre-processing method is applied to columns in the source table and unpredicted target columns to produce second category pre-processing output.

Abstract: A method comprises providing a one way communication path that initiates a request by a client for retrieving information from a Servlet, and sending a response by the Servlet containing at least one return code specifying success or failure of the request, and including the result of the request if available. If the Servlet identifies missing information not included in the initial request, the method includes providing a complete response to automatically open an other communication path from the Servlet via the client's web-browser to the Servlet and providing the missing information to a Servlet by making use of the response functionality of the initial request. The other communication path is supported by a further Servlet functionality component.

Abstract: The present invention provides a method and system for improving the client-Servlet communication in the World-Wide-Web (Web) without changing the existing communication protocol, and without changing the client. The existing prior art one-way communication path between client and Servlet remains unchanged if the initial request includes all information for retrieving the desired information.

Abstract: Provided are a method, system, and article of manufacture for managing validation models and rules to apply to data sets. A schema definition describing a structure of at least one column in a first data set having a plurality of columns and records providing data for each of the columns is received. At least one model is generated, wherein each model asserts conditions for at least one column in a record of the first data set. The schema definition and the at least one model are stored in a data quality model. Selection is received of a second data set and the data quality model. A determination is made as to whether a structure of the second data set is compatible with the schema definition in the selected data quality model. Each model in the data quality model is applied to the records in the second data set to validate the records in the second data set in response to determining that the structure of the second data set and the schema definition are compatible.

Abstract: A computer implemented method, apparatus and computer program product for adjusting a graph. A modification to a first object in the graph is determined in which the first object has a position relative to a second object in the graph. The second object in the graph is repositioned, without user intervention, to accommodate the modification to the first object. The repositioning includes preserving the relative position of the first object to the second object.

Abstract: Provided are a method, system, and article of manufacture for using a data mining algorithm to generate format rules used to validate data sets. A data set has a plurality of columns and records providing data for each of the columns. Selection is received of at least one format column for which format rules are to be generated and selection is received of at least one predictor column. A format mask column is generated for each selected format column. For records in the data set, a value in the at least one format column is converted to a format mask representing a format of the value in the format column and storing the format mask in the format mask column in the record for which the format mask was generated. The at least one predictor column and the at least one format mask column are processed to generate at least one format rule. Each format rule specifies a format mask associated with at least one condition in the at least one predictor column.

Abstract: Provided are an article of manufacture, system, and method for using a data mining algorithm to generate rules used to validate a selected region of a predicted column. A data set has a plurality of columns and records providing data for each of the columns. Selection is received of at least one predicted column for which rules are to be generated and at least one region of the selected at least one predicted column, wherein each region specifies data positions in the column. The data set is processed to determine association relationships among data in at least one predictor column and subsequences in the selected at least one region of the at least one predicted column. At least one rule is generated from the relationships specifying a condition involving at least one predictor column that predicts at least one value in the selected region of the at least one predicted column.

Abstract: The invention relates to a method for mapping at least one data column from a database source to at least one data column of a data target, the method comprising: defining at least one reference column of the data target and at least one database source column; performing a comparison of data contained in the data column(s) with the reference column(s); and determining mapping candidates between the data column(s) and the reference column(s).

Abstract: The invention relates to a method for determining a time for retraining a data mining model, comprising the steps of: calculating multivariate statistics of a training model during a training phase; storing the multivariate statistics in the data mining model; monitoring at least one distribution parameter of application data as a function of time during a deployment phase; and evaluating reliability of the data mining model based on the multivariate statistics and at least one distribution parameter.

Abstract: Provided are a method, system, and article of manufacture for using a data mining algorithm to discover data rules. A data set including multiple records is processed to generate data rules for the data set. Each record has a record format including a plurality of fields and each rule provides a predicted condition for one field based on at least one predictor condition in at least one other field. The generated data rules are provided to a user interface to enable a user to edit the generated data rules. The data rules are stored in a rule repository to be available to use to validate data sets having the record format.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for integrating and data activities in a process flow. A data transformation activity is invoked through local or remote invocation. The data transformation activity is part of a process flow defined in a standard business process execution language format and is invoked from within the process flow. A system for executing a process flow including one or more control activities and one or more data transformation activities is also described. The system includes a process control engine for executing activities included in the process flow, a data transformation subsystem for storing domain specific definitions of data transformation processes of data in one or more databases, and a control data repository for storing domain specific activity information related to the process flow.

Abstract: A computer implemented method, apparatus and computer program product for adjusting a graph. A modification to a first object in the graph is determined in which the first object has a position relative to a second object in the graph. The second object in the graph is repositioned, without user intervention, to accommodate the modification to the first object. The repositioning includes preserving the relative position of the first object to the second object.

Abstract: A method and system of the present invention determines the performance values of components of a flow by taking the interactions between the components into account, and visualizes the performance values on a graphical user interface during a flow design phase. Thus, interactions between the components of the flow become transparent to the user and bottlenecks can be identified immediately.

Abstract: The present invention relates to a method and system for client-side interacting with a server-side web application in a web-based client-server environment, in which a client-side web browser is used as a user interface for displaying web pages sent by the web application within a browser application frame and for converting events triggered by one or more user actions within said application frame into a request directed to said server-side web application, wherein an executable program object for example a Java Script is used at the client side as a part of the client-side web application user interface. In order to improve the user interface it is proposed to use an additional frame in the browser which communicates with the server and which prevents the displayed document from being reloaded when the server sends its response. Instead, only delta information (50) is displayed within the frame.