Abstract: The invention provides for checking data quality of data of an application program by a data quality management system. At least one of a plurality of jobs are executed for evaluating the data for compliance with one or more quality criteria. The runtime behavior of the at least one executed job is monitored to determine a current runtime behavior of the executed job. The monitored job is reclassified by reallocating the job to a job set representing the determined current runtime behavior.

Abstract: The invention provides for checking data quality of data of an application program by a data quality management system. At least one of a plurality of jobs are executed for evaluating the data for compliance with one or more quality criteria. The runtime behavior of the at least one executed job is monitored to determine a current runtime behavior of the executed job. The monitored job is reclassified by reallocating the job to a job set representing the determined current runtime behavior.

Abstract: Automatic workflow processing in a workflow processing computer system. A data management system support module receives a data management activity (DMA) description. A set of set references associated with the DMA is determined. Using the set of set references, a set of data sources associated with the set references is determined. The data sources is provided within a data management system. Using the set references and the data sources, it is determined whether the data management system includes infrastructure for accessing the set references and for accessing the data sources. If not, the infrastructure is automatically created from information in a metadata repository coupled to the data management system. References to set references and references to data sources in the data management activity description are replaced by references to the infrastructure. The data management activity description is delivered for execution by the data management system.

Abstract: Embodiments of the present invention provide, systems, methods, and computer program products for processing data in an extract, transform, and load system. Embodiments of the present invention provide protective enhancements to be applied to data during extract-transform-load operations, including protections that can prevent unauthorized access and/or modifications to data stored on an intermediate computer system. Embodiments of the present invention can afford users with the ability to modify the protective enhancements and provide users with transformation operations compatible with the protective enhancements during extract-transform-load operations.

Abstract: Embodiments of the present invention provide, systems, methods, and computer program products for processing data in an extract, transform, and load system. Embodiments of the present invention provide protective enhancements to be applied to data during extract-transform-load operations, including protections that can prevent unauthorized access and/or modifications to data stored on an intermediate computer system. Embodiments of the present invention can afford users with the ability to modify the protective enhancements and provide users with transformation operations compatible with the protective enhancements during extract-transform-load operations.

Abstract: A method includes receiving a request from a source service, determining whether the target service associated with the request supports a by-reference evaluation strategy, determining whether an information object associated with the request is a data reference, retrieving data associated with the reference from a database, adding the data to the information object, and invoking the target service and passing the information object to the target service responsive to determining that the target service does not support the by-reference strategy and the information object is a data reference.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for automatic workflow processing in a workflow processing computer system.

Abstract: Embodiments related to processing of restricted-access data. An aspect includes receiving a request for data from a user by a storage system infrastructure comprising a centralized database that stores non-restricted access data and a local system that stores restricted-access data associated with a first set of areas or entities and comprising a federated database for providing a federated view, wherein the requested data comprises restricted-access first data and non-restricted access second data. Another aspect includes based on an association of the user, routing, by a routing entity, the request to the local system. Another aspect includes receiving the request at the at least one federated database of the local system. Another aspect includes retrieving from the federated database the restricted-access first data and the non-restricted access second data.

Abstract: Processing data errors in a data processing system, includes a computer receiving one or more patterns and a data set. The one or more patterns describe characteristics of an erroneous data record and are associated with a root cause. The root cause includes a description of a technical deficiency causing the data error in the erroneous data record. Responsive to the computer determining that a first set of data records in the received data set have characteristics that match a first pattern of the one or more patterns, the computer assigns the first set of data records of the received data set having characteristics that match the first pattern to a first error group.

Abstract: Methods, systems, and computer program products for deriving a multi-pass matching algorithm for data de-duplication are provided herein. A method includes identifying multiple passes across multiple databases using a set of one or more blocking columns derived from a set of trained input data; identifying, in each of the multiple passes, one or more columns across the multiple databases that match one or more of the blocking columns; selecting a given pass from the multiple passes, wherein said given pass comprises a maximum number of matching columns within the multiple passes; determining, for the given pass, data that conform to the given pass comprising (i) a set of matching columns, (ii) one or more matching types and (iii) one or more weights; and determining one or more subsequent passes across the multiple databases iteratively by removing the data that conform to the given pass.

Abstract: A computer-implemented method, computer program product, and computer system for intelligently provisioning cloud information services. The computer system determines a target computing zone based on location constraints defined in service processing rules, in response to receiving service request. The computer system determines whether a merger or a split is needed, based on a score for the resources, scores for the respective processing nodes, and operational metadata. The computer system determines whether request processing constraints defined in the service processing rules allow the merger or the split. The computer system processes, in the target computing zone, the service request with the merger or the split, in response to determining that the merger or the split is needed and in response to determining that the request processing rules allow the merger or the split.

Abstract: The present invention relates to a method for processing data quality exceptions in a data processing system, the data processing system having access to one or more data sources and having access to multiple technical support systems, the multiple technical support systems having one or more predefined technical tasks. The method comprises providing a predefined grouping rule for assigning data quality exceptions to exception groups, and associating each exception group using at least one technical task; receiving a first description of at least a first data quality exception in a data set of the first data source; using the grouping rule for assigning the first data quality exception to at least a first exception group using the first description, and for associating the first exception group with a first technical support system; routing by the exception engine at least part of the first description to the first technical support system.

Abstract: Embodiments relate to operating a data processing system. An aspect includes receiving a request for data storage by an application server, said request comprising restricted-access data. Another aspect includes processing the request in the first application server thereby extracting said restricted-access data from the request. Another aspect includes encrypting said restricted-access data with a cryptographic key associated with said privacy regime to a cipher representation. Another aspect includes defining a masking rule relative to the field designated for storage of the cipher representation, the masking rule defining a set of privacy regimes applicable to processing of the restricted-access data. Another aspect includes forwarding the cipher representation and the masking rule to the shared database by a database client.

Abstract: A computer-implemented method, computer program product, and computer system for intelligently provisioning cloud information services. The computer system determines a target computing zone based on location constraints defined in service processing rules, in response to receiving service request. The computer system determines whether a merger or a split is needed, based on a score for the resources, scores for the respective processing nodes, and operational metadata. The computer system determines whether request processing constraints defined in the service processing rules allow the merger or the split. The computer system processes, in the target computing zone, the service request with the merger or the split, in response to determining that the merger or the split is needed and in response to determining that the request processing rules allow the merger or the split.

Abstract: Data to be loaded into a target system includes entities having corresponding unique primary data value and secondary data values. The secondary data values have associated foreign key relationships, which links the secondary data value to the primary data value of another entity. In loading the data, the entities are split into insertion leaf groups by execution of an iteration process, each iteration involving generation of a respective set of insertion leaf groups containing entities whose secondary data values have no foreign key relationships or only foreign key relationships with the primary data values of entities of the insertion leaf groups generated during any prior iteration. The iteration process is executed until there are no such entities are left. A sequence of generation of the sets of insertion leaf groups is recorded, and the sets of insertion leaf groups are consecutively loaded into the target system according to the sequence.

Abstract: A computer-implemented method, computer program product, and computer system for intelligently provisioning cloud information services. The computer system determines a target computing zone based on location constraints defined in service processing rules, in response to receiving service request. The computer system determines whether a merger or a split is needed, based on a score for the resources, scores for the respective processing nodes, and operational metadata. The computer system determines whether request processing constraints defined in the service processing rules allow the merger or the split. The computer system processes, in the target computing zone, the service request with the merger or the split, in response to determining that the merger or the split is needed and in response to determining that the request processing rules allow the merger or the split.

Abstract: The invention provides for checking data quality of data of an application program by a data quality management system. At least one of a plurality of jobs are executed for evaluating the data for compliance with one or more quality criteria. The runtime behavior of the at least one executed job is monitored to determine a current runtime behavior of the executed job. The monitored job is reclassified by reallocating the job to a job set representing the determined current runtime behavior.

Abstract: During migration of data from at least one data source to a target system, data quality is determined by obtaining metadata associated with the target system, automatically generating instantiated rules for assessing a quality of data to be loaded from the at least one data source into the target system, where the instantiated rules are dependent upon the obtained metadata associated with the target system, and applying a quality analysis based upon the instantiated rules to the data to be loaded into the target system. The quality analysis provides an indication of a level of compliance of the data with requirements of the target system.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for automatic workflow processing in a workflow processing computer system.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for automatic workflow processing in a workflow processing computer system.