Abstract: Systems, methods, and other embodiments associated with a unit of work for incremental data processing are described. In one embodiment, a method includes selecting a unit of work key for a program that processes records in a source table. The unit of work key is selected such that modifications to a record having a certain unit of work key value will not affect the program's processing of records having a different unit of work key value. The selected unit of work key is associated with the program. When a record in the source table is created, modified, or deleted, a unit of work key value is identified for the record and a selected set of records having the identified unit of work key value is provided to the program. Thus, records in the data source that do not have the identified unit of work key values are not provided to the program.

Abstract: A data lineage system is provided that traces a data lineage of a data warehouse. The data lineage system maps a target data element to one or more source data elements. The data lineage system further stores one or more source surrogate keys within one or more auxiliary columns of a target data record. The data lineage system further stores, for each source data element, a data lineage mapping system record within a data lineage mapping system table that represents the mapping of the target data element and the corresponding source data element. The data lineage system further maps a source data element to one or more target data elements. The system further stores, for each target data element, a shadow system record within a shadow system table that represents the mapping of the source data element and the corresponding target data element.

Abstract: An associated information system is provided that propagates visibility of associated information. The associated information system traces a data lineage of a data warehouse. The associated information system further identifies an association between a primary data element and an associated object, where the association between the primary data element and the associated object is identified as a primary link. The associated information system further stores a first associated object mapping system record within an associated object mapping system table that represents the primary link. The associated information system further identifies an association between a secondary data element and the associated object using the data lineage, where the association between the secondary data element and the associated object is identified as a secondary link, and where the secondary data element is related to the primary data element within the data lineage.

Abstract: Systems, methods, and other embodiments associated with a unit of work for incremental data processing are described. In one embodiment, a method includes selecting a unit of work key for a program that processes records in a source table. The unit of work key is selected such that modifications to a record having a certain unit of work key value will not affect the program's processing of records having a different unit of work key value. The selected unit of work key is associated with the program. When a record in the source table is created, modified, or deleted, a unit of work key value is identified for the record and a selected set of records having the identified unit of work key value is provided to the program. Thus, records in the data source that do not have the identified unit of work key values are not provided to the program.

Abstract: An associated information system is provided that propagates visibility of associated information. The associated information system traces a data lineage of a data warehouse. The associated information system further identifies an association between a primary data element and an associated object, where the association between the primary data element and the associated object is identified as a primary link. The associated information system further stores a first associated object mapping system record within an associated object mapping system table that represents the primary link. The associated information system further identifies an association between a secondary data element and the associated object using the data lineage, where the association between the secondary data element and the associated object is identified as a secondary link, and where the secondary data element is related to the primary data element within the data lineage.

Abstract: A data lineage system is provided that traces a data lineage of a data warehouse. The data lineage system maps a target data element to one or more source data elements. The data lineage system further stores one or more source surrogate keys within one or more auxiliary columns of a target data record. The data lineage system further stores, for each source data element, a data lineage mapping system record within a data lineage mapping system table that represents the mapping of the target data element and the corresponding source data element. The data lineage system further maps a source data element to one or more target data elements. The system further stores, for each target data element, a shadow system record within a shadow system table that represents the mapping of the source data element and the corresponding target data element.