Abstract: A method implemented by a data processing system including: executing a dataflow graph that includes the plurality of components and the links, with a given component of the plurality including an input port, an audit port and an output port; processing, by the dataflow graph with the components and the links, the one or more data records representing the transaction, wherein the at least one of the components saves a state specifying one or more input records that are processed by the at least one of the components; when an error occurs during processing of one or more input records by the given component, restoring a state of the at least one of the components to the saved state; and based on the restored state, recovering at least some of the audit data for the given component of the dataflow graph.

Abstract: A method implemented by a data processing system including: executing a dataflow graph that includes the plurality of components and the links, with a given component of the plurality including an input port, an audit port and an output port; processing, by the dataflow graph with the components and the links, the one or more data records representing the transaction, wherein the at least one of the components saves a state specifying one or more input records that are processed by the at least one of the components; when an error occurs during processing of one or more input records by the given component, restoring a state of the at least one of the components to the saved state; and based on the restored state, recovering at least some of the audit data for the given component of the dataflow graph.

Abstract: A method performed by a data processing system for processing data, the method including: intermittently receiving data from one or more data streams, the received data including data records; detecting two or more particular data records in the received data records, where the detected two or more particular data records each include a particular identifier; for that particular identifier, creating a collection of data records; for at least one particular data record included in the collection of data records, searching data records for a historical aggregation of data; and computing combined data; modifying a data record by inserting the combined data into a field of the data record and by inserting data from at least one of the data records in the collection into another field of the data record; based on applying the rules, writing to memory one or more instructions for initiation of one or more actions.