Abstract: In some implementations, a system may receive information identifying a dataset. The system may process an identification attribute using a function that generates a first value, to generate a first identifier for the dataset. The system may search a data store storing a plurality of groupings to identify a grouping with the first identifier for the dataset. The system may extract a second identifier from the grouping with the first identifier for the dataset. The system may search a data lineage based graph representation of a plurality of datasets to identify a graph node representing the dataset. The system may update the data lineage based graph representation of the plurality of datasets to link the dataset with the at least one other dataset based on searching the data lineage based graph representation of the plurality of datasets to identify the graph node.

Abstract: Disclosed herein are system, method, and computer program product embodiments for performing in-flight transformations of data streams. Complex event processing (CEP) operating on event records from various data streams can operate by storing the streamed event record data in a database, and then querying the data to perform a data transformation. However, in order to improve the performance of the data transformations and streamline CEP, a serverless architecture is introduced that can perform data transformations directly on streams, using attributes of the streamed record data defined in a schema. The resulting transformed data can then be provided by the serverless architecture to the CEP for direct access of the data most needed by the CEP.

Abstract: Systems and methods are disclosed herein for providing contextually relevant incentives in real-time to consumers. In one example, the method may include receiving, from a data repository, one or more raw data streams of real time data and determining an identity of the end user based on the one or more raw data streams. The method may further include filtering, using contextual filtering parameters, the received one or more raw data streams to produce filtered data. The method may also include applying a set of rules correlating the filtered data with incentive programs relevant to the filtered data to generate correlated data, and querying the data repository for historical data associated with the end user. The method may also include calculating a propensity score of the end user, and ranking the correlated data. The method may also include sending one or more incentives based on the correlated data ranking.

Abstract: Disclosed herein are system, method, and computer program product embodiments for performing in-flight transformations of data streams. Complex event processing (CEP) operating on event records from various data streams can operate by storing the streamed event record data in a database, and then querying the data to perform a data transformation. However, in order to improve the performance of the data transformations and streamline CEP, a serverless architecture is introduced that can perform data transformations directly on streams, using attributes of the streamed record data defined in a schema. The resulting transformed data can then be provided by the serverless architecture to the CEP for direct access of the data most needed by the CEP.