Abstract: A computing system may provide an interface for creating a data processing pipeline through which the computing system may receive configuration information for a given pipeline that is configured to receive streaming messages from a given data source, process each of the streaming messages, and then output a processed version of at least a subset of the streaming messages to a given data sink. The given pipeline may comprise a chain of two or more operators, which may take the form of enrichers, routers, and/or transformers. The computing system may then use the received configuration information to create the given pipeline. In turn, the computing system may deploy the given pipeline for use in processing streaming messages received from the given data source.

Abstract: A computing system may receive, from a data source, a stream of messages. In turn, the computing system may input each of at least a plurality of the messages in the stream into an enrichment pipeline comprising at least a first enricher and a second enricher. Each enricher may be configured to receive a message, produce a respective enrichment for the message, append the enrichment to the message, and output an updated version of the message containing at least the respective enrichment. The computing system may then produce an enriched stream of messages in which each of at least a plurality of the messages in the enriched stream includes the respective enrichment and output the enriched stream of messages to a data sink.

Abstract: A computing system may provide an interface for creating a data processing pipeline through which the computing system may receive configuration information for a given pipeline that is configured to receive streaming messages from a given data source, process each of the streaming messages, and then output a processed version of at least a subset of the streaming messages to a given data sink. The given pipeline may comprise a chain of two or more operators, which may take the form of enrichers, routers, and/or transformers. The computing system may then use the received configuration information to create the given pipeline. In turn, the computing system may deploy the given pipeline for use in processing streaming messages received from the given data source.