Abstract: System and method for executing one or more tasks in data processing is disclosed. Data is received from at least one channel from multiple channels. The data is received in order to generate a corresponding result. A set of tasks is generated. The set of tasks is generated to process the data so received. The tasks receive the data as an input argument for generating the corresponding result. A worker node from a plurality of worker node is selected for executing the set of task in a pipeline. An idle worker node from the plurality of worker node is selected for executing the set of tasks. The set of task is executed by the selected worker nodes in order to generate the corresponding result. The results are stored for a predefined time in the system.