Abstract: A method for managing a serverless function (SF) pipeline includes: reading, by a first function, a dataset from a data input; writing, by the first function, a result to a segment of a data stream; reading, by a second function, the result; writing, by the second function, the result to a transaction; starting, by the second function and after a checkpoint is generated, to process the transaction; making, by an orchestrator and a determination, that the second function is failed; re-initiating, by the orchestrator and based on the determination, the second function, in which, upon re-initiated, the second function resumes processing the transaction from the checkpoint; generating, by the second function and upon completion of the processing of the transaction, a data output; and storing, by the second SF, the data output to a tier-2 storage.