Abstract: A method and system for archiving data is provided. The method includes an extraction stage, a load stage, and a production merge stage. In the extraction stage, incoming files from a source system are extracted, where each incoming file has data records. Upon determining that the incoming files are of different data record types, the incoming files are split by record type. The files are also parsed. In a load stage, all files from a load ready directory are placed together in a single batch with a common RUNID for each data record type. In a production merge stage, all files made available from the load stage are processed. The processed files are loaded into a data warehouse. Each stage operates independently of any other stage. Each stage is also iterative and circular.

Abstract: A method and system for archiving data is provided. The method includes an extraction stage, a load stage, and a production merge stage. In the extraction stage, incoming files from a source system are extracted, where each incoming file has data records. Upon determining that the incoming files are of different data record types, the incoming files are split by record type. The files are also parsed. In a load stage, all files from a load ready directory are placed together in a single batch with a common RUNID for each data record type. In a production merge stage, all files made available from the load stage are processed. The processed files are loaded into a data warehouse. Each stage operates independently of any other stage. Each stage is also iterative and circular.