Abstract: In accordance with an embodiment, described herein are systems and methods for determining or allocating an amount, quantity, or number of compute instances or virtual machines for use with extract, transform, load (ETL) processes. In an example embodiment, a particular (e.g., optimal) number of virtual machines (VM's) can be determined by predicting ETL completion times for customers, using historical data. ETL processes can be simulated with an initial/particular number of virtual machines. If the predicted duration is greater than the desired duration, the number of virtual machines can be incremented, and the simulation repeated. Actual completion times from ETL processes can be fed back, to update a determined number of compute instances or virtual machines. In accordance with an embodiment, the system can be used, for example, to generate alerts associated with customer service level agreements (SLA's).

Abstract: Systems and methods for automatic error rejection are provided. Systems and methods described herein bypass the creation of a staging table at the outset and, instead, attempt a direct merge from a source data location to a target data location. In the event that the merge fails, then a temporary/staging table can be loaded where errors can be logged, validations can be performed, and erroneous data can be corrected.

Abstract: In accordance with an embodiment, described herein are systems and methods for determining or allocating an amount, quantity, or number of compute instances or virtual machines for use with extract, transform, load (ETL) processes. In an example embodiment, a particular (e.g., optimal) number of virtual machines (VM's) can be determined by predicting ETL completion times for customers, using historical data. ETL processes can be simulated with an initial/particular number of virtual machines. If the predicted duration is greater than the desired duration, the number of virtual machines can be incremented, and the simulation repeated. Actual completion times from ETL processes can be fed back, to update a determined number of compute instances or virtual machines. In accordance with an embodiment, the system can be used, for example, to generate alerts associated with customer service level agreements (SLA's).

Abstract: Systems and methods for automatic error rejection are provided. Systems and methods described herein bypass the creation of a staging table at the outset and, instead, attempt a direct merge from a source data location to a target data location. In the event that the merge fails, then a temporary/staging table can be loaded where errors can be logged, validations can be performed, and erroneous data can be corrected.

Abstract: In accordance with an embodiment, described herein are systems and methods for determining or allocating an amount, quantity, or number of compute instances or virtual machines for use with extract, transform, load (ETL) processes. In an example embodiment, a particular (e.g., optimal) number of virtual machines (VM's) can be determined by predicting ETL completion times for customers, using historical data. ETL processes can be simulated with an initial/particular number of virtual machines. If the predicted duration is greater than the desired duration, the number of virtual machines can be incremented, and the simulation repeated. Actual completion times from ETL processes can be fed back, to update a determined number of compute instances or virtual machines. In accordance with an embodiment, the system can be used, for example, to generate alerts associated with customer service level agreements (SLA's).