Abstract: The present disclosure presents systems and related methods for optimizing extraction, transformation, and loading (ETL) operations. One such method comprises receiving an extraction, transformation, and loading (ETL) job that is in current deployment on an ETL job database; obtaining ETL job metadata for the extracted ETL job; obtaining database schema for input data sources in the ETL job; using the database schema, parsing the ETL job to identify structural components of the ETL job; providing, in a graphical user interface display, one or more recommendations to perform one or more optimization actions for at least one structural component of the ETL job; and/or performing the one or more optimization actions for the at least one structural component of the ETL job.

Abstract: Disclosed herein are system, method, and computer program product embodiments for converting queries and scripts used in big data systems. A script conversion system converts a script and its queries from a first big data format to a second big data format. The script conversion system uses a configuration mapping that includes direct and/or indirect function mappings. For the direct mapping, the script conversion system replaces the function with a new function in the second big data format. For the indirect mapping, the script conversion system constructs an equivalent function in the second big data format using information extracted from parsing queries in the first big data format. The script conversion system also formats a converted query using a project mapping and/or generates a conversion report indicating successful or unsuccessful conversions. Scripts may be converted from an on-premises data warehouse system to a cloud-based data warehouse system.

Abstract: Disclosed herein are system, method, and computer program product embodiments for converting queries and scripts used in big data systems. A script conversion system converts a script and its queries from a first big data format to a second big data format. The script conversion system uses a configuration mapping that includes direct and/or indirect function mappings. For the direct mapping, the script conversion system replaces the function with a new function in the second big data format. For the indirect mapping, the script conversion system constructs an equivalent function in the second big data format using information extracted from parsing queries in the first big data format. The script conversion system also formats a converted query using a project mapping and/or generates a conversion report indicating successful or unsuccessful conversions. Scripts may be converted from an on-premises data warehouse system to a cloud-based data warehouse system.