Abstract: An automated, dynamic system and method of testing infrastructure-as-code (IaC). The system is configured to validate infrastructure provisioned in multi-cloud environments and is able to accommodate any cloud provider. Implementation of such as system can eliminate manual errors, as well as enable early detection of errors (i.e., before production deployment), thus empowering early ‘go live’. Furthermore, the proposed embodiments are configured to integrate with already existing devOps pipelines for rapid test execution and can run as many times as needed with minimal configuration, allowing for creation and execution of complex scenarios to test low-level validation upon cloud infrastructure setup.

Abstract: An autonomous system and method of comprehensively testing serverless applications. The system is configured to automatically generate test scripts and test data based on deployed and modified function code and configuration files. The system is configured to work in multi-cloud environments and is able to accommodate any cloud provider. Implementation of such a system can eliminate manual errors. Furthermore, the proposed embodiments are configured to integrate with already existing devOps pipelines for rapid test execution, and can continue automated testing in real-time as modifications to the app are made.

Abstract: A device may receive system data identifying computational components and software components of a distributed and heterogeneous system executing a hybrid cloud application, and may create digital twins for the computational components and the software components. The device may create a central digital twin to receive functional data, operational data, and key performance indicators (KPIs) from the digital twins, and may create complex KPIs based on the functional data, the operational data, and the KPIs. The device may modify, based on the complex KPIs, one or more of the digital twins to generate additional KPIs, and process the additional KPIs, with a principal component analysis model and a self-organizing maps model, to detect anomalies in the distributed and heterogeneous system. The device may generate, based on the anomalies, a KPI cause vector identifying a root cause associated with the anomalies, and may perform actions based on the root cause.

Abstract: An automated, dynamic system and method of testing infrastructure-as-code (IaC). The system is configured to validate infrastructure provisioned in multi-cloud environments and is able to accommodate any cloud provider. Implementation of such as system can eliminate manual errors, as well as enable early detection of errors (i.e., before production deployment), thus empowering early ‘go live’. Furthermore, the proposed embodiments are configured to integrate with already existing devOps pipelines for rapid test execution and can run as many times as needed with minimal configuration, allowing for creation and execution of complex scenarios to test low-level validation upon cloud infrastructure setup.

Abstract: Aspects of the present disclosure provide methods, devices, and computer-readable storage media that support detection, effect monitoring, and recovery from failure modes in cloud computing application using a failure mode effect analysis (FMEA) engine. Historical metadata related to operation of a hierarchy of devices may be used as training data to train the FMEA engine to identify failure modes experienced by the hierarchy of devices. After training the FMEA engine, metadata from the hierarchy of devices may be input to the FMEA engine to identify a failure mode that may have occurred, and the FMEA engine may select a recovery process to recommend for addressing or mitigating the identified failure mode. In some implementations, the FMEA engine may output an indication of the recommended recovery process and/or initiate performance of one or more operations at the hierarchy of devices to recover from the failure event.

Abstract: An autonomous system and method of comprehensively testing serverless applications. The system is configured to automatically generate test scripts and test data based on deployed and modified function code and configuration files. The system is configured to work in multi-cloud environments and is able to accommodate any cloud provider. Implementation of such a system can eliminate manual errors. Furthermore, the proposed embodiments are configured to integrate with already existing devOps pipelines for rapid test execution, and can continue automated testing in real-time as modifications to the app are made.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artifact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for performing autonomous self-healing of test scripts. One example process includes the actions of recording data that reflects user interactions with multiple user interface objects of a first user interface, and, for each interaction, generating a natural language statement that reflects an intent of the interaction with an associated user interface object. The process also includes storing the natural language statements in a test script, autonomously self-healing the test script for execution on a second user interface, and executing the autonomously self-healed test script on a second user interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artifact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for performing autonomous self-healing of test scripts. One example process includes the actions of recording data that reflects user interactions with multiple user interface objects of a first user interface, and, for each interaction, generating a natural language statement that reflects an intent of the interaction with an associated user interface object. The process also includes storing the natural language statements in a test script, autonomously self-healing the test script for execution on a second user interface, and executing the autonomously self-healed test script on a second user interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement defect solutions. In one aspect, a method includes receiving a log file and testing results generated from a code base for an application; processing the log file through a pattern-mining algorithm to determine a usage pattern of code modules within the code base; clustering defects from the testing results based on a respective functionality of the application reported within each of the defects; generating testing prioritizations for test cases for the application by assigning weightages to the test cases based on the clusters of defects and the usage pattern of the code modules within the code base; sequencing a set of the test cases based on the test prioritizations; and transmitting the sequence to a test execution engine.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artefact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement determine defect solutions.

Abstract: A device identifies training data and scoring data for a model, and removes bias from the training data to generate unbiased training data. The device trains the model with the unbiased training data to generate trained models, and processes the trained models, with the scoring data, to generate scores for the trained models. The device selects a trained model, from the trained models, based on model metrics and the scores, and processes a training sample, with the trained model, to generate first results, wherein the training sample is created based on the unbiased training data and production data. The device processes a production sample, with the trained model, to generate second results, wherein the production sample is created based on the production data and the training sample. The device provides the trained model for use in a production environment based on the first results and the second results.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for performing autonomous self-healing of test scripts. One example process includes the actions of recording data that reflects user interactions with multiple user interface objects of a first user interface, and, for each interaction, generating a natural language statement that reflects an intent of the interaction with an associated user interface object. The process also includes storing the natural language statements in a test script, autonomously self-healing the test script for execution on a second user interface, and executing the autonomously self-healed test script on a second user interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement determine defect solutions. In one aspect, a method includes the actions of receiving a log file that includes log records generated from a code base; processing the log file through a pattern mining algorithm to determine a usage pattern; generating a graphical representation based on an analysis of the usage pattern; processing the graphical representation through a machine learning algorithm to select a set of test cases from a plurality of test cases for the code base and to assign a priority value to each of the selected test cases; sequencing the set of test cases based on the priority values; and transmitting the sequenced set of test cases to a test execution engine.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artefact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement defect solutions. In one aspect, a method includes receiving a log file and testing results generated from a code base for an application; processing the log file through a pattern-mining algorithm to determine a usage pattern of code modules within the code base; clustering defects from the testing results based on a respective functionality of the application reported within each of the defects; generating testing prioritizations for test cases for the application by assigning weightages to the test cases based on the clusters of defects and the usage pattern of the code modules within the code base; sequencing a set of the test cases based on the test prioritizations; and transmitting the sequence to a test execution engine.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement defect solutions. In one aspect, a method includes receiving a log file and testing results generated from a code base for an application; processing the log file through a pattern-mining algorithm to determine a usage pattern of code modules within the code base; clustering defects from the testing results based on a respective functionality of the application reported within each of the defects; generating testing prioritizations for test cases for the application by assigning weightages to the test cases based on the clusters of defects and the usage pattern of the code modules within the code base; sequencing a set of the test cases based on the test prioritizations; and transmitting the sequence to a test execution engine.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for a touchless testing platform employed to, for example, create automated testing scripts, sequence test cases, and implement determine defect solutions. In one aspect, a method includes the actions of receiving a log file that includes log records generated from a code base; processing the log file through a pattern mining algorithm to determine a usage pattern; generating a graphical representation based on an analysis of the usage pattern; processing the graphical representation through a machine learning algorithm to select a set of test cases from a plurality of test cases for the code base and to assign a priority value to each of the selected test cases; sequencing the set of test cases based on the priority values; and transmitting the sequenced set of test cases to a test execution engine.