Abstract: Using a large language model to improve testing of an application programming interface. Access an application programming interface specification, the application programming interface specification used for testing of an application programming interface. Access one or more test cases previously generated for testing the application programming interface which when utilized to test the application programming interface resulted in one or more errors. Access the one or more errors generated when testing the application programming interface using the one or more test cases previously generated. Input the application programming interface specification, the one or more test cases previously generated, and the one or more errors into a large language model for refinement by the large language model. Receive a modified set of the one or more test cases, modified by the large language model. Receive a modified application programming interface specification, modified by the large language model.

Abstract: Methods, computer program products, and systems are presented. The methods, computer program products, and systems can include, for example, processing multiple datasets using metadata, wherein the metadata can characterize relationships among datasets. In dependence on such metadata, production datasets can be, e.g., generated, versioned, and/or merged. The resulting production datasets can support subsequent computing uses such as analytics, machine learning, application testing, and/or enterprise processing.

Abstract: Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: processing a plurality of raw datasets for generating index metadata and associating one or more index defining the index metadata to respective ones of the plurality raw datasets, wherein the respective ones of the plurality of raw datasets define respective metadata augmented datasets by the associating of the one or more index thereto; examining augmented datasets of the metadata augmented datasets in dependence on metadata of the index metadata and in dependence on user defined input data; and merging first and second ones of the augmented datasets in dependence on the examining augmented datasets, wherein the merging first and second ones of the augmented datasets in dependence on the examining augmented datasets is performed in support of preparing a production dataset.

Abstract: Methods, computer program products, and systems are presented. The method computer program products, and systems can include, for instance: processing a plurality of raw datasets for generating index metadata and associating one or more index defining the index metadata to respective ones of the plurality raw datasets, wherein the respective ones of the plurality of raw datasets define respective metadata augmented datasets by the associating of the one or more index thereto; examining augmented datasets of the metadata augmented datasets in dependence on metadata of the index metadata and in dependence on user defined input data; and merging first and second ones of the augmented datasets in dependence on the examining augmented datasets, wherein the merging first and second ones of the augmented datasets in dependence on the examining augmented datasets is performed in support of preparing a production dataset.

Abstract: Automated testing of an application programming interface (API) includes determining features of an application programming interface (API). The features include operations of the API, one or more resources used by each operation, and resource-based dependencies between the operations. A resource-specific group of operations is generated. The operations within the resource-specific group operate on a selected resource selected from the one or more resources. A sequence of operations is generated by ordering the operations within the resource-specific group based on resource-based dependencies between the operations within the resource-specific group. A functional test case of the API based on the sequence of operations is output for testing the API.

Abstract: A processor can receive input data to a computer code and output data that the computer code produces corresponding to the input data. Based on the input data and the output data, the processor can build a decision tree that links input conditions to the output data. Using the input conditions, the processor can run a condition generator model created by fine-tuning a pre-trained programming language model, where the condition generator model predicts next condition that is likely to occur in the computer code. Based on the next condition, the processor can generate input instances and run the computer code using the generated input instances. Based on output instances output by the computer code based on the generated input instances, the processor can detect at least one flow path in the computer code, which had not been previously built in the decision tree.

Abstract: A method of providing a surrogate program for a program endpoint includes: obtaining, by a processor set, a set of plural input/output pairs generated using the program endpoint; generating, by the processor set, transformations based on the input/output pairs; generating, by the processor set, a model that classifies inputs of the input/output pairs to ones of the transformations based on parameters of one or more strings of the inputs; receiving, by the processor set, a new input; selecting, by the processor set and using the model, one of the transformations based on parameters of one or more strings of the new input; and generating, by the processor set, a new output by applying the selected one of the transformations to the new input.

Abstract: Methods, systems, and computer program products for path-coverage directed black box application programming interface (API) testing are provided herein. A computer-implemented method includes determining constraints based on inputs and corresponding outputs of an API in a production environment; generating initial test inputs based at least in part on the constraints; creating a program dependency graph based on trace sequences and request-response data obtained in response to providing the initial test inputs to an endpoint of the API; enhancing the program dependency graph by generating additional test inputs directed to one or more paths of the dependency graph; identifying, based on the enhanced program dependency graph, at least a portion of the API that is not covered by an existing test suite; and using the enhanced program dependency graph to generate new test cases for the test suite based on the identifying.

Abstract: Methods, systems, and computer program products for path-coverage directed black box application programming interface (API) testing are provided herein. A computer-implemented method includes determining constraints based on inputs and corresponding outputs of an API in a production environment; generating initial test inputs based at least in part on the constraints; creating a program dependency graph based on trace sequences and request-response data obtained in response to providing the initial test inputs to an endpoint of the API; enhancing the program dependency graph by generating additional test inputs directed to one or more paths of the dependency graph; identifying, based on the enhanced program dependency graph, at least a portion of the API that is not covered by an existing test suite; and using the enhanced program dependency graph to generate new test cases for the test suite based on the identifying.