Abstract: Various examples are directed to systems and methods for detecting vulnerabilities in a web application. A testing utility may direct a plurality of request messages to a web application. The testing utility may be executed at a first computing device and the web application may be executed at a second computing device. The testing utility may determine that a first request message of the plurality of test messages describes a state changing request. The determining may be based at least in part on the first request message and a first response message generated by the web application in response to the first request message. The testing utility may generate a first tampered request message based at least in part on the first request message and direct the first tampered request message to the web application.

Abstract: A system, method, and server for optimizing deployment of a containerized application. The system includes a machine and a server configured to receive optimization criteria related to the containerized application, the optimization criteria including affecting parameters, effected metrics, and stopping criteria. The server is further configured to transmit at least one value of the affecting parameter to the machine, receive results of a trial of the containerized application performed by the machine according to the transmitted at least one value, the results of the trial including an empirical value of the effected metrics, update an optimization model based on the trial results, compare the results of the trial and the updated optimization model to the one or more stopping criteria, and transmit an optimized one of the at least one value of the affecting parameters to the machine for deployment of the containerized application.

Abstract: A computer implemented method, system and computing device for identifying a test option associated with an application for a user is described. The method comprises selecting a predefined test indicated by a test identifier associated with the requested application, the test having more than one test option associated therewith, generating a hash of the test identifier and a user identifier associated with the user, processing the hash to generate an index, comparing said index with a distribution of numbers divided into multiple ranges, each range being associated with a test option, and selecting a test option associated with the range into which the index falls. The applications may be computer gaming applications.

Abstract: Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.

Abstract: A method includes identifying a portion of a web application to be migrated from a first to a second web application framework, selecting at least one page element in the portion of the web application that is to be migrated, generating an application chunk for the selected page element as a self-contained web application that utilizes the second web application framework, and replacing a portion of software code of the web application corresponding to the selected page element with chunk definition metadata defining content of the selected page element, dependencies of the selected page element, and triggers for loading the generated application chunk. The method also includes creating an application core comprising a user interface shell configured to load the generated application chunk and one or more other application chunks of the web application responsive to activation of user interface elements of the web application corresponding to the defined triggers.

Abstract: An assert statement generator employs a neural transformer model with attention to generate candidate assert statements for a unit test method that tests a focal method. The neural transformer model is pre-trained with source code programs and natural language text and fine-tuned with test-assert triplets. A test-assert triplet includes a source code snippet that includes: (1) a unit test method with an assert placeholder; (2) the focal method; and (3) a corresponding assert statement. In this manner, the neural transformer model is trained to learn the semantics and statistical properties of a natural language, the syntax of a programming language, and the relationships between the code elements of the programming language and the syntax of an assert statement.

Abstract: Computerized systems and methods are provided to intelligently and dynamically generate at least a first set of tests to be executed on one or more changes made to one or more applications to determine whether the one or more changes were successful. Data is received regarding one or more changes and a failure probability value for each change is determined. A first plurality of fields are generated for completion by a first user. Upon receiving responses for the first plurality of fields, a first customized code is generated and based upon first customized code, a first set of tests to be executed on the second version of the first application is generated. Additionally, the first set of tests are assigned labels, stored for future use, and executed on the second version of the first application.

Abstract: The disclosed embodiments provide a system that modifies execution of a target process in a computer system. During loading of a marker library by a target process, the system modifies import dependency data of the marker library to include an injection library as a dependency of a marker library. After the modified import dependency data is used to load the injection library into the target process by the operating system or loader, the system executes the injection library prior to execution of the marker library to revert the import dependency data to an original state and modify execution of the target process.

Abstract: Techniques are described herein for selecting, curating, normalizing, enriching, and synthesizing the results of user experience (UX) tests. In some embodiments, a system identifies a set of expectation elements associated with one or more UX tests. An expectation element may specify, using unstructured data that does not conform to a schema, an expectation for a user experience and a respective outcome for the user experience. A themer model may generate predictions that map the respective expectation elements to a theme from a theme schema, which may include a plurality of themes. A selector model may generate selection scores for the expectation elements. The predicted themes and selection scores may be used to render user interfaces and/or trigger other actions directed to optimizing a product's design.

Abstract: Provided herein are systems and methods for creating, testing and providing digital guidance for use in an underlying computer application. In one exemplary implementation, a method includes using a browser extension to record steps of digital guidance content as the steps are created by a content author, automatically testing the content with the same browser and making the tested content available for playback. The testing may include receiving an execute testing command, fetching test case data from a server, executing a test case in the browser using the test case data, running tests on the test case in a background tab of the browser, recording passes and or failures of the tests, sending reports of the passes and failures to the server, sending a notification to the content author that the testing results are ready to view, and displaying the testing results in the dashboard.

Abstract: Techniques for auto-intrusive data pattern and test case generation for negative service testing are described. A test engine obtains negative test information specifying negative test input examples or schemas associated with tests that are expected to fail. A test generator generates multiple test cases based on the negative test information. A test execution orchestrator splits each test case up into actions that are inserted into queues, where workflow execution agents perform the tests by reading from the queues and interacting with services. The tests may also include adjusting a rate of transactions allowed between top-level services and/or downstream services. Results from the testing are analyzed by a test analysis engine and used to inform the services or the test originator of test cases where the expected failures did not arise.

Abstract: A processing system comprising multiple tiles and an interconnect between the tiles. The interconnect is used to communicate between a group of some or all of the tiles according to a bulk synchronous parallel scheme, whereby each tile in the group performs an on-tile compute phase followed by an inter-tile exchange phase with the exchange phase being held back until all tiles in the group have completed the compute phase. Each tile in the group has a local exit state upon completion of the compute phase. The instruction set comprises a synchronization instruction for execution by each tile upon completion of its compute phase to signal a sync request to logic in the interconnect. In response to receiving the sync request from all the tiles in the group, the logic releases the next exchange phase and also makes available an aggregated a state of all the tiles in the group.

Abstract: Provided is a system and method capable of automatically testing a website or application for an error in a user interface without human intervention. As an example, in a system for testing an error in a user interface of an application or website, a user interface system that includes a testable action recognizer that obtains a screenshot of a screen of the application or website, manages a layout and a test action based on user interface (UI) configuration and text recognition information from the screenshot, and a test action generator that receives the layout, selects a test scenario corresponding the layout, and performs a test action according to the test scenario, and in which the testable action recognizer manages whether or not a test is progressed for each screen layout according to the test scenario, is disclosed.

Abstract: A software code testing system includes sub-engines and a test case database storing test cases. A test case sub-engine runs each of the test cases on a plurality of software code modules, and a software code coverage determination sub-engine identifies a respective software code coverage for each software code method included in each of the software code modules. A test case/software code coverage mapping sub-engine then maps the respective software code coverage for each of the software code methods included in each of the software code modules with the respective test case that was run on that software code module to provide a test case/software code coverage mapping, which is used by a test suite optimization sub-engine to generate a test suite that includes a subset of the test cases that provide a desired level of software code coverage using a minimum number of test cases.

Abstract: A computer implemented method, system and computing device for identifying a test option associated with an application for a user is described. The method comprises selecting a predefined test indicated by a test identifier associated with the requested application, the test having more than one test option associated therewith, generating a hash of the test identifier and a user identifier associated with the user, processing the hash to generate an index, comparing said index with a distribution of numbers divided into multiple ranges, each range being associated with a test option, and selecting a test option associated with the range into which the index falls. The applications may be computer gaming applications.

Abstract: Various methods, apparatuses/systems, and media for integrating data are provided. A processor implements a data processing framework configured to run native on a big data platform and abstracts data processing constructs to a user friendly template, thereby eliminating necessity of user initiated tasks of instantiating language level objects. The processor also implements a core set of data pipeline configurations on the template configured to initiate a chain of user defined data transformations. A receiver operatively connected with the processor via a communication network receives input of the chain of the user defined data transformations. The processor tests each transformation independently of each other and outputs data integration solutions on the big data platform based on a positive test result.

Abstract: The present application is directed towards systems and methods for automatic retrofitting of customized code objects during transformation of a system from a source installation to a target installation. In many instances, new objects may be created or objects modified on an online or production system while a development system is being upgraded. Simply copying the upgraded development system to the production system when complete would delete these new objects or modifications. Accordingly, the modifications or new objects may need to be retrofitted, or propagated to the development system and upgraded or transformed for compatibility with the new software, prior to placing the system online.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for a continuous software development and delivery system. Currently, the software development and delivery process is complicated and time consuming. The process requires multiple checkpoints and human intervention to ensure that software updates do not cause errors in the existing software when implemented. Coordination throughout the development process is also problematic as developers may be using varying development environment that are different than the environment used to test and produce the software. The continuous development and delivery system of the present disclosure remedies these issues by providing a consistent development environment throughout the development process. This reduces issues that may arise from use of inconsistent development environments and allows for automation of previously manual portions of the software development and delivery process.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer-readable storage media, for validation of mobile device workflows. In some implementations, a mobile device application to be tested is identified. An installation of the application on each of a plurality of remote mobile devices, including mobile devices having different hardware configurations and different operating system configurations, is initiated. Usage of the application by instructing the remote mobile devices to perform a series of operations using the application is simulated. Performance of the respective mobile devices during the simulated usage is measured. A document indicating performance of the application across the different mobile device configurations is generated.

Abstract: Embodiments include a method for one or more processors to receive an organic dataset and a domain knowledge base. The one or more processors identify private data entities present within the organic dataset. The one or more processors determine statistical properties of the private data entities identified within the organic dataset. The one or more processors create a plurality of test data templates by removing the private data entities from the organic dataset. The one or more processors select from the domain knowledge base, synthetic data entities that match a data type of the removed private data entities, respectively, and align with the statistical properties of the private data entities, and the one or more processors generate synthetic test data by inserting, respectively, the synthetic data entities of the matching data type for the removed private data entities in the test data templates.