Abstract: According to an aspect of the present invention, there is provided an interlock component for a software system. The interlock component may comprise an input for receiving an interaction request for a first system component and system data. The interlock component may comprise a processor arranged to assess the interaction request and the system data relative to predefined system logic rules to determine if the interaction request satisfies the system logic rules. The interlock component may comprise an output arranged to output the interaction request to the first system component in the event that the system logic rules are satisfied.

Abstract: According to an aspect, software test failures are analyzed using natural language processing (NLP) and machine learning. A failure is detected during a code build associated with a software product. Each change set since a last successful code build associated with the software product is identified and analyzed using NLP to extract change set features. A software defect origin model is applied to the extracted features in each analyzed change set to detect an origin of the failure.

Abstract: A workflow for an operational process may be defined using a functional programming language. A computer system may parse the workflow to generate an abstract syntax tree, which may include states of the workflow and transitions from one workflow state to another. The computer system may generate code paths from the abstract syntax tree representing sequences of execution. Reflection on the workflow may be performed using the abstract syntax tree and code paths to allow intelligent decision-making.

Abstract: Optimal selection of relevant testing parameters is disclosed. A test parameter data structure that identifies a plurality of test parameters for use with a plurality of different test functions of a test suite is accessed, each test parameter having at least one test value. A parameter usage data structure that identifies for each respective test function a set of test parameters of the plurality of test parameters used by the respective test function is accessed. Each respective test function is initiated a number of times based at least in part on the set of test parameters used by the respective test function.

Abstract: The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for testing open source software are disclosed. In one aspect, a method includes the actions of receiving, from a user device and by a presubmit check server system that is configured to perform presubmit checks on system software code updates, a system software code update and a request to perform a presubmit check on the system software code update. The actions further include requesting, from a system software code server system that is configured to store system software code, presubmit check code. The actions further include receiving, from the system software code server system, a presubmit check code module. The actions further include executing the presubmit check code module against the system software code update. The actions further include providing a report that indicates results of the presubmit check code module execution against the software code update.

Abstract: Techniques are disclosed for determining whether to permit distribution of a software package—for example, via an application exchange service of a cloud computer system. The computer system may calculate a risk score for the software package based on various factors, including package metadata that specifies one of a plurality of package types supported by the application exchange service. The specified package type may be indicative of an amount of developer control on the software package after distribution. Based on comparing the calculated risk score to a risk threshold, the computer system may determine whether to permit distribution of the software package via the application exchange service. Scoring software packages based on package metadata may reduce the number of packages requiring manual review, which may advantageously reduce an amount of time between package development and deployment.

Abstract: Described are automated systems and methods for providing a simulated environment for robotic and/or real-time systems, such as unmanned vehicles, to perform full system simulations while also providing a system-wide code coverage assessment of the software associated with the robotic and/or real-time systems. The exemplary systems and methods can employ code coverage instrumented shared libraries to facilitate generation of code coverage information and one or more code coverage reports. The code coverage information and/or the code coverage report can quantify the effectiveness of the testing and can facilitate development of more comprehensive and efficient testing of the software.

Abstract: A narrative response generator receives a user data query specifying variables and data sources from which to extract information desired by a user. The narrative response presents the information desired by the user in a non-textual format such as graphs and a textual format such as one or more paraphrases that are automatically generated by a sentence struct model. The sentence struct model generates context free grammar (CFG) which provides templates for generating word sequences that contain natural language words and placeholders. The placeholders are replaced with values obtained from the user data query for generating grammatically-accurate, complete paraphrases. The narrative response may additionally include information extracted from external data sources.

Abstract: A computer-implemented method, system and computer program product for identifying and recommending code snippets to be reused by a software developer. Multiple sources (e.g., social media messages) are monitored for source code development difficulties. In response to detecting a source code development difficulty, the source code which is the source of the detected source code development difficulty is labeled with a struggle tag, which may indicate a category of the source code. Furthermore, source code snippets from various sources (e.g., source code snippets publicly available on the Internet) are mined, identified and labeled with tags, which may indicate a category of the source code snippet. Relevant source code snippets are identified to address the software developer's struggles based on matching one or more of these tags with the struggle tag, which are later ranked as to which are the best to address the software developer's struggles in writing source code.

Abstract: Systems, methods, and computer program products are described for edge computing for cloud application development. Data having at least one image of a continuous integration system is received. The at least one image can be locally instantiated within a local container. Developmental code associated with an application can be retrieved from a code repository. The application is compiled, built, and tested within the local container based on the developmental code. The application is deployed to a production environment.

Abstract: Apparatus, device, methods and system relating to a vehicular telemetry environment for monitoring vehicle components and providing indications towards the rating condition of the vehicle components and providing optimal indications towards replacement or maintenance of vehicle components before vehicle component failure are disclosed.

Abstract: Systems, computer-implemented methods, and computer program products to facilitate generation of microservices from a monolithic application based on runtime traces are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise a model component that learns cluster assignments of classes in a monolithic application based on runtime traces of executed test cases. The computer executable components can further comprise a cluster component that employs the model component to generate clusters of the classes based on the cluster assignments to identify one or more microservices of the monolithic application.

Abstract: A method for assigning test case priority includes analyzing, based on a set of test vectors, one or more test cases from a set of test cases on source code to determine a particular combination of attribute values associated with the one or more analyzed test cases. The method further includes generating a priority value for each attribute in the determined particular combination of attribute values. A priority value for each of the analyzed one or more test cases is generated based on the generated priority values of the particular combination of attribute values associated with the analyzed one or more test cases.

Abstract: Disclosed herein are a method for automated fuzzing for an IoT device based on automated reset and an apparatus using the same. The method includes loading, by the apparatus, a fuzzing agent into an IoT device based on firmware; monitoring, by the apparatus, the status of processing of fuzzing input by the IoT device based on the fuzzing agent; collecting, by the apparatus, fuzzing data corresponding to occurrence of a crash based on hooking using the fuzzing agent when the crash occurs in the IoT device; and resetting, by the apparatus, the IoT device based on the fuzzing agent.

Abstract: Disclosed herein are system, method, and computer program product embodiments for providing the ability to generate unit tests for a web service from a logged interaction with the web service and an API specification for the web service. Rather than having to manually generate tests for the web service, a test developer may interact with the web service through a web browser and record a log of these interactions. The log is then matched to a definition of the API specification, and a test is created. The test developer can either run this test against the web service, or use the test as a foundation for developing and refining the test further.

Abstract: A deep learning model is trained on historical pull requests to automatically identify appropriate reviewers to review source code from one or more source code repositories. The model is trained on features that are based on past pull requests from the source code repositories and that represent the context of the syntactic representation of the changed code. The model learns patterns found in the changed source code and of the past peers associated with the changed source code to relate certain source code fragments with certain peers. The model generates probabilities based on the learned patterns which are used to identify appropriate reviewers more suitable to review the source code.

Abstract: Certain aspects of the present disclosure provide techniques for managing deployment of application components in a continuous development pipeline based on a comparison of execution graphs generated from execution of functions in production and test environments of the continuous development pipeline. Embodiments include generating a first graph representation of a function from log data captured during execution of the function in a production environment and a second graph representation of the function from log data captured during execution of the function in a test environment. Differences between the first and second graph representations are identified, and based on the identified differences, a system takes one or more actions to manage deployment of software application components implementing the function from the test environment to the production environment.

Abstract: Some embodiments describe improvements to an interface for designing robotic process automation (RPA) software. In response to receiving user input that selects a target UI element for an RPA activity (e.g., mouse click, text input), some embodiments automatically identify a label element co-displayed with the respective target element. An activity configuration interface displays an activity name and/or description using the label element as a descriptor and/or substitute for the target element, making the interface more intuitive and accessible to developers without a programming background.

Abstract: A method for integration-testing a microservices-based application is performed by an automated software-testing system by using mock software entities. The mock entities emulate the behavior of other microservices or external software applications that would normally interact with the tested microservices in a production environment. The mock entities are managed by a mock server that communicates with the test system through a messaging system. The mock server determines how the mock entities should respond to the tested application's service requests by referring to test guidelines stored in a behavior store. During testing, the test system dynamically updates the behavior store in response to the tested application's service requests and to other indicators of the current state of the tested application. If the tested application interacts with the mock entities during the test as expected, the test system deems the application to have passed the integration test.

Abstract: A computer program file or a sequence of processing steps from an authoring environment of a data processing system is used to generate a graph including nodes representing the processing steps is generated. Unique identifiers (tags) are assigned to the nodes. One or more processing steps are optionally modified while preserving the original identifiers. If an error occurs during execution, error information is saved including the processing step that failed and data records that triggered the failure. The identifier of the failed processing step is attached to the error information. The error information is collected and processed. The collected error information is used to correlate the error to the failed processing step and to data records triggering the error using the identifier of the failed processing step recorded with the error information. The correlated error information indicates cause and location of the error.

Abstract: Techniques for automated generation of inputs for testing microservice-based applications are provided. In one example, a computer-implemented method traverses a user interface of a microservices-based application by performing actions on user interface elements of the user interface, and generates an aggregated log of user interface event sequences and application program interface call sets based on the traversing. The computer-implemented method also determines respective user interface event sequences that invoke application program interface call sets and generates respective test inputs based on the user interface event sequences that invoke the application program interface call sets.

Abstract: Systems and methods in accordance with embodiments of the invention can automatically track the creation of documents, such as source code files and unit tests, along with the development of those documents. The document creation and development workflow can be automatically validated against a defined set of standards to ensure that the documents are properly created. The review of the documents can also be automatically validated to ensure that the review process is properly completed. A variety of metrics can be generated regarding errors and issues identified during the validation processes. These metrics can be used to identify common issues, automatically generate proactive suggestions to avoid issues during document creation and testing, and/or generate developer profiles indicating the performance of particular developers.

Abstract: Methods for generating and maintaining test scripts for automated web testing are provided. A method for generating test scripts includes: receiving a series of steps defining a procedure; linking keywords in the series of steps with functional objects; dynamically arranging the functional objects according to the series of steps; generating the test scripts from the arranged functional objects; and sending the test scripts to a testing manager. A method for maintaining test scripts includes: determining a change in steps of metadata; identifying a position within a test script affected by the change in steps; updating row(s) within the test script based on the change in steps; and providing the test script to the testing manager. Embodiments of the disclosure enable a codeless automated web-testing framework based on a non-recording approach, which avoids manual coding or recording of test scripts, thereby accelerating website system testing and reducing associated time and costs.

Abstract: A software ecosystem includes a software supply chain in which each of the participants in the software supply chain produce software components using reproducible builds. By using deterministic compilation practices, each of the software components produced by a respective participant should be identical. The software ecosystem also includes a set of tamper proof distributed ledgers. Hashes of the software components are generated and securely recorded in the set of distributed ledgers. The software ecosystem also includes an intrusion detection system configured to compare hashes of the software components to determine when one or more of the software components has been generated in a corrupt manner. The secure software ecosystem includes a full-platform approach to integrity which incorporates designing against attacks, rather than patching after them, which creates a paradigm in which computing platforms can be trusted because they have been designed to operate in an untrustworthy environment.

Abstract: Certain aspects of the present disclosure provide techniques for providing a graphical user interface to assist a user of an application programming interface (API). Embodiments include determining that the user has selected an attribute of the API within an API explorer. The API explorer may be displayed with a developer interface of a web application. Embodiments further include identifying a user interface component of the web application that is related to the attribute of the API. Embodiments further include displaying an indication within the developer interface that the user interface component is related to the attribute of the API.

Abstract: A website building system (WBS) that enables web site designers to build and host websites for their end users. The WBS includes at least one processor and an experiment manager running on the at least one processor to manage multiple concurrent experiments at runtime with the experiments to test at least features, components or system updates for the WBS and where the experiment manager at least selects a target population for an experiment, handles conflict resolution between the experiment and at least one other concurrent experiment, and collects experiment data. The WBS also includes an experiment analyzer to analyze the experiment data during runtime and to update the experiment manager accordingly.

Abstract: A computer system operates to detect a series of activities performed by a user, where the activities include interactions as between the user and one or more user interface components. The computer system recognizes the of activities as a sequence of events, where each event of the sequence corresponds to one more activities of the series. In response to the computer system detecting a current user activity, the computer system determines at least one of a user intent or interest based on an analysis of a relevant portion of the sequence of events.

Abstract: A method is provided. The method includes determining, in a determination by an electronic testing device, one or more locations in a cellular network where a test case is to be executed, a time at which the test case is to be executed at the one or more locations, a number of times the test case is to be executed at the one or more locations, or a type of a test equipment on which the test case is to be executed. A test context for testing a user equipment is determined based on a result of the determination. An optimal test case is determined from a test case repository, based on the test context, and the optimal test case is executed.

Abstract: A computing device includes a processor and a medium storing instructions. The instructions are executable by the processor to: record a test script for an application in a first display configuration, the test script including a user interaction with an input object in a graphical user interface (GUI) of the application; in response to reaching the user interaction during a configuration execution of the recorded test script, determine identifier information of the input object for each of a plurality of display configurations; and store the identifier information of the input object for each of the plurality of display configurations, the stored identifier information used during testing executions of the test script.

Abstract: Disclosed embodiments relate to simultaneously running live data of a website in a website deployment environment while also running test data of the website in a non-public website testing environment. Operations include storing the live data and test data of the website; accessing the live data; using the live data to render the website; receiving a request to perform testing on the website while the website is live in the website deployment environment; accessing a set of the test data responsive to the request; and while the website is operating in the website deployment environment, testing the website in parallel in the non-public website testing environment such that both the set of test data and the live data are used simultaneously by the website in the non-public website testing environment.

Abstract: System and computer-implemented method for managing workloads in a computing environment use collected resource utilization metrics for a workload of a compute instance running in the computing environment that are superimposed to produce a unified time series of the resource utilization metrics for the workload. Undesired periodic patterns are then removed from the unified time series of the resource utilization metrics, which is used to identify the compute instance as a particular type of compute instances. Based on the identification, an action is recommended and implemented on the compute instance.

Abstract: A system and method for CI/CT/CD, which is continuous integration/continuous testing/continuous delivery, in which testing is fully integrated to the needs of rapid code development and delivery. The system is determining test coverage of a plurality of tests, comprising a code builder for providing code, a code tester for testing the code with said plurality of tests, and a code test analyzer for analyzing results of said plurality of tests to determine coverage of said code by said plurality of tests.

Abstract: Systems and techniques of the present disclosure may provide remote debugging of an integrated circuit (IC) device while preventing unauthorized access of device intellectual property (IP). A system may include an IC device that generates an encrypted session key and an interface that enables communication between the IC device and a remote debugging site. The interface may enable the IC device to send the encrypted the encrypted session key to initiate a remote debug process, receive an acknowledgement from the remote debugging session, and authenticate the acknowledgement. Further, the interface may enable to the IC device to initiate a secure debug session between the IC device and the remote debugging site.

Abstract: Systems and methods for creating, modifying, and executing user acceptance testing are provided. The systems and methods may employ a repository of test cases which a user can copy and edit to produce user acceptance test plans. The system and method may provide auto-generated software feature files, skeletal test code and test parameters to an automation server which can executes the user acceptance test plans. The results of the tests may be provided to the user via a user interface.

Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating identification of code ownership through test coverage in database systems according to one embodiment. In one embodiment and by way of example, a method includes identifying a code developed by one or more teams, generating code coverage segment data associated with the code, where the code coverage segment data to identify one or more segments of the code associated with one or more teams. The method may further include calculating, based on the code coverage segment data, a percentage of support provided by each of the one or more teams in developing each of the one or more segments, and determining, based on the support percentage, an ownership share of each of the one or more segments associated with each of the one or more teams.

Abstract: In one embodiment, a telemetry system may track a cloud synchronization system to improve performance. A service proxy 114 may receive a matching file metadata set 304 for a matching file 134 stored in a cloud user account 132 of a cloud synchronization system. The service proxy 114 may execute a synchronization verification of the matching file metadata set 304 to a local file 112 stored in a client device 110. The service proxy 114 may create a telemetry report 400 describing a synchronization error 412 as determined by the synchronization verification.

Abstract: A system including one or more processors; and at least one memory storing computer code that, when executed by the one or more processors, is configured to cause the system to: receive data representative of first text indicative of a first draft coding script; query a database storing coding technique information corresponding to a plurality of coding techniques, the query comprising a first request including indications of a first coding technique classification of a first coding technique of the first draft coding script; receive, responsive to an identification of the first coding technique classification within the database, indications of one or more authors of corresponding coding techniques; generate a first recommendation comprising an identification of a first expert among the one or more authors; and dynamically display the first recommendation.

Abstract: An apparatus identifies each of one or more strongly connected graphs included in a control flow graph of a program, and calculates a characteristic value indicating a characteristic of a first process indicated by the identified strongly connected graph, based on profile information indicating a characteristic of a second process indicated by each of one or more nodes included in the control flow graph. The apparatus determines, based on the calculated characteristic value of the first process and a requirement set for an accelerator, whether or not the first process is executable by the accelerator.

Abstract: Examples of the present disclosure describe systems and methods for behavioral threat detection definition. In an example, a behavior rule comprising a set of rule instructions is used to define one or more events indicative of a behavior. For example, a set of events from which one event must be matched may be defined or a set of events from which all events must be matched may be defined. In some examples, events are matched based on an event name or type, or may be matched based on one or more parameters. Exact and/or inexact matching may be used. The set of rule instructions ultimately specifies one or more halt instructions, thereby indicating that a determination as to the presence of the behavior has been made. Example determinations include, but are not limited to, a match determination, a non-match determination, or an indication that additional monitoring should be performed.

Abstract: A system may parse a group of manuscripts to extract manuscript properties and textual data included in each respective manuscript. The system may perform computer based identification of a predetermined category in which each respective manuscript resides and generate a categorized inventory of log entries, which include the manuscript properties and the textual data as respective field values. Each of the log entries may be representative of one of the manuscripts and may be categorized in the categorized inventory of log entries according to the predetermined category. The system may generate derived field values in at least some of the log entries. The derived field values may be indicative of at least some of the respective field values. The system may generate an architectural computer based dimensional mapping of a categorized inventory of log entries based on the relational association among the respective field values and the derived field values.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artefact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Systems, devices, and methods are provided for using neural networks to determine the applicability of a software patch to a software code. A system may receive a first code modification associated with first software code, and determine a second code modification associated with second software code, the second software code including the second code modification. The system may determine a first feature vector associated with the second code modification, and may determine a threshold value associated with the first feature vector. The system may determine a second feature vector associated with the first code modification, and may determine that the second feature vector satisfies the threshold value. The system may send an indication to initiate the first code modification to the software code.

Abstract: A method for providing a development accelerator for microservices is provided. The method includes obtaining a code set that includes first computer program codes representing a framework for developing microservices in a network environment; obtaining, from the network environment, runtime routines relating to second computer program codes of network functions with respect to the microservices; compiling, in a data package, the runtime routines, the code set, and an instruction set relating to textual directions for developing the microservices; and storing the data package in a central repository.

Abstract: In accordance with an embodiment, a service, application, or other component can operate in association with a virtual machine at a computer server or device. The system can determine memory heap usage based on collected metrics, via one or more push and/or pull communications of data, and automatically adjust or tune concurrent processing of registered components, in response to such determination. In accordance with an embodiment, the system is extensible to support different low memory conditions and different components that require tuning of their processes. Datasets describing information such as heap usage, garbage collection, and stuck threads, can be captured and stored; and machine learning processes applied to those datasets, to deduce new low memory conditions. If memory pressure continues to be high, and is not controlled by tuning component processes, the system can determine likelihood of a memory leak, and restart the server.

Abstract: Systems and methods for testing software such as webservices and APIs using behavior-driven development (BDD) language are disclosed. Software such as, for example, an Application Programming Interface (API) or webserver is tested using a BDD expression such as, for example, a Gherkin. The Gherkin may be converted into machine-executable code for the test. The machine-executable code may be executed if the software is available. A response output generated by the software may be validated based on validation information of input data. A report based on the validation may be generated.

Abstract: A system and method in accordance with examples may include systems and methods for detecting failure of microservice applications in communication with an orchestration layer of a microservice-architecture. The system may include memory and an orchestration layer including one or more processors coupled to the memory. The one or more processors may be configured to connect the orchestration layer to a plurality of microservice applications that are each associated with a respective dataset. The one or more processors may be configured to validate, responsive to the connection of each of the microservice applications, the microservice applications by performing a first test and a second test. The one or more processors may be configured to deploy, responsive to the validation of the microservice applications, the microservice applications to execute a plurality of workflow actions.

Abstract: A Software optimization method, system, and computer program product, include defining a vocabulary of tokens to yield admissible inputs of a system, generating random test inputs based on combining inputs and input tuples, followed by application of these inputs into the system, and analyzing the correlations between system failures and the tokens present in respective inputs to localize failures to particular inputs and input tuples.

Abstract: Systems and methods are disclosed for automatically assessing and conforming software development modules to accessibility guidelines in real-time. The systems may facilitate an incremental development of applications. One or more modules or base codes of the application, as they are developed, may be tested for compliance to various accessibility standards (e.g., Web Content Accessibility Guidelines 2.0). If a module or base does not meet a specific threshold of compliance, systems and methods allow for an automatic modification of the module or base code to make it more compliant to the accessibility standards.

Abstract: Aspects capture test coverage in a distributed system, wherein a processor instigates execution of a unique hypertext transfer request protocol test case within a distributed system of different, networked servers. The header of the unique test case includes a unique name for the unique test case, and the distributed system servers are each configured to, in response to processing a test case, generate a time-stamped log entry that includes header data for the processed test case and a uniform resource locator address of the processing server. The processor thus maps the unique test case to a subset of the distributed system servers as endpoint servers of the unique test case, in response to determining that the uniform resource locator addresses of each of the subset endpoint servers are listed within generated log entries of the endpoint servers in association with the unique test case name.