Abstract: A method of generating a user interface for presentation to a user. The method comprises executing a first application computer program to provide a user interface, executing agent computer program code to interrogate and modify said user interface during execution of said first application computer program, and presenting said modified user interface. The first application computer program may be run on a server, while the modified user interface may be presented to a user at a client connected to said server.

Abstract: A system for deploying a Radio Access Network Containerized Network Function (RAN CNF) that is portable across a plurality of RAN hardware platforms is provided. The system includes a Software Development Kit (SDK), a schedule generator and a scheduler runtime unit. The SDK enables providing a RAN functionality in a physical layer (L1) software code in a platform-independent manner as a RAN pipeline of a plurality of RAN tasks. The RAN tasks include a first and second RAN task. The first RAN task invokes an Application programming interface (API) from a plurality of Application Programming Interfaces to call to the second RAN task. The schedule generator generates a schedule for allocating a node in the RAN pipeline to one or more processing elements. The scheduler runtime unit loads the RAN tasks corresponding to nodes in the RAN pipeline, based on the schedule generated by the schedule generator.

Abstract: A system for conducting user interface (UI) software component testing has been developed. The test of the UI software component is initiated and a display of the test results are shown to a user in a browser used in the testing. A code editor used for debugging by the user receives the test results from the browser and presents the test results to the user for debugging. The browser webview and the code editor are simultaneously displayed to the user in a dual screencast window during the UI software testing.

Abstract: Computer systems and associated methods are disclosed to implement a model development environment (MDE) that allows a team of users to perform iterative model experiments to develop machine learning (ML) media models. In embodiments, the MDE implements a media data management interface that allows users to annotate and manage training data for models. In embodiments, the MDE implements a model experimentation interface that allows users to configure and run model experiments, which include a training run and a test run of a model. In embodiments, the MDE implements a model diagnosis interface that displays the model's performance metrics and allows users to visually inspect media samples that were used during the model experiment to determine corrective actions to improve model performance for later iterations of experiments. In embodiments, the MDE allows different types of users to collaborate on a series of model experiments to build an optimal media model.

Abstract: Systems and methods are provided for managing states of deployment. A presence of a configuration change to be implemented at a deployment may be detected. The configuration change may include one or more commands to change a configuration of the deployment. Responsive to detecting the presence of the configuration change, information describing the configuration change may be stored in a repository. The information may be stored in an unsubstituted form and a substituted form. An interface through which configuration change information is accessible may be provided. The configuration change information may describe the configuration change at the deployment based on one or both of the unsubstituted form and the substituted form.

Abstract: Techniques are described for enabling real-time database performance measurement and tuning in a service provider network. To efficiently test one or more proposed configuration changes to a database in a service provider network, a database service is able to create a replicated copy of the database in an environment that mirrors that of the primary database. The database service then automatically causes database traffic destined for the primary database to be routed to both the primary database and the test database. Once the test database is created and traffic is routed to both databases, the database service obtains performance data by monitoring performance of both the primary database and the test database over a period of time. Based on the obtained performance database, the database service can automatically determine which of the primary database and the test database is exhibiting better performance.

Abstract: Techniques described herein relate to a method for deploying workflows with data management services. The method may include identifying a service update event; identifying a service sub-tree based on a service call graph; generating an update sequence for the service sub-tree; predicting an update window for the service sub-tree using a final estimated updated completion time for the service, wherein the final estimated updated completion time is based on a risk profile; selecting a first service of the service sub-tree based on the update sequence, wherein the first service includes a first standby service instance and a first active service instance; generating a backup of a first portion of a services shared data volume repository associated with the first service; and applying an update to the first standby service instance to obtain a first updated active service instance.

Abstract: Techniques are described for automatically generating a consistent configuration state version 2 for a network device with no or minimal help from a user and/or from a provider of the network device when updating from a configuration state version 1 to the configuration state version 2. The techniques and architecture also provide for migration from configuration state version 1 to configuration state version 2 when at least some of a configuration state are located in text files that are applied to the network device at start-up of the network device.

Abstract: There is provided a computer-implemented method and system for provisioning a virtual development and test environment for testing a mainframe computer, comprising: obtaining an indication of a software change to an application on the mainframe computer; receiving a request, from a requesting device, for testing the software change.

Abstract: Aspects of the invention include computer-implemented methods, computing systems and computer program products for calculating an active time on a software application with respect to a first work item. A computer-implemented method includes retrieving activity data from a software development application and a plurality of input signals generated by a peripheral device. The method further includes determining a causal relationship between the input data and any events described by the activity data. In response to a determination of a causal relationship, a first time interval is calculated between an initial signal and a final signal of the plurality of input signals. The first time interval is compared to an estimated time interval. A schedule of a second work item is determined based on the comparison, wherein the first time interval relates to a first work item.

Abstract: A test manager receives notification by a version control hosted service of one or more files, containing plain text instructions, being stored in a repository to be used for guiding a human tester to perform operations and observe behavior for a system under test. The manual test includes callable automated software, executed by a serverless computing platform, to set the system under test in a predefined state required for the manual test. The test manager is configured to display a user interface having information indicating the manual tests to be executed, including required automated software to be executed, and to provide guiding instruction for the execution of the tests. The test manager communicates with the serverless computing platform, issuing instructions regarding the required automation. The user interface is also configured to receive status information from both the human tester and the serverless computing platform.

Abstract: System and method are provided for facilitating performance testing. The method includes mapping application code for an application under test to at least one performance test script to generate a functionality mapping, the test script for executing functions in the application under test, receiving build release notes, determining at least one source code change from the build release notes, and receiving volume data from a production environment for the application under test. The method also includes using the build release notes and the functionality mapping to identify the source code changes for at least one functionality to be tested and for each functionality to be tested, analyzing corresponding volume data for a period of time, and using the volume data from the production environment to generate or update a workload model for the at least one functionality to provide a framework for subsequent performance testing of the application under test.

Abstract: A method for managing bugs includes obtaining, by a bug deduplication system, a set of bugs, performing an encoding on each section of a first bug of the set of bugs to obtain encoded sections, wherein the encoded sections comprise a first encoded section and a second encoded section, applying a first classification model to the first encoded section to obtain a first section score, applying a second classification model to the second encoded section to obtain a second section score, generating a confidence score based on the first encoded section and the second section, and providing the confidence score to a client, wherein the client initiates a corrective action for the first bug based on the confidence score.

Abstract: According to certain aspects of the disclosure, non-transitory computer readable media, systems and methods are disclosed for creating and executing test scenarios for automated testing of web pages. A computer system, for example, may perform operations including: recording one or more actions performed by a user on a web page, the one or more actions resulting in a web page element being displayed in the web browser application, recording an identifier of the web page element, in response to detecting a user input indicating a selection of the web page element, and recording a characteristic of the web page element; and generating, by the testing extension, a test scenario specifying a testable outcome resulting from the one or more actions, the testable outcome being an occurrence of an element having the identifier and the characteristic.

Abstract: Disclosed herein are embodiments of systems, methods, and products comprise an analytic server, which provides a SilverlineRT system that prioritizes and analyzes security alerts and events. The server builds an attack tree based on attack detection rules. The server monitors large-scale distributed systems and receives alerts from various devices. The server determines attacks using the attack tree while excluding false alarms. The server determines impact and risk metrics for attacks in real-time, and calculates an impact score for each attack. The server ranks and prioritizes the attacks based on the impact scores. The server also generates real-time reports. By consider the mission and system specific context in the analysis alert information, the server gives insight into the overall context of problems and potential solutions, improving decision-making. By showing the impacts of alters, the server allows security personnel to prioritize responses and focus on highest value defense activities.

Abstract: A system is provided to validate a computer processor. The system includes a computing system configured to obtain core dump data including executable instructions corresponding to a code stored in a legacy processor. An instruction-level simulator is installed in the computing system and is configured to simulate the executable instructions to generate a plurality of instruction traces. The system further includes a pre-silicon chip model simulator configured to execute the instruction traces to generate performance data. The computer processor is verified based at least in part on the performance data.

Abstract: In general, this disclosure describes methods and devices for analyzing source code to detect potential bugs in the code. Specifically, a device retrieves source code of an application. For each distinct execution of a plurality of executions of the application, the device initiates the respective execution at a particular starting point of the source code and inputs, into the source code, a unique set of inputs relative to any other execution. The device stores, into a path log, an indication of each line of source code and stores, into an output log, an indication of each output object encountered during the respective execution. Each output object includes a local variable dependent on the inputs. The device analyzes, using a machine learning model, the path and output logs to identify an abnormality indicative of a potential bug in the source code. The device outputs a graphical representation of the abnormality.

Abstract: A system and method of generating one or more integration tests are disclosed herein. A computing system receives a URL from a client device. The URL corresponds to a website hosted by a third party server. The computing system generates a recurrent neural network model for testing of the website. The one or more variables associated with the recurrent neural network model are defined by a genetic algorithm. The computing system inputs code associated with the website into the recurrent neural network model. The recurrent neural network model learns a plurality of possible paths through the website by permutating through each possible set of options on the website. The recurrent neural network mode generates, as output, a plurality of integration tests for at least the test website. The computing system compiles the plurality of integration tests into a format compatible with a testing service specified by the client device.

Abstract: A system and method for adaptively sampling a corpus of data samples for improving an accuracy of a predictive machine learning model includes: identifying the corpus of data samples, wherein each data sample of the corpus of data samples is associated with a machine learning-derived threat inference value; stratifying the corpus of data samples into a plurality of distinct strata based on the machine learning-derived threat inference value associated with each data sample of the corpus of data samples; adaptively sampling the plurality of distinct strata; constructing a machine learning training corpus comprising a plurality of data samples based on the adaptive sampling of the plurality of distinct strata; and training the predictive machine learning model based on the machine learning training corpus.

Abstract: A computer implemented method comprises analysing data defining the first image which is displayable when a computer application runs to determine at least one candidate user interactive area in the image. A user interactive area is one which is responsive to user input when the computer application is run. The method comprises attempting to interact with the determined at least one candidate user interactive area and comparing the data defining the first image with data defining a further image to determine if the respective candidate user interactive area is an interactive area.

Abstract: A software library recommendation engine provides an analysis and aggregate dashboard comparison of metrics denoting maintainability trends in a plurality of libraries from a publicly available software repository. Maintainability trends include regularity and magnitude of changes (commits), resolution of user inquiries for issues, problems and bugs, and an estimation of core contributors for estimating inertia and longevity of a plurality of candidate libraries under consideration for a particular usage. Usage metrics coalesce and summarize usage data of libraries under consideration for comparison, and a dashboard of computed metrics provides an indication of trends that indicate reliability or longevity to mitigate vulnerability of the library user from dependence on the collaborative intent of the library author and contributors.

Abstract: Techniques and solutions are described for automatically evaluating test code. In one technique, test code quality is evaluated by comparing assertions in test code with output values in target code tested by the test code. Output values that are not associated with assertions, or an insufficient number or variety of assertions can indicate that a test can be improved. In another technique, test quality is assessed by dynamically changing target code or test data used with a test. Room for test improvement can be indicated if test code provides a passing result despite changes to test data used with the test or changes to target code executed in conducting the test.

Abstract: A software development system is provided for creating and testing applications. The software development system includes a non-transitory computer-readable medium and a processor in communication with the medium.

Abstract: Methods, apparatus, systems and articles of manufacture to provide machine assisted programming are disclosed. An example apparatus includes a feature extractor to convert compiled code into a first feature vector; a first machine leaning model to identify a cluster of stored feature vectors corresponding to the first feature vector; and a second machine learning model to recommend a second algorithm corresponding to a second feature vector of the cluster based on a comparison of a parameter of a first algorithm corresponding to the first feature vector and the parameter of the second algorithm.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for test cycle optimization using contextual association mapping. In one aspect, a method includes obtaining an artifact that includes a collection of reference items, where each reference item includes a sequence of words, generating candidate tags from each of the reference items based on the sequences of words in the reference items, selecting a subset of the candidate tags as context tags based on an amount that the candidate tags appear in the reference items, obtaining a sample item that includes a sequence of words, identifying a subset of the context tags in the sequence of words in the sample item, and classifying a subset of the reference items as contextually similar to the sample item based the context tags that were identified.

Abstract: Multiple versions of a process element in a process plant may run at the same time in different sub-systems of the plant such as configuration system, display system, and run time system. The ability to run multiple versions of process elements allows for more flexibility in production and reduces the time and costs in changes in product production. It is now possible to reduce auditing costs by performing an audit only on differences between versions instead of the entire process element.

Abstract: Example methods are provided for performing fast building and testing a software suite with multiple software components. In one example, the method may include obtaining a changed code file, identifying a software component of the software suite impacted by the changed code file, and instructing to generate a software component build based on the software component but excluding other software components of the software suite. Before completing generating the software component build, the method may also include selecting a software suite build. The method further includes instructing to prepare a testbed based on the software suite build and instructing to test the software component build on the testbed.

Abstract: Systems, apparatuses, methods, and computer program products are disclosed for at least semi-automated generation of model documentation. In an example embodiment, a template corresponding to a model is selected. User input populating portions of a build notebook is received. The build notebook comprises a model identifier identifying the model and executable code. The build notebook is executed using an execution engine to cause an intermediary file encoded in a type-setting system to be generated. Executing the build notebook causes cross-references of elements of the model documentation to be mapped to appropriate locations within the intermediary file. The elements comprise graphical representations of results of model tests executed on the model and/or extracted or user-defined artifacts required for the model documentation.

Abstract: Systems and method for URL filtering are provided herein. In some embodiments, a system includes a processor programmed to receive a URL request to access a resource associated with the URL; perform a first layer of URL filtering by comparing the URL to a blocklist of malicious URLs; determine that the URL does not match a URL on the blocklist; perform a second layer of filtering by applying a machine learning algorithm to analyze the URL to predict whether the URL is malicious; and generate and transmit a URL filter determination that the URL is malicious and update the blocklist to include the URL.

Abstract: An attack/abnormality detection device includes: a command extraction unit configured to extract elements having the same command destination as a command destination of an additionally received actual manufacturing command from among each of a set of normal manufacturing commands and a set of actual manufacturing commands, which contain information on a command destination and an arrival order, and are stored in a command storage region; and a detection unit configured to detect an attack or an abnormality by comparing details of the commands with each other for each arrival order of both extracted elements.

Abstract: A system and methods which manage and secure the interaction between (1) the owner of a client application and third-parties, and (2) between the third-parties and the client application while the client application is operating on a user's client computer. The invention enables interactive primitives such as ensuring the integrity of the client environment, reading data from the client, writing data to the client, collecting data from the user, and ensuring privacy. All functionality is done through the client application and under management and control of the owner of the client application.

Abstract: A highly scalable automated SDK testing system includes an automated testing controller, an automated testing message server and an automated testing message terminal running on a set of target devices. The controller and the terminals register themselves with the message server. A testing case is programmed for testing an SDK on a number of target devices concurrently and transformed into a set of command messages in JSON message format. The controller sends the set of messages to the message server. The message server then distributes the set of command messages to the terminals. In response, the terminal calls corresponding APIs of the SDK. The APIs called can be the same or different between the devices within the set of target devices. The SDK returns a result that is forwarded to the server. The server sends the results from the target devices to the controller. The controller verifies the results.

Abstract: Concepts and technologies are disclosed herein for end-to-end validation of virtual machines. A control system including a processor can detect a validation request that can include a request to create an end-to-end validation function to perform end-to-end validation of a service. The processor can analyze a policy to determine components of the end-to-end validation function and a virtual machine that will host the end-to-end validation function. The components can include a generator function and a receiver function that can encompass the service. The processor can load, or trigger loading of, an image to the virtual machine and instantiation of the virtual machine. The image can include the end-to-end validation function. The processor also can validate the service using the end-to-end validation function based upon a test scenario stored in a test library of the end-to-end validation function.

Abstract: Various embodiments for providing a user interface test and validation system are described herein. An embodiment operates by determining user interface (UI) settings and metadata, and fetching data corresponding to the metadata. A plurality of test procedures corresponding to the UI element are identified. A plurality of states to be present in a rendering of the UI element based on the plurality of test procedures, the metadata, and the data are identified. A rendering of the UI element is validated against the plurality of states. A test report is provided based on the validating.

Abstract: Systems and methods for processing data service requests are disclosed. The system may receive a data service request comprising a unique process code and a data input. The system may parse the data service request to determine the unique process code. The system may retrieve a data operation sequence based on the unique process code. The data operation sequence may comprise an ordered list of executable operations. The system may generate an operation service request based on a first executable operation and the data input. The system may execute the operation service request.

Abstract: The present disclosure discloses a design and test method of a test plan. The test plan includes the plurality of input parameters, the plurality of output parameters, the plurality of system parameters, all of the numerical levels or the types of each input parameter, each output parameter and each system parameter. The test plan includes a plurality of test cases to cover combination conditions including a great number of the input parameters, the output parameters and the system parameters and their dynamic cross of the parameters. The design and test method performs the test cases of the test plan on the product automatically by considering overall possibly parameters and their levels associated with the product. The overall possibly parameters and their levels associated with the product can be tested before the product is dispatched to the customer so as to enhance the product quality.

Abstract: Proposed are a transaction savepoint management apparatus and method, which may involve: creating, based on a transaction initiation request from a user terminal, a transaction, wherein the transaction includes a plurality of operation instructions, and subsequently accessing at least one of a plurality of databases so as to sequentially execute the plurality of operation instructions according to a time sequence; and if the plurality of operation instructions includes global savepoint establishment instruction, creating and maintaining a global savepoint queue to coordinate the plurality of databases and implement an operation for global savepoints, and based on the global savepoints, triggering a database, involved in this transaction, from among the plurality of databases to establish local savepoints and record an association relationship between each of the local savepoints and the global savepoints.

Abstract: A method and apparatus for event attribution during software experimentation is described. The method may include receiving, by a server computer system, a plurality of event tracking messages associated with an end user system, each event tracking message including at least a customer identifier, an end user identifier, and a timestamp. The method may also include storing each event tracking messages with the received customer identifier, end user identifier, and timestamp in a customer data store. Furthermore, the method may include applying, by the server computer system, a feature treatment to a configurable application executing on the end user system, the feature treatment specified by a customer system associated with the customer identifier, and the feature treatment configures one or more features of the configurable application associated with the end user identifier.

Abstract: A system and method may integrate project development information. e.g. software development lifecycle (SDLC), information, collecting sets of SDLC data, each set in a format different from the format of others of the sets of SDLC data. An analysis of the sets of SDLC data may be produced from the sets of SDLC data, and displayed in a SDLC or planning system. The sets of planning data may be collected from a number of project management or SDLC systems. The analysis may be a KPI (key performance indicator), best practice recommendation, or other analysis.

Abstract: Techniques, supported by corresponding apparatuses and methods, are disclosed for monitoring execution of software in a trusted environment and generating path signatures which are characteristic of the behaviour of the software. Multiple approximate nearest neighbour searching hash tables are generated in dependence on such path signatures and on attribute information defining behavioural classifications for the path signatures. Later execution of the software in a non-trusted environment is monitoring and an observed path signature characteristic of the behaviour of the software is generated. This observed path signature is queried against the multiple approximate nearest neighbour searching hash tables and a behavioural classification is determined in dependence on hash collision-based similarity between the observed path signature and the content of the multiple approximate nearest neighbour searching hash tables.

Abstract: Discovery of unique identifiers in firmware can be prevented. During the boot process on a computing system, and after the firmware has generated firmware tables containing unique identifiers, an anonymizer module of the firmware can generate an anonymized version of the firmware tables and cause the anonymized version of the firmware tables, rather than the original, system-unique firmware tables, to be accessible after the operating system is loaded. In this way, once the operating system is loaded, when a module attempts to read the firmware tables, the read will be performed against the anonymized version of the firmware tables thereby preventing the module from obtaining any of the computing system's unique identifiers. A copy of the firmware tables may be maintained separately from the anonymized version of the firmware tables to enable authorized utilities to obtain the computing system's unique identifiers.

Abstract: A set of attributes of software packages may be determined by analyzing a first set of software packages, where the set of attributes of software packages may be useful for uniquely identifying software packages in the first set of software packages. A heuristic may be created or a machine learning model may be trained that combines the set of attributes of software packages to uniquely identify software packages in the first set of software packages. The heuristic or the trained machine learning model may be used to categorize a second set of software packages, or determine relationships among a second set of software packages.

Abstract: In partitioning a graph database, a plurality of vertices of the graph database is assigned to a plurality of nodes. The vertices of the graph database are connected by edges that indicate relationships between the vertices. A vertex of the graph database is designated as a super-vertex that is split into a truncated vertex and at least one vertex representative.

Abstract: A system is provided that enables tests created by a second entity to run with first entity data and configurations. A test module is able to assess test results with dynamic input (e.g., rule-based assessments). The system is also provided to run and test these test modules on the first entity system with first entity configuration and let the first entity define the test input and interpret the test results. This is not performed on all available tests, but only on the tests that are related to the change to be implemented.

Abstract: A method and system for providing debug information associated with computer software executing in a production container that is replicated as a debug container. The computer software is executed in the production container and corresponding computer software is executed in the debug container. Requests are processed via: a gateway sending each request to the computer software executing in the production container, the gateway replicating each request sent to the computer software executing in the production container, the gateway sending each replicated request to the corresponding computer software executing in the debug container, the computer software executing in the production container executing the requests received from the debug container, the corresponding computer software executing in the debug container executing the replicated requests received from the debug container.

Abstract: Methods and apparatus are described by which a rich, time-correlated information set is captured during automated testing of an application in a way that allows the application developer to understand the state of the application under test (AUT), the browser interacting with the AUT, and/or the device interacting with the AUT, as it/they changed over time. Mechanisms or features associated with browsers and/or device operating systems are exploited to capture such information, not only for the purpose of better understanding individual test runs, but also to enable the use of analytics over data sets.

Abstract: Systems, methods, and devices for retrying a query. A method includes receiving, by a first database query manager, a query directed to database data from a client account. The method includes assigning an original execution of the query to one or more execution nodes of an execution platform. The method includes determining the original execution of the query was unsuccessful. The method includes transferring the query to a second database query manager configured to manage internal tasks for improving operation of a database platform that are not received from client accounts. The method includes assigning, by the second database query manager, a retry execution of the query to one or more execution nodes of an execution platform.

Abstract: An approach for detecting non-compliant methodologies in a repository. The approach can generate an abstract model of an Infrastructure as Code (IaC) repository based on security requirements of an IaC. The approach can compare the abstract model to one or more validated abstract models associated with other repositories of a hybrid multi-cloud system. The approach can generate an alert notifying the IaC repository of one or more non-compliant methodology measures. The approach can send the alert to the IaC repository.

Abstract: An example computer system includes a memory having a computer program, a set of data containing a cryptographic first hash protected by a code, and a set of trusted security guidelines for operating an electronic device; a trusted platform module device to store a second hash associated with the computer program; a trusted application computing agent to establish that a hardware initialization sequence of the electronic device is trusted upon matching the first hash with the second hash; and a controller to operate the computer program on the electronic device according to the set of trusted security guidelines.

Abstract: Systems and methods for preventing source code error reoccurrence. The method includes receiving a source code file including a record of modifications of the source code and a record of source code errors. The method also includes storing the source code file in a database. The method further includes receiving a modified source code file including an identification of a user that created the modified source code file on a user device. The method also includes determining a portion of the source code file that has been modified based on a comparison of the source code file and the modified source code file. The method further includes determining whether the portion of the source code file that has been modified corresponds to an error in the record of source code errors. The method also includes generating a notification corresponding to the error for display on the user device.