Abstract: A method includes scanning a network having a first and second host, obtaining, via the scanning, a first and second type information of the first and second host, respectively, the first or second type information including a device category, obtaining, via the scanning, a first and second scaling factor of the first and second host, respectively, calculating, a first criticality score of the first host based on the first type information and the first scaling factor, calculating a second criticality score of the second host based on the second type information and the second scaling factor, calculating a first host risk score (HRS) for the first host based on the first criticality score, calculating a second HRS for the second host based on the second criticality score, and applying a security patch on the first host prior to the second host first HRS is higher than the second HRS.

Abstract: Methods, system, and non-transitory processor-readable storage medium for bug fix system are provided herein. An example method includes executing at least one test on a system using an automated test tool. The bug fix system predicts at least one characteristic of a test related failure that occurred during the execution using test data produced by the automated test tool. The bug fix system predicts at least one source of the test related failure using the test data produced by the automated test tool.

Abstract: An information handling system executes test cases against a code that includes a set of functions, wherein the execution is performed at least twice using a different trace switch value. The system also identifies trace logs associated with each test case, and maps each test case to one or more functions based on the association of the trace logs with each test case.

Abstract: A method for operating an automated testing platform includes providing a testing cloud application running on the automated testing platform; providing a test facility; receiving, by the testing cloud application, a job file of a test; connecting the test facility to the testing cloud application; publishing job data prescribed in the job file of the test to the test facility, wherein the job data configures the test facility to perform at least one test of a device or service under test and synchronizes a plurality of elements of the test; receiving, by the testing cloud application, result data from the test facility, which has performed at least one of the plurality of elements of the test; and generating a report of the result data.

Abstract: According to examples, an apparatus may include a processor that may identify sensitive information in a recording of an automated test script that is replayed to automatically test a graphical user interface (GUI) of an application under test (AUT). The apparatus may identify the sensitive information during the recording such that sensitive information is identified as the automated test is recorded or afterward based on an analysis of the recording. as based on user input that identifies the sensitive information (or areas containing the sensitive information), automated text analysis, or automated image analysis such as machine-learning based object detection. Once sensitive information (or area) is identified, the apparatus may generate and apply a mosaic to obscure the sensitive information (or area).

Abstract: Systems, methods, and computer-readable media are disclosed for testing a software application. An exemplary method includes storing a control file identifying a test case for testing a software application. A first expected result may be extracted from a device storing expected results of the software application, the first expected result being identified by the control file. A first actual result may be extracted from a device storing actual results output by the software application, the first actual result being identified by the control file. The first expected result may be compared with the first actual result to determine whether the first actual result matches the first expected result. A result file indicating whether the test case passed or failed is generated, and the test case has passed when the first actual result matches the first expected result. The result file may be stored in a storage device.

Abstract: Disclosed herein is a system and a method for generating automation test scripts dynamically for Human Machine Interface (HMI) testing. Test configurations are generated for a Device Under Test (DUT) (115) based on a screen transition dataset upon receiving a user request (105). Based on test configurations and the screen transition dataset, HMI components located in a test path are identified for transitions from source HMI screens to destination HMI screens. Based on the HMI components, reference images are determined for the destination HMI screens from a screen design dataset. The test configurations are executed on the DUT (115) via an external simulating device (113) and transition associated with the test path is validated based on matching the real time destination HMI screen image with the reference image. Based on a validation result, automation test report (117) is generated for the DUT (115).

Abstract: A system includes a memory, a display, and a processor. The processor determines that the display is displaying an element associated with an application. The element includes at least one of a graphical user interface and a web browser. In response to determining that the display is displaying the element, the processor records a video of the display, which depicts a process performed using the element, to obtain a first set of information from the application. The processor extracts, from the video, metadata associated with the process depicted in the video. The processor generates, based at least in part on the extracted metadata, a set of instructions for interfacing with the application. When executed by the processor, the set of instructions are configured to cause the processor to interface with the application to obtain the first set of information. The processor further stores the set of instructions in the memory.

Abstract: The disclosed computer-implemented method may include systems and methods for embedding specific data into a call stack associated with an application session. For example, the systems and methods described herein can initialize a program thread that sequentially executes specialized application functions based on characters of a unique identifier to embed the unique identifier within a call stack of the application session. The systems and methods further provide the unique identifier in connection with other data sources associated with the application session such that further analysis of all data associated with the application session may be cross-referenced according to the unique identifier. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A non-transitory computer-readable medium includes a program causing one or more processors to execute disposing one or more program components and one or more comments on a screen of a visual programming editor based on acceptance of an operation, determining whether to associate a specific comment with a specific program component based on a positional relationship between the specific comment included in the one or more comments and the specific program component included in the one or more program components, and generating a text-based code in which a text of the specific comment and a text of the specific program component are disposed nearby based on determination that the specific comment is associated with the specific program component.

Abstract: A computer-implemented method includes downloading respective instances of an enterprise mobile application to a plurality of mobile devices. The instances of the enterprise mobile applications, while executing on respective mobile devices, capture, for each session, a session log that includes indications of ordered user actions occurring during the session, and optionally time intervals between user actions and/or user attributes. Captured session logs stored at and are mined by one or more servers to discover a particular pattern or sequence of user actions that occurred across multiple, different user sessions. If the number and/or rate of occurrences of the particular pattern is greater than a threshold, a new test case corresponding to the pattern is automatically generated and added to a suite of test cases for the UI functionality of the enterprise mobile application. The updated test suite may be automatically executed on a test version of the enterprise mobile application.

Abstract: A method may include accessing a first code commit for a software application from a code repository, the code repository including a sequence of code commits for the software application; accessing a second code commit for the software application from the code repository, the second code commit occurring prior to the first code commit in the sequence of code commits for the software application; parsing the first code commit for differences across a plurality of dimensions from the second code commit; generating a video frame based on the differences; and appending the video frame to a video, the video including a plurality of frames tracking differences between code commits of the software application.

Abstract: Some embodiments automatically detect a software development code improvement stage. Improvement stage detection may be based on computational events involving a development tool, such as a testing tool, a debugger, or a performance profiler. Program analysis tools driven by artificial intelligence functionality may then be automatically invoked to provide code improvement options, which may be presented to a developer in a tool user interface. Options may include source code edits, configuration changes, or test coverage changes, for example. Analysis results and corresponding code improvement options are thus presented when the developer is prioritizing program performance, program behavior accuracy, program security, or programming style, as opposed to prioritizing code creation or code integration.

Abstract: An update deployment service performs automatic testing and deployment of a software update (e.g., security patches) for a software component on a fleet of IoT devices, without the need for the client to test the update and manually deploy the update to the IoT devices. A client configures the service by providing an upper usage limit for certain IoT hardware components (e.g., memory, hard disk) and/or code components (e.g., threads) that may be caused by any future updates. When a new update is available for deployment, the update deployment service obtains usage test data that indicates the amount of usage (or increase in usage) of the IoT hardware and/or code for the new update. If the usage (or increase in usage) is within the client-provided usage limits, then the service automatically deploys the update to the fleet of edge devices.

Abstract: Processing logic may monitor testing of a candidate service with one or more services to determine if one or more criteria are satisfied. The one or more criteria may be defined in a smart contract on a blockchain. In response to the one or more criteria being satisfied, processing logic may initiate a transaction of the blockchain which causes each of the one or more services to validate the one or more criteria. In response to the one or more services validating that the one or more criteria are satisfied, processing logic may promote the candidate service.

Abstract: For a given input query specifying a task to be performed on a website, the correct sequence of actions (or UI script) is machine learned without having any previous knowledge about the website or the query. To learn the correct UI script, a task agent is created that performs multiple task agent runs comprising different sequences of actions of UI elements on the website (e.g., buttons, text fields, menus, and the like). The states of the webpages are monitored after each action of a UI element is performed. Tasklets are created that include the performed sequences of actions for each task agent as well as their assigned scores, and the correct UI script is chosen from the tasklets based on the scores (e.g., tasklet with the highest score).

Abstract: In example, a natural language input is processed to generate a formal query that is executed to retrieve data from a data store. An indication as to which subparts of the natural language input were used to generate the formal query may be presented to a user. The user may debug the query, such that associations between natural language input subparts and formal query subparts may be changed, added, or removed by the user. Further, a set of steps may be generated that provide an indication to the user as to how the formal query is executed, for example using sample data from the data store. The user may manipulate the sample data, thereby causing the presented steps to be updated accordingly. Once the user has made adjustments and has finished debugging the query, the revised formal query may be executed to retrieve updated data from the data store.

Abstract: Devices, computer-readable media, and methods for automatically configuring network elements in multi-vendor and multi-domain topologies. In one example, a method includes determining a need of a communications network, where a topology of the communications network includes a plurality of network functions from at least two different vendors, predicting a subset of the plurality of network functions and respective configuration parameter values for network functions in the subset, that are expected to support the need of the communications network, and modifying the configurations of the network functions in the subset to reflect the respective configuration parameter values.

Abstract: A system and method are provided for testing application. The method is executed by a device having a communications module and includes initiating via the communications module, an application testing tool, to test an application build according to at least one metric and obtain a test result. The method also includes accessing via the communications module, session details generated by the application testing tool while testing the application build, to determine an overhead component introduced by the application testing tool in generating the test result. The method also includes adjusting the test result based on the overhead component to increase an accuracy of the test result.

Abstract: A method includes receiving, by one or more processors of a computer system, source code, annotating, by the one or more processors of the computer system, features of the received source code using an automated annotation system to provide annotations for the features, relating, by the one or more processors of a computer system, a code execution path of the source code to the features during the annotating, identifying, by the one or more processors of the computer system, a runtime issue associated with the source code, identifying, by the one or more processors of the computer system using a code analytic engine, one or more of the features based on the annotations that are associated with the runtime issue, and automatically disabling, by the one or more processors of the computer system, the identified one or more features associated with the runtime issue.

Abstract: A method and system for debugging SQL statements by computing and saving to memory metadata for each component part of the statement. The system includes a user interface, memory, and a processor, the processor configured to compute and save to memory metadata of SQL statements. The stored metadata may be used for later computation of modified SQL statements. The metadata may also be displayed through a user interface to assist a user in the process of debugging component portions of an SQL statement.

Abstract: A system including first computer memory storing a full data set representable in rows and columns, a second computer memory storing executable instructions, and processors configured to execute the instructions to cause presentation of data of the full data set on a display including columns of data each having data fields, receive user input identifying a column of the data set, determine items to modify in information in the data fields of the identified column, generate and cause display of an indication of a proposed change action to modify the determined items, and in response to a user input indicating a selection of the indication of the proposed change action, update the presentation of the data based on the change action to modify information displayed in the data fields of the identified column of the data, and store a log of the change action.

Abstract: A method and system for predicting post-upgrade outcomes in information technology environments through proactive upgrade issue testing. At least with respect to computing, an upgrade may entail the replacement of a product—in the form of hardware, software, and/or firmware—with a newer or better version, which may serve to bring the product up to date, improve the characteristic(s) of the product, and/or resolve any issue(s) inflicting the product. Further, the process of upgrading a product in view of an issue therein is often reactive—that is, it is often required that a customer experiences and reports an issue for a product to a vendor prior to the issuance of an upgrade to the customer that addresses the issue for the product by the vendor. Presently, what is lacking is a mechanism through which product upgrades may be presented to customers proactively in order to minimize product failure and/or downtime.

Abstract: A device and method for analyzing a performance of an n-tier application capable of carrying out on-the-fly anonymization processing of production data. The production data is generated following a performance test request message transmitted to the n-tier application. The anonymization processing is implemented by an anonymization module that identifies, from a sensitive data identification repository, data to be anonymized in the response message. The anonymization processing also includes generating, from an anonymization repository, anonymized data from the previously identified data to be anonymized, and generating an anonymized response message from the anonymized data and the response message.

Abstract: Embodiments of the present disclosure are directed to, among other things, providing resource allocation advice, configuration recommendations, and/or migration advice regarding data storage, access, placement, and/or related web services. In some examples, a web service may utilize or otherwise control a client instance to control, access, or otherwise manage resources of a distributed system. Based at least in part on one or more resource usage checks and/or configuration checks, resource usage information and/or configuration information of an account utilizing a web service, and/or user preferences and/or settings, resource allocation advice, system configuration recommendations, and/or migration advice may be provided to a user of an account. Additionally, in some examples, one or more remediation operations may be performed automatically.

Abstract: Techniques for evaluating software systems are provided, including measurement of performance ratings of features of an app-under-test are described. The evaluation may include analysis of a video recording of the user interface of the app-under-test, where the video analysis may include comparing the changes over time of co-located pixel in the video to produce a performance rating, for example a speed index. The results of multiple such tests can be compared by comparing the performance rating produced during execution of different tests.

Abstract: In one aspect, a computerized method useful for automated software testing comprising: writing a test suite in a human-readable language; implementing an Artificial Intelligent (AI) process test suite; and creating a set of scripts, data, and execute tests.

Abstract: A method identifies a proposed change associated with a source code file that comprises changed content, identifies a review comment associated with the proposed change, wherein the review comment is further associated with reviewed content of the source code file, presents, via a user interface, a notification indicating that the proposed change has been reviewed, receives, via the user interface, a request to present the review comment, and, responsive to receiving the request to present the review comment, presents, via the user interface, the review comment in association with the reviewed content. The review comment may be presented in visual association with the reviewed content in the user interface. A line of text of the review comment may be presented at a location adjacent to a line of text of the reviewed content in the user interface.

Abstract: The instant invention provides a Dynamic Enterprise Application Platform and a method accordingly for development of application software in a computer system in which users develop application software for their enterprise without the assistance of software consultants. The platform comprises an Enterprise Software Design Model which works with and an Enterprise Software Engine. Data and information gathered by users are configured by the Enterprise Software Design Model and saved into database in the Enterprise Software Engine. The Enterprise Software Engine performs a mapping and reduction procedure to create functional enterprise software application using visual editor with drag and drop interface.

Abstract: A method that includes identifying a processing error, obtaining user input information for a determined period prior to identifying the processing error, determining steps undertaken during the determined period prior to identifying the processing error based on the input information, and obtaining context awareness information related to the one or more processors. The method also includes obtaining network user input information and network context awareness information related to the processing error from other electronic devices within a network, determining a reduced amount of steps from the steps undertaken during the determined period to identify the processing error to form an error reproduction plan by analyzing the network user input information and the network context awareness information in comparison to the user input information and context awareness information, and communicating the error reproduction plan to a user or third party.

Abstract: Methods, computer-readable media, software, and apparatuses may determine source code keywords via analysis of a source code file, map the source code keywords to test keywords, based on a similarity between the source code keywords and the test keywords, wherein the test keywords are associated with test cases, and cause execution of one or more of the test cases. Artificial intelligence driven testing utilizes artificial intelligence in analysis of source code and may automatically select and perform tests on the source code based on results of the analysis.

Abstract: Described herein are methods, computer program products, and computer systems for video-based user interface (UI) application testing. The method includes receiving first test video data corresponding to test video images of an application executing on a first UI, generating the test video images on a first display, generating application video images on a second display. Further, the method may include determining that a first frame of the test video images and a second frame of the application video images fail to satisfy a predetermined similarity threshold, generating a third UI comprising the second frame of the second UI on a third display, receiving user inputs at the third UI for a first duration, capturing replacement test video images from the third display for the first duration, and generating second test video images, wherein the first frame of the test video images is replaced by the replacement test video images.

Abstract: A system configures a test case including a test script to validate a new product. The test script has a logic flow for communications through a sequence of network nodes and the test case includes pass/fail criteria for parameter data of packets communicated between the sequence of network nodes. The system initiates an automation engine that is configured to execute the test script and validates the new product based on actual parameter data relative to the pass/fail criteria. The system simulates the enhanced calling or messaging communications service to utilize by the new product during the test. The system instantiates a network probe that captures packets of the network nodes and extracts actual parameter data, which is compared to expected parameter data to generate test results relative to the pass/fail criteria. The system can present an indication that the new product passed/failed the test case based on the test results.

Abstract: The disclosed embodiments provide a system that modifies execution of a target process in a computer system. During loading of a marker library by a target process, the system modifies import dependency data of the marker library to include an injection library as a dependency of a marker library. After the modified import dependency data is used to load the injection library into the target process by the operating system or loader, the system executes the injection library prior to execution of the marker library to revert the import dependency data to an original state and modify execution of the target process.

Abstract: A method for processing a medical image is provided. The method may include obtaining the medical image, and processing the medical image using a processing program. The processing program may include one or more optimized computation units. The one or more optimized computation units may be optimized by an instruction set supported by the at least one CPU. The instruction set may be configured to optimize at least one of an operation time of the processing program, a resource of the at least one CPU occupied by the processing program, and a count of instructions included in the processing program.

Abstract: A library model addition engine adds library models to a library knowledge base by defining a template for a library configuration file that conveys information about each library model, custom inputs and code snippets to facilitate library comparison operations, and education content for the library model, where the library configuration file template may be automatically filled by populating selected data fields in the template with information identifying the library model and a set of custom inputs for the library model, and then passing a set of test cases from the set of custom inputs to an input/output matching engine to evaluate a repository of code snippets and identify a set of functionally similar code snippets for inclusion one or more data fields in the template.

Abstract: A device configured to identify automated process instructions for a network device. The automated process instructions include instructions for performing a series of actions on the network device. The instructions include machine-executable code partitioned into a plurality of code segments using breakpoints where each breakpoint temporarily pauses the execution of the machine-executable code between a pair of code segments. The device is further configured to identify a first time instance for executing the automated process instructions that does not occur within a time interval associated with a system update for the network device. The system update is configured to modify one or more settings on the network device. The device is further configured to execute the machine-executable code at the first time instance to perform the series of actions on the network device.

Abstract: A scalable test workflow service facilitates management, automated generation and execution of numerous test cases. Test definitions representing tasks to be executed to validate a capability, parameter providers that provide metadata options, and step executors that execute the individual steps of the tasks are all specified. In response to a request to perform a test, an iterative process builds, based on the test definitions and the corresponding parameters, test instances that are executed to obtain the test results. For example, a run tests workflow initiates a test initialization workflow for each test definition. The test initialization workflows call the parameter providers to obtain parameter combinations used to create test instances, and initiate test execution workflows for each parameter combination. Each test execution workflow calls a step executor for each step of the test definition using parameters for the test instance, and returns the results. Results are aggregated and returned.

Abstract: A method and apparatus are provided that includes, in a same framework, storing an artificial intelligence (AI) model, loading the AI model into a serving platform, loading and testing a test unit against the AI model loaded into the serving platform, and collecting reports from results of storing the AI model, loading the AI model into the serving platform and testing the test unit.

Abstract: A computer-implemented method includes downloading respective instances of an enterprise mobile application to a plurality of mobile devices. The instances of the enterprise mobile applications, while executing on respective mobile devices, capture, for each session, a session log that includes indications of ordered user actions occurring during the session, and optionally time intervals between user actions and/or user attributes. Captured session logs stored at and are mined by one or more servers to discover a particular pattern or sequence of user actions that occurred across multiple, different user sessions. If the number and/or rate of occurrences of the particular pattern is greater than a threshold, a new test case corresponding to the pattern is automatically generated and added to a suite of test cases for the UI functionality of the enterprise mobile application. The updated test suite may be automatically executed on a test version of the enterprise mobile application.

Abstract: An embodiment of a method can create a directed acyclic graph (DAG) from a programmer specified set of computation units to solve, in a computer program, physics based simulations of physical systems, and the DAG can be used to analyze and debug the computer program. In this method, the computer program can be created by automatically determining dependency relationships in the set of computation units and automatically schedule their execution. The method can also automatically allocate memory for the computation units.

Abstract: Systems and methods of assessing climate transition risk. A computing system receives a user indication of a selected climate change scenario from a remote client device. The system identifies one or more energy factors from among energy sources. The system retrieves historical financial information directed to one or more securities from remote financial data sources. The system predicts one or more future returns for the securities, by applying the historical financial data and the energy factors to at least one hierarchical linear model. The system adjusts the predicted future returns based on a first climate scenario and the selected climate scenario, to form respective first and second adjusted returns. The system generates a climate transition risk for the securities based on a spread between the first adjusted returns and the second adjusted returns. The system provides a data set representing the climate transition risk to the remote client device.

Abstract: A user interface (“UI”) code coverage system and process determines the coverage by test code of UI Components in a computer program. In other words, the UI code coverage system and process determine whether the test code tests a UI Component. In at least one embodiment, the UI code coverage system and process identify the particular UI Components tested by the test code, provide coverage (i.e. tested) statistics, provide a visualization of the UI Component tested, provide a visualization of tested and not-tested (also referred to respectively as “covered” and “not covered”) UI Components of a UI Screen.

Abstract: In some embodiments, a method comprises obtaining a pipeline of operations, the pipeline of operations including a plurality of functions providing any of one or more modification operations or visualization operations for a plurality of datasets. A first dynamic visualization of the pipeline of operations at a first level of granularity is generated. A second dynamic visualization of the pipeline of operations at a second level of granularity is generated in response to user input.

Abstract: Various methods, apparatuses/systems, and media for automatic risk-based testing of an application are disclosed. A processor accesses a database to obtain data corresponding to a plurality of test results of test runs conducted over a certain period of time for a set of plurality of tests and data corresponding to a change set; generates historical data based on the data corresponding to the plurality of test results and the change set; assigns a test failing probability value for each test among the set of plurality of tests based on analyzing the historical data; identities a first test whose assigned test failing probability value is below a predetermined threshold value; and filters out the identified first test from the set of plurality of tests whose assigned test failing probability value is below the predetermined threshold value so that the identified first test is not utilized for future test runs.

Abstract: The disclosed technology teaches correctly assembling a sequence of components for interacting with a user, including providing a sequence setup GUI with components that accept inputs and have input chain dependencies and outputs. The GUI supports construction of an executable sequence by connecting at least five of the components in a directed graph and tracing multiple paths through the components in the directed graph, resulting from at least one conditional branch at a first component, as the components are connected in the directed graph. Also taught is testing whether input chain dependencies of components under evaluation are satisfied when the components are invoked following any of the multiple paths and locating at least one error in use of a second component that results from failure to satisfy the input chain dependencies of the second component and reporting the error to a user, before executing the sequence and causing the error.

Abstract: A computer-implemented method dynamically detects and corrects an error in a query. The method includes identifying an error in a first query. The method further includes generating a set of alternate execution structures for the first query. The method includes running each of the alternate execution structures, including generating a set of results corresponding to each set of alternate execution structure, comparing each of the set of results against each other of the set of results, and storing each of the set of alternate execution structures to include a result of the set of results, for each alternate structure. The method further includes selecting, from the set of alternate execution structures, a first alternate execution structure based on a predetermined criteria, and implementing the first alternate structure in place of the first query.

Abstract: A method and apparatus for performing a user interface test by a middleware server including determining a state change of a portion of the user interface, receiving a test command indicative of a user interface functional test from a test interface, determining an auxiliary test associated with the test command, generating an altered test command requesting performance of the user interface functional test and the auxiliary test, transmitting the altered test command to the user interface, receiving a functional result from the user interface in response to the altered test command, generating an altered test result indicative of the functional result, and transmitting the altered test result to the test interface.

Abstract: A system for performing remote usability testing of a website includes a module for generating particular tasks, a module for moderating a session with a number of participants, and a module for receiving usability data. The system further includes an analytics module for analyzing the received usability data. The module for generating the particular tasks includes a research server configured to interface with user experience researchers and storing multiple testing modules for selecting qualified participants from the number of participants and for generating the particular tasks having research metrics associated with a target web site. In an embodiment, the research server randomly assigns one or more of the multiple testing modules to one of the participants. The multiple testing modules may include card sorting studies for optimizing a web site's architecture or layout.

Abstract: A system receives binary data and first identification data. The binary data includes hashes of strings of bits, bytes, words or characters. The system receives vulnerability data and second identification data. The system determines a correspondence between the binary data and the vulnerability data based on matching the first identification data with the second identification data. The vulnerability data includes a country of origin for a product identified by the second identification data. The system generates a binaries-to-vulnerabilities database. The system scans target binary data from a target device to to find matches between the target binary data and the binary data using the binaries-to-vulnerabilities database. The system determines a known security vulnerability based on the results of the scanning and the correspondence between the binary data and the vulnerability data. The known security vulnerability includes the country of origin for the product in the target device.