Abstract: A method for processing verification tests for testing a design under test (DUT), may include receiving from a user a start time message and an end time message for each action of actions in a verification test in a target code form, to be printed into a log file of an execution of the test, so as to list chronologically the start time and end time of each of the actions in the log file. The method may also include executing the verification test to obtain the log file with the start time and end time messages and, using a processor, analyzing the log file to construct a graph representation of the validation test, based on the printed start and end times of the actions of the test.

Abstract: The present disclosure involves systems, software, and computer implemented methods for correlating critical events to identified log data. An example event log analyzer can identify a set of log messages. One or more occurrences of a first critical event and a time of each of the occurrences are identified. One or more candidate subsets of log messages are identified. Each log message in each candidate subset is associated with a timestamp that is within a predefined time window prior to the time of an occurrence of the first critical event. A candidate subset of log messages is selected as a correlator of the first critical event. A rule is defined using the selected candidate subset of log messages. The rule defines a second critical event that correlates to the first critical event. The rule is associated with one or more actions to perform when the second critical event occurs.

Abstract: A method for monitoring resources in a computing system having system information includes transforming, via representation learning, variable-size information into fixed-size information, and creating a machine learning neural network model and training it the machine learning model to predict future resource usage of an application. The method further includes providing the prediction of further resources usage of the application as an input to an action component, wherein the action component is one of an anomaly detector or a reinforcement learner that drives a scheduler. The method additionally includes performing, by the action component, at least one of scheduling resources within the computing system or detecting a resources usage anomaly.

Abstract: Machine learning techniques are used to determine the viability of user data measuring the behavior of a new version of the program when compared with user data that measured the behavior of a previous version of the program. The machine learning techniques utilize statistical techniques in a non-conventional manner to train a system to learn from data obtained from the usage of both a new version of the program and a previous version that accounts for the variability in the user population, time variability of the results of the previous version, and feature coverage between the two test results in order to ensure the suitability of the user data in making estimations or predictions about the performance and reliability of the new version.

Abstract: Embodiments for automated testing of a virtualization management system are described. An example computer-implemented method for automated testing of a virtualization management system includes sending, by a test server, a test case to a plurality of instances of the system under test, the test case sent to each instance of the system under test via each interface from a plurality of interfaces supported by the system under test. The method further includes, for each instance of the system under test, performing multi-interface comparison. The comparison includes comparing, by the test server, responses to the test case from each of the interfaces. The method also includes in response to the responses from each of the interfaces being identical, storing the responses in an instance-response file corresponding to the instance. The method also includes reporting, by the test server, an error in response to the responses from each interface not being identical.

Abstract: An improved static program analysis procedure is provided by formulating a set of seeding configurations, and selecting a subset of queries posed by the static program analysis procedure. In response to one or more queries of the subset of queries being answered positively under at least one configuration of the set of seeding configurations, the one or more queries are determined to be valid queries. Each query of the valid queries is evaluated under each configuration of the set of seeding configurations to determine an accuracy score for each seeding configuration. A seeding configuration having a highest accuracy score is selected as a tool configuration to be used with the static program analysis procedure.

Abstract: A system for data management includes a root object, zero, one, or more member objects, and a processor. The root object is associated with a garbage collection root metadata. Each of the one or more member objects is associated with a garbage collection member metadata. The root object has a direct relation or an indirect relation to each of the one or more member objects. The processor is to determine that an object is the root object; determine whether the root object and the one or more member objects are to be garbage collected; and garbage collect the root object and the one or more member objects in the event that the root object and the one or more member objects are to be garbage collected.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program executable by at least one processing unit of a device. The program receives a test configuration for performing a set of operations on an application. The test configuration includes a first configuration component having a first type and a second configuration component having a second type. The program also processes the first configuration component with a first configuration component processor. The program further processes the second configuration component with a second configuration component processor. The program also performs the set of operations on the application based on the processing of at least one of the first and second configuration components.

Abstract: A web server, such as one operating with a test agent in a database system receives a request for executing a test. The request is sent by a test master to an endpoint of the web server. In response to receiving the request by the web server, without exchanging information between the test agent and the test master, the test agent performs a series of operations as follows. A complete set of test steps is determined for the test. A complete set of test data used to execute the complete set of test steps is determined. The complete set of test steps for the test is executed with the complete set of test data. A final test execution status is generated for the test. The test agent can make the final test execution status for the test available for the test master to retrieve by way of the web server.

Abstract: Embodiments utilize a unified testing framework (UTF) to automate browser-based API testing of web applications. Embodiments cause a browser to generate an authentication context for a user of the web application, and then test API functionality based on the established authentication context. The UTF is configured to run both UI testing and API testing. Furthermore, in order to facilitate running multiple API tests in a given testing session (potentially being performed in parallel), the UTF stores results of a given API test in a corresponding data island DOM node. Each data island node, generated for each respective API test being run in a given testing session, is identified by a unique global unique identifier (GUID) that is associated with the corresponding API test. Using this GUID, the UTF accesses the test results of each API test individually as the test results are asynchronously returned by the remote service being tested.

Abstract: A system and apparatus for enhancing the functionality and utility of an authentication process for web applications is disclosed.

Abstract: A server has a processor and a memory connected to the processor. The memory stores instructions executed by the processor to collect operating signals from machines, where each operating signal characterizes the state or a change in operational state of a designated application operating within a designated container, where the designated container is an isolated process in user space designated by an operating system kernel. The operating signals are compared to models that incorporate summarizations of data sets that represent observed benign operating signals and malicious operating signals for the designated application operating within the designated container. Risks associated with the operating signals are characterized.

Abstract: A flexible, adaptive performance test platform allows a test developer to customize performance tests to more realistically determine the impact of network behavior on a system under test. The test platform may be accessed through the use of a Graphic User Interface (GUI) by all developers within an enterprise to generate and execute performance tests prior to release of new systems by the enterprise. In one aspect, the test platform enables developers to share performance tests, thereby leveraging existing work product to reduce the overall system development time. In another aspect, the test platform enables developers to customize performance tests, providing the flexibility to easily specify a duration, scale, geography and/or resource for the test. In another aspect, the test platform enables developers to customize and monitor one or more metrics in accordance with the particular performance goals of the SUT, to enable a developer to more easily identify system issues.

Abstract: A computing system in a server environment receives a diagnostic data package, corresponding to a problem, from a client computing system and runs a problem-specific analyzer to generate additional problem-specific data. A root cause for the problem is identified along with a recovery action, based on the diagnostic data package and the additional problem-specific data. The root cause and recovery action are communicated to the client computing system.

Abstract: A computer-implemented method assessing the risk of a future crash occurring on a computer system is disclosed. Crash results are received from a crash analysis system. The crash results are analyzed, at a processor, to determine the likelihood of the future crash occurring on the computer system. Information regarding the likelihood of the future crash occurring on the computer system is provided to a user of the computer system.

Abstract: A storage system query mechanism and corresponding techniques for implementing queries are provided. Queries can be created on a client and server, where the client and the server are based on different programming languages, by providing a server-side meta-model and client-side meta-model. A base meta-model is provided having a plurality of base classes and a domain-specific injection point to allow domain specific meta-models to be injected into the base meta-model. Domain-specific query executors can be employed to process a query. Techniques are also provided for caching control path data in a storage array using one or more façade data classes and a refresh service to listen to refresh events that impact a validity of the cached data objects. Applications can optionally register domain specific query executors, object model providers and/or class loaders. Query results can be presented on a client device by providing a declarative data grid component as part of a graphical user interface.

Abstract: Examples of an application experiment system are provided that can manage and run experiments for software applications. In one embodiment, the application experiment system receives definitions for experiments and treatments for an application, runs experiments in response to requests from users of the system, automatically allocates treatments to users of the application, logs experiment data and treatment allocation data, and/or reports experiment results data. The application experiment system enables application developers to test changes or features in a precise, controlled environment on a limited user base before deciding whether to deploy changes or features to all users of an application.

Abstract: A method for generating a dump comprising data generated by a virtual system in a computing environment is depicted. The method comprises: initiating a dump process for dumping data generated by the virtual system and stored in guest memory; sending a dump request for the data from the virtual machine monitor to the trusted component; in response to receiving the dump request, generating a symmetric dump generating key; reading the data from the guest memory; encrypting the data with the symmetric dump generating key; encrypting the symmetric dump generating key with the public cryptographic key of the client system; providing the encrypted dump data and the encrypted symmetric dump generating key to the virtual machine monitor; generating a dump comprising the encrypted dump data and the encrypted symmetric dump generating key; and providing the dump to the client system.

Abstract: Systems and methods for debugging dynamically rendered content are described herein. A plurality of rules are defined and stored, wherein each rule includes a condition and an action, and wherein each action includes an instruction to render content within a webpage. A rule object is generated based on the plurality of rules, wherein the rule object includes executable code. The rule object is stored within an in-memory device disposed between a rules server and a transformation server. An error is detected during the execution of the rule object. In response to a user request, an encrypted security token is generated to access one or more rule debugging modules of the rules server.

Abstract: A method of generating test data is provided herein. The method includes generating a schema comprising a database table. The method also includes receiving a selection of the database table. Additionally, the method includes receiving one or more rule definitions for populating the database table. The method further includes generating a stored procedure for populating the database table based on the rule definitions and the schema.

Abstract: An optimized test data selection strategy references a sampling file that identifies data attributes that serve as the basis of the test data selection strategy. By analyzing fields and the corresponding field values of the sample imprint, a total number of test data selected for inclusion into a sample dataset is reduced. The test data selection strategy provides an efficient methodology for implementing a data comparison testing process.

Abstract: Identifying false test alarms to a developer. A code build is executed in a test system that includes computing functionality and computing infrastructure that is able to execute the build. Executing the code build includes running a plurality of system and integration tests on the code build. As a result of executing the code build, a system and integration test failure is identified. One or more characteristics of the system and integration test failure are identified. The characteristics of the system and integration test failure are compared to characteristics of a set of historical previous known false test alarms. False test alarms are failures caused by a factor other than a factor for which a test is being run. Based on the act of comparing, information is provided to a developer with respect to if the system and integration test failure is potentially a false test alarm.

Abstract: A computer system, having: a physical computer, which includes a processor and a memory; and an external apparatus, which is coupled to the physical computer and which includes a storage apparatus, the physical computer further includes: a virtualization module for providing at least one virtual machine; a first failure monitoring module for detecting a failure in the physical computer and the virtualization module; a first memory dump module for copying, to the external apparatus, a first area in the memory which is allocated to the virtualization module; a second failure monitoring module for detecting a failure in the virtual machine; and a second memory dump module for copying, to the external apparatus, a second area in the memory which is allocated by the virtualization module to the virtual machine.

Abstract: A debugging method is proposed in the disclosure. A computer running a program generates a master core dump file and one or more slave core dump files in response to a triggering event such as an internal failure. The core dump files are analyzed by another computer for debugging the program. The master core dump file includes an index list, and each entry of the index list corresponds to a slave core dump file of the one or more slave core dump files. The master core dump file can be the first to be transferred to the other computer. Based on the information in the index list, the other computer selectively requests one or more slave core dump files from the generated slave core dump files for debugging.

Abstract: An apparatus (100) in an example comprises a test-script generator (704) and selection logic (114). The test-script generator (704) serves to create a test script (116) through identification of currently-available elements (604, 606, 608, 610, 612, 614, 616, 618) of an application (106) under test. The test script (116) is employable to exercise the application (106). The selection logic (114) serves to identify elements (406, 408) of a currently-executing component script (402) within the test script (116), contemporaneous with execution of the test script (116), that may be affected by graphical user interface changes made to the application (106). The identification of the elements (406, 408) of the currently-executing component script within the test script (116), contemporaneous with execution of the test script (116), that may be affected by the graphical user interface changes by the selection logic is contemporaneous with the exercise of the application (106) by the test script (116).

Abstract: A process for finding potentially harmful malware dropper on an infected computer system includes the steps of a) identifying an executable file that is about to run, and b) providing a storage agent that stores a copy of said executable file for a later inspection.

Abstract: An objective of the present invention is to appropriately extract, or assist in extracting, a normal operation pattern from a normal operation log. A log file including information wherein a plurality of log records is ordered in time series is segmented into a plurality of log groups according to prescribed rules. A plurality of patterns which are configured by a plurality of events which are contiguous in time series is extracted from the plurality of log groups, and the patterns are associated with frequency information which represents how many log records the pattern is extracted from. The pattern to be outputted from the plurality of patterns is selected on the basis of an inclusion relation between the plurality of events which are contiguous in time series and configure a given pattern and the plurality of events which are contiguous in time series and configure other patterns, and on the basis of the frequency information which is associated with the patterns.

Abstract: Methods and arrangements for efficiently mining a control flow graph from execution logs of a distributed system. Using at least one text clustering technique, two text clusters are generated from the plurality of execution logs. At least one approximate template is generated based on the at least two text clusters. At least one refined template is created via refining the at least one approximate template using multimodal sequencing. The control flow graph is created based on the at least one refined template. An anomaly is detected in the control flow graph.

Abstract: Remotely testing a client device, the method including: implementing an interface of a messaging and presence protocol; starting a connection of the messaging and presence protocol between the client device and a server; initiating a test to execute steps of the test over the messaging and presence protocol connection; indicating information regarding results of the test to send over the messaging and presence protocol connection. Key words include remote testing and XMPP.

Abstract: A method for performing a regression session when testing a device under test (DUT), may include a. obtaining a coverage model of the DUT, and a verification session input file (VSIF) relating to a plurality of tests to be run on the DUT, the VSIF including an initial number of runs associated with each of the tests of the plurality of tests; b. performing a first iteration of the regression session in which each of the tests of the plurality of tests is run the initial number of runs associated with that test; c. calculating for that iteration an effectiveness grade of each run of the tests of the plurality of tests, and assigning a weight to each of the runs of the tests of the plurality of tests corresponding to the calculated effectiveness grade of that test run; an d.

Abstract: Systems and methods for branched development environments enable construction of development and deployment environments for use at various stages of software development and delivery. Various embodiments are configured to deliver these constructed environments to reproduce faithfully the state of an application at a given revision of the application's source or configuration. The branched development system can be configured to use the constructed environments to offer a variety of novel results and benefits that simplify the development, test, deployment, and debugging tasks commonly associated with software throughout its lifecycle.

Abstract: Various techniques for diagnostics, troubleshooting, and root-cause analysis are disclosed herein. In one embodiment, a method includes receiving operational data from a computing system and identifying an operational pattern based on the operational data. The operational pattern includes a temporal sequence of operations, events, or system states related to the computing system. The method also includes receiving an annotation and associating the received annotation with the identified operational pattern. The annotation identifies a reason, a cause, or a corrective suggestion corresponding to a violation of the temporal sequence.

Abstract: A method, computer program product, and system for testing an application on a GUI are provided. A request to perform a test of an application is received. The test uses a script that includes instructions to perform real actions on a GUI of the application. Execution of the script is initiated. A test recording is generated by capturing a first plurality of screenshots of the GUI during the test. In response to detecting an error during execution of the script, a baseline video is retrieved. The baseline video includes a second plurality of screenshots of the GUI from a successful execution of the script. An error message is issued. The error message includes at least a portion of the test recording and at least a portion of the baseline video.

Abstract: The present disclosure proposes a computer implemented method for selecting test cases to be executed on a terminal by creating a configuration code and applying this code to a set of test case selection tuples. The present disclosure also proposes a method for automatically creating a set of test case selection tuples, taking a source code as an input. The created set of test case selection tuples can be used in the above-mentioned method for selecting test cases. Finally, the present disclosure proposes a method for operating a program for selecting test cases having a user interface and a selection logic. The program may apply the above-mentioned method for selecting test cases by creating a configuration code and applying this code to a set of test case selection tuples.

Abstract: An approach is provided for collecting data for diagnosing a failure of a computer hardware device. After an indication of the failure of the computer hardware device that results in a full system crash is received, an address translation table of a central processing unit (CPU) of the computer hardware device is collected. A format of call stack frames of an operating system (OS) image of the computer hardware device is retrieved. Based on the collected address translation table and the retrieved format of the call stack frames, the call stack frames are retrieved and output to a computer file. Retrieving the call stack frames is performed by a service processor external to system processing units running OS images via a hypervisor of the computer hardware device. The service processor does not require an ambulance logical partition managed by the hypervisor.

Abstract: Provided are techniques for parsing a pre-existing test script for a graphical user interface (GUI) to identify a first GUI action in a first line of the pre-existing test script; parsing a model associated with the GUI to identify GUI actions and associated elements for the GUI actions in the model; identifying a corresponding element for the first GUI action in a second line, following the first line, that are identified by keywords and associated parameters that exist in the pre-existing test script and match actions in the model; identifying GUI actions in the pre-existing test script that match GUI actions in the model; and generating a new test script by adding the first GUI action and corresponding element to the pre-existing test script.

Abstract: As disclosed herein a method, executed by a computer, for enabling multi-tiered software stack diagnostic collection includes initiating, on a first tier of a multi-tiered software stack, a targeted diagnostics collection corresponding to a symptom of a failure, determining a symptom to a reason code mapping corresponding to the symptom in a product of a subsequent tier, and issuing a command to the product of the subsequent tier to initiate targeted diagnostics collection corresponding to the reason code. Problems or failures in a multi-tiered software stack environment may require analyses of programs or products corresponding to each tier of a multi-tiered software stack. The method described herein enables simultaneous collection of diagnostics for programs or products corresponding to each tier of a multi-tiered software stack. A computer system, and a computer program product corresponding to the method are also disclosed herein.

Abstract: Various embodiments are generally directed to generating logs recording events related to wakelocks at application and kernel levels, and then temporally aligning graphs of those events in a visual presentation to enable debugging of wakelocks. An apparatus to debug wakelocks includes a processor component; a capture component to intercept calls associated with application level wakelocks, the intercepted calls received by an application power manager of an operating system from application routines; and a relaying component to cooperate with the application power manager to provide indications of the intercepted calls to a system log generator of the operating system coupled to the application power manager, the system log generator to generate system log data comprising indications of events associated with execution of the operating system by the processor component and the indications of the intercepted calls. Other embodiments are described and claimed.

Abstract: A computer device may include logic configured to provide a centralized library for descriptive programming and other types of object descriptions to a testing script engine. The descriptive programming library may store test object descriptions for test objects associated with an application under testing. The logic may be further configured to provide a unification layer over all the object description types and to provide inheritance among the objects at the unification layer. The logic may be further configured to store a test object description, associated with a test object, in the descriptive programming library; identify a reference to the test object in a descriptive programming statement associated with the testing script engine; access the stored test object description in the descriptive programming library based on the identified reference to the test object; and identify an application object, associated with the application under testing, based on the stored test object description.

Abstract: A dump management apparatus having a memory; and a processor that executes a process including: selecting, in response to receiving a notification of an occurrence of a failure from a failure node of a parallel computer having a plurality of nodes, a plurality of nodes that are not scheduled to execute a job within at least a first time needed to perform dump processing of a memory of the failure node and have a memory capacity needed to perform the dump processing as dump-processing target nodes from among a plurality of nodes within a reference range near the failure node; selecting the dump-processing target nodes with a first priority according to which a plurality of adjacent nodes are preferentially selected as a candidate over a plurality of dispersing nodes from among candidates for the dump-processing target nodes; and causing the failure node to transfer a dump file inside the memory of the failure node to memories of the dump-processing target nodes.

Abstract: A method captures diagnostic trace information in a computer system having a plurality of software images. Information is received that is associated with a first failure in a first one of the plurality of software images. The received information is distributed to others of the plurality of software images. Further information is captured that is associated with a second failure in another one of the plurality of software images. The information associated with a first failure in a first one of said plurality of software images is combined with the information associated with a second failure in another of said plurality of software images, and the combined information is analyzed in order to determine a cause of the first failure.

Abstract: A method for performing a deferred system dump includes storing a preservation list referencing physical memory addresses allocated to pages by an initial operating system executing on a computer system. The method further includes identifying a subset of the pages that are at least partially allocated below a first physical memory address, relocating the subset to new physical memory addresses above the first physical memory address, and updating the preservation list with the new physical memory addresses. The method further includes transferring control of the computer system from the initial operating system to a subsequent operating system. The subsequent operating system accesses the preservation list to identify preserved pages. The method further includes assigning each of the preserved pages to an address segment in an address space of the subsequent operating system, storing a subset of the preserved pages, and freeing the preserved pages.

Abstract: Disclosed in some examples are systems, machine readable mediums and methods which automate testing of web-based application code by automatically generating test harnesses based on a specified configuration and test script, hosting the test harness, causing the test harness to be run to test the code, and delivering the test results to the user. In some examples, the specified conditions may specify one or more test environments corresponding to an execution environment. This allows users greater flexibility in support of testing libraries and support of testing environments. The end users of the software under test will be provided software that is better tested for many different environments.

Abstract: In one embodiment, a method is provided for using a server computer, creating and storing a first module name, a first indication of a first version, and a first signature for a first data model that is digitally stored in a digital electronic data storage unit; receiving a second data model from the data storage unit and identifying a second module name in the second data model; comparing the second module name of the second data model to the first module name of the first data model; determining that the first module name and the second module name comprise a same name, and in response thereto, identifying a second indication of a second version from a revision field of the second data model; using the server computer, comparing the second indication of the second version from the second data model to the first indication of the first version of the first data model; determining the first indication and the second indication indicate the same version, determining a second signature for the second data model

Abstract: A method of recording user-driven events within a computing system includes receiving an indication that a user interacted with a first graphical user interface (GUI) user interactive control. The method includes automatically searching at least one vicinity near the first GUI user interactive control for descriptive information associated with the first GUI user interactive control, and automatically recording a user-driven event that represents the user interaction with the first GUI user interactive control and includes the descriptive information.

Abstract: Optimizing deployment of a modular application in a runtime environment is provided. The optimizing includes: deploying application modules of the modular application, each application module having a module manifest and at least one application module having parts for execution, one or more module manifests include one or more references to parts of another application module, and parts required for execution of the application, the deploying is according to the module manifest; executing the modular application; determining that at least one deployed application module has no parts executing in the runtime environment; and adapting the module manifest so that the determined at least one deployed application module will not be deployed as part of the modular application in future deployments.

Abstract: A computer system and computer program captures diagnostic trace information in a computer system having a plurality of software images. Information is received that is associated with a first failure in a first one of the plurality of software images. The received information is distributed to others of the plurality of software images. Further information is captured that is associated with a second failure in another one of the plurality of software images. The information associated with a first failure in a first one of said plurality of software images is combined with the information associated with a second failure in another of said plurality of software images, and the combined information is analyzed in order to determine a cause of the first failure.

Abstract: The techniques described herein provide software testing of a candidate software system. In some examples, an interceptor intercepts at least one production request to a production software system. The duplicating proxy service causes the at least one intercepted request to be processed by the candidate software system being validated and the production software system being used to validate the candidate software system. The duplicating proxy service may then compare and/or analyze at least one candidate response to the intercepted request from the candidate software system and at least one production response to the intercepted request from the production software system.

Abstract: A leak detection system may be configured to receive a plurality of memory use reports periodically from a user device. The memory use reports may include an indication of memory that may be used and/or allocated by/to a particular process, such as a process that may currently be running on the user device. The memory use report may further provide a relatively granular view of the allocation of memory associated with the process, such as by type of memory and/or category of memory associated with the process. The leak detection system may use the plurality of memory use reports to generate a memory profile associated with the process and particular memory types and/or categories of memory allocation. By analyzing the memory profiles, the leak detection system may be configured to identify a memory leak associated with the process on the user device.

Abstract: A method for efficiently managing and analyzing log information is disclosed. In one embodiment, such a method includes providing a community database for a particular product and enabling a user to view a log file associated with the particular product. The method further enables the user to create a category and link a portion of a line of the log file to the category. The category is then submitted to a database administrator to accept or decline the category for admission into the community database. In the event the database administrator accepts the category into the community database, the category is stored in the community database and the portion of the line is linked to the category. Upon opening and viewing future log files, the category may then be used to label lines containing the portion. A corresponding apparatus and computer program product are also disclosed.