Abstract: A predefined number of matches is identified between records in a first file and records in a second file. For the matches, determine the span of the actual range of record positions in the second file relative to the positions of the operation records in the first file within which all matches were found. If the actual span is smaller than the span of a current defined range of record positions by at least a first threshold value, decrease the span of the current defined range. If the actual span is within a second threshold value of the span of the current defined range, increase the span of the current defined range. If an amount above a third threshold value of operation records in the first file are not matched to operation records in the second file, increasing the span of the current defined range.

Abstract: A method for comparing a first subroutine and a second subroutine in functionality, includes: defining a plurality of instruction sets, each instruction set associated with a corresponding instruction set process; obtaining a first program section and a second program section from a first subroutine and a second subroutine, respectively, and categorizing the first subroutine and the second subroutine to one of the instruction sets, respectively; performing a program section comparison process to select and perform one of the instruction sets according to the instruction set to which the first program section is categorized and the instruction set to which the second program section is categorized, so as to compare whether the first program section and the second program section have identical functions, and to accordingly determine whether the first subroutine and the second subroutine are equivalent in functionality.

Abstract: A program on a plurality of processing units executes test input data. In the case where an error occurs so that processing of the program is not completed normally, it is determined that a test performed by using the input data failed. Meanwhile, in the case where an error does not occur so that processing of the program is completed normally, if the same feature pattern as that of the input data is stored in a storing unit which stores feature patterns of the executed input data, it is determined that the test performed by using the input data succeeded, while if the feature pattern is not stored in the storing unit, the result of the test performed by using the input data is judged based on the result of comparing the expected data with result data of the program.

Abstract: A method includes, by one or more computing devices, determining instructions for a computing device to be evaluated, creating a first symbolic test driver including one or more of the instructions to be evaluated and a designation of a symbolic variable corresponding to a portion of the instructions, symbolically executing the instructions with respect to the symbolic variable, determining a test case from the results of the symbolic execution including one or more commands to execute the instructions with a given value for the symbolic variable, determining one or more calls to an object-oriented-programming component in the commands, creating a new symbolic test driver including the calls based on the determined calls, and subsequently symbolically executing the new symbolic test driver.

Abstract: A method of storing data on a storage medium includes determining a risk index associated with a performance of the storage medium, adjusting a refresh factor associated with at least a portion of the storage medium in response to determining the risk index, and performing a data refresh operation on the portion of the storage medium based at least in part on the on the refresh factor.

Abstract: A power supplying system is configured so that a power supply server for supplying power and a client for receiving power are connected through a bus line on which an information signal representing information and power exist superimposed on one another, and the information signal is exchanged between the power supply server and the client. To the bus line of the power supplying system, a monitoring apparatus to monitor at least one of the information signal and power information related to power is connected. The monitoring apparatus includes a receiving portion to detect an information signal existing on the bus line, and a display control portion to display at least one of the information signal and the power information exchanged between the power supply server and the client.

Abstract: A method and apparatus for generating automated test case scripts from natural language test cases is described. The method may include receiving a natural language test case for testing a software application. The method may also include parsing the received natural language test case to locate terms relevant to testing a software application within the natural language test case, selecting one or more of the terms, and causing a search of a testing framework system for automated testing script commands based on the selected terms. The method may also include generating an automated test case script that corresponds to the natural language test case based on results of the search.

Abstract: A system and method for performing a progressive fault injection process to verify software is provided. In some embodiments, the method comprises loading a software product into the memory of a testbed computing system, wherein the software product includes a function and a statement that calls the function. A data structure is updated based on an error domain of the function. The calling statement is executed for each of one or more error return codes of the error domain. For each iteration of the execution, a call of the function by the calling statement is detected, and, in response, an error return code of the one or more error return codes is provided in lieu of executing the function. The software product is monitored to determine a response to the provided error return code. In some embodiments, the error return code to provide is determined by querying the data structure.

Abstract: Aspects of the subject matter described herein relate to software validation. In aspects, code may be instrumented to generate certain records upon execution. The code may be further instrumented to generate start and stop records that correspond to the start and stop events of a scenario of a program. The start and stop event records allow correlation of the scenario with other records written to the log. With the correlation and appropriate instrumentation, a tool may determine performance, memory usage, functional correctness, and other characteristics of program at the granularity of the scenario.

Abstract: A system and method for error handling associated with a widget are disclosed. The system comprises a registration module, a communication interface, a command module, a manager monitoring module and an error detection engine. These entities are communicatively coupled to each other. The registration module registers a widget to be hosted on the host page. The host page is presented on a user device. The communication interface receives a notification indicating that the widget is ready to be displayed on the host page and sends the notification to the manager monitoring module. The manager monitoring module instructs the command module to generate a command to display the widget. The command is sent to the user device for displaying the widget. The manager monitoring module monitors the displayed widget. The error detection engine detects an error associated with the widget and performs an error correction procedure to the widget.

Abstract: A solution is proposed for analyzing a test of a software program comprising a plurality of software components, the test comprising a plurality of test cases each one for exercising a set of corresponding exercised software components. A corresponding method comprises the steps of receiving an indication of each failed test case whose current execution has failed, retrieving a suspicion attribute of each failed test case indicative of a change to the corresponding exercised software components since a previous execution of the failed test case, retrieving a change attribute of each failed test case indicative of a change to the failed test case since the previous execution thereof, retrieving a regression attribute of each failed test case indicative of a regression of the failed test case since the previous execution thereof, and classifying each failed test case into a plurality of disjoint classes according to the corresponding suspicion attribute, change attribute and regression attribute.

Abstract: A method, system and program product for recording a program execution comprising recording processor context for each thread of the program, results of system calls by the program, and memory pages accessed by the program during an execution interval in a checkpoint file. Processor context includes register contents and descriptor entries in a segment descriptor table of the operating system. System calls are recorded for each program thread, tracked by an extension to the operating system kernel and include returned call parameter data. Accessed memory pages are recorded for each program process and include data, libraries and code pages. The program address space, processor context, and program threads are reconstructed from checkpoint data for replaying the program execution in a different operating system environment.

Abstract: A method includes detecting user interaction with a first control of a user interface, identifying a property of the first control, and storing data representing the property of the first control in a memory. The method further includes dynamically generating an event for the first control by use of the property of the first control upon detecting user interaction with a second control and upon detecting an absence of an event corresponding to the first control being generated with respect to a user interface test program. An action responsive to the dynamically generated event is stored in an event log.

Abstract: Dynamic concolic execution of an application. A first hypotheses pertaining to a nature of test payloads that satisfy a specified property, and that are expected to satisfy a condition tested by the application's program code, can be generated. A plurality of first test payloads to test first hypothesis can be synthesized and submitted to the application during respective executions of the application. Whether each of the first test payloads actually satisfy the condition tested by the application's program code can be determined. When at least one of the first test payloads does not actually satisfy the condition tested by the application's program code, a second hypotheses that is expected to satisfy the condition tested by the application's program code can be generated. A plurality of second test payloads to test the second hypothesis can be synthesized and submitted to the application during respective executions of the application.

Abstract: Various method, system, and computer program product embodiments for facilitating upgrades in a computing storage environment are provided. In one such embodiment, one of an available plurality of rolling upgrade policies registering at least one selectable upgrade parameter for an upgrade window is selected. A node down tolerance factor is set for at least one node in the computing storage environment. The node down tolerance factor specifies a percentage of elements of the at least one node taken offline to apply the selected one of the available plurality of rolling upgrade policies during the upgrade window.

Abstract: The presently disclosed subject matter includes a system and method which enable to identify one or more causes for excessive energy consumption in a computer executing one or more processes. Information indicating that consumption of a computer-resource of at least one of said processes is greater than a predefined threshold is obtained and one or more threads of said at least one process which are in running state are identified. Thread performance information of at least one thread in running state is collected and used for identifying one or more functions that are the cause for said state of the respective thread. The identified functions are associated with their respective modules in order to identify one or more modules of said process, which are the cause for said excessive energy consumption.

Abstract: One embodiment of the present invention provides a technique for automatic diagnosis of regression test failures. Initially, an automatic regression test system provides the test results per configuration for a revision of the device under test. Next, each failing test is analyzed in conjunction with the information in the version control system that is used to manage the device under test in order to conclude what additional revisions that needs to be tested for each test and configuration in order to find the earliest failing revision. Next, a request is issued to the automated regression test system which performs the requested tests and provides back a list of test results. Next, another analysis takes places and if the earliest failing revision cannot be concluded for each failing test and configuration then another request is issues to the automated regression test system. This continues until the earliest failing revision can be concluded for each failing test and configuration.

Abstract: A method is provided to evaluate impact of a change in code of a depended upon component of a system stored in a computer readable storage device, upon a dependent component of the system, the method comprising: identifying a dependency relationship between a first component stored in a computer readable storage device and a second component stored in the computer readable storage device; in response to a determination that the second component depends upon the first component, configuring a computer system to obtain a first property evaluation corresponding to the first component; and in response to obtaining the first property evaluation corresponding to the first component, configuring the computer system to associate the first property evaluation with the second component, and obtain a second property evaluation corresponding to the second component, wherein the second component is associated with the first property evaluation.

Abstract: According to some embodiments, a system and method for determining a value for an error code for a program operation; determining whether the operation supports postponing a determination of an occurrence of an error for the operation; proceeding to evaluate a next operation in an instance the operation does support postponing the determination of an occurrence of an error for the operation; and checking the error code for the operation in an instance the operation does not support postponing the determination of an occurrence of an error for the operation.

Abstract: Systems, methods, and computer storage mediums are provided for mitigating damage to data caused by a computer process having a corrupted pointer. An exemplary method includes receiving a pointer to a memory address. The pointer is received in conjunction with a command of the computer process to access data stored at the memory address, where the data is intended to be stored in a memory segment that allows for read-only access. The memory segment that includes the memory address is analyzed to determine a modification state for the memory segment, where the modification state indicates the type of access that the memory segment allows. The computer process is halted when the modification state indicates that the memory segment allows for other than read-only access.

Abstract: Systems, methods, and non-transitory computer-readable storage media for receiving historical data describing behavior of human subject-matter experts, wherein the historical data links customer problems with solutions, receiving a plurality of human-generated algorithms describing patterns for linking customer problems with solutions based on problem-specific diagnostic data, comparing each algorithm of the plurality of algorithms with the historical data to determine respective predictive scores for linking a customer problem type with a particular solution, and ranking at least part of the plurality of algorithms based on the respective similarity scores.

Abstract: Systems and methods for monitoring operational performance of at least one application containing no explicit instrumentation are described. Data relating to the operational performance of the application can be obtained and provided to a telemetry server for analysis without the use of diagnostic instrumentation within the application. Generic and targeted performance data can be obtained using responsiveness components within a computing operating system.

Abstract: Provided is a malfunction influence evaluation system comprising a controller simulator that simulates the operation of a controller, an input apparatus that provides input data to the controller simulator, a simulation manager that exercises integrated management of the operation of the input apparatus and the controller simulator, and a database wherein malfunction information and simulation conditions to be referred to by the simulation manager is stored. The controller simulator retains a control program for the controller and an analysis unit, and the analysis unit has a propagation flag tracking function wherein propagation flags are assigned to a variable within the control program, bits of the variable are set by inputting a prescribed value thereto as a malfunction input value, the bits are propagated each time the variable is involved in a calculation within the control program, the states of propagation of the bits are tracked, and the result thereof is output.

Abstract: An apparatus is provided for facilitating bulk assignment of test cases to a test cycle. The apparatus may include at least one memory and at least one processor configured to enable selection, via a user interface, of test cases to assign the test cases to a designated test cycle. The test cases are designated for testing or execution of functions of at least one application. The processor is also configured to automatically calculate an estimated duration of time in which to complete the testing or execution of the functions in response to receipt of indications of selections of the test cases via the user interface. The processor is also configured to provide visible indicia in the user interface indicating the estimated duration of time in which to complete the testing or the execution of the functions of the application. Corresponding computer program products and methods are also provided.

Abstract: Some embodiments described herein provide a system to facilitate determining a solution for a software product crash. During operation, a server can receive multiple crash reports, wherein each crash report corresponds to a crash instance of the software product. The crash reports can be received from client systems where the product was executing before the crash. The server can then generate a description for each crash instance based on the corresponding crash report. Next, the server can create a crash report page that visually organizes each of the crash descriptions. Finally, the crash report can be displayed to a user to facilitate determining a solution to at least some of the crash instances.

Abstract: A method is integrated into the local operating system of a test machine. The disclosed technique preferably uses a master copy of one or more data objects from a first location to create virtual data objects (e.g., files or folders) that appear to be part of a file system mounted to a test machine in a second location. This disclosure describes a “projection” method and computer program that enables access to a destination object at a target location immediately upon initiation of a copy command at a source location while a copy operation is carried out in a background manner.

Abstract: A system for analyzing one or more process of software defect handling using one or more percentile-based statistical metric is provided herein. The system may include: a monitoring unit that is configured to monitor one or more processes of software defect handling, to yield monitored samples. The system further includes a percentile-based generator configured to generate one or more statistical metric that are at least partially based on percentile, further based on the monitored samples and further responsive to user selection; and a statistical calculation unit configured to apply the generated one or more statistical metric to real-time handling time samples obtained from the one or more processes of software defect handling, to yield a percentile-based analysis of the processes of software defect handling. The system may further include and a visual representation unit configured to visually present the percentile-based analysis responsive to preferences specified by the user.

Abstract: Provided is a code analysis method, a code analysis system and a computer storage medium. The method includes: obtaining a code change list; analyzing the code change list, obtaining a change list corresponding to each type of programming languages from the code change list, determining a mapping relationship between the change list and the type of programming languages; obtaining code analysis tool information and analysis rule information according to the mapping relationship, and generating an execution solution; and calling a code analysis tool and an analysis rule according to the execution solution to perform the code analysis and obtain a code analysis result. Examples of the present disclosure may integrate multiple code analysis tools and analysis rules, meet requirements of the code analysis on different types of programming languages, reduce workload of a developer and a tester, and increase efficiency of the code analysis.

Abstract: A test data extraction and persistence technique that relies on a data domain based storage infrastructure is disclosed. In operation, a test data server receives a test data query that specifies selection parameters for selecting test data and any transformation operations to be performed on the test data. The test data server identifies domains associated with the selection parameters and traverses the tables in the database based on the identified domains to extract test data that satisfies the selection parameters. The test data server optionally performs transformation operations, such as masking operations, specified by the test data query on the extracted data. The identified domains are stored such that test data that satisfies the test data query may be extracted from the database repetitively without reevaluating the test data query each time.

Abstract: This disclosure relates generally to software development, and more particularly to systems and methods for improved software testing project execution. In one embodiment, a software testing system is disclosed, comprising: a processor; and a memory storing processor-executable instructions comprising instructions for: obtaining a software test execution request including one or more software test cases to execute; identifying one or more software test environmental parameters; determining one or more computing systems for performing software test execution, based on the one or more software test environmental parameters; generating one or more configuration settings associated with initiating or terminating software test execution on the one or more computing systems; and storing the one or more configuration settings.

Abstract: An information processing apparatus that executes an operating system, the apparatus including a panic process unit configured to stop the operating system when the operating system has detected an error, a mapping process unit configured to assign, to the operating system stopped by the panic process unit, a second memory area which is other than a first memory area being used by a kernel of the operating system before stop or by a hypervisor that controls the operating system before stop of the operating system, a reactivation process unit configured to reactivate the operating system by using the second memory area as a usage area, and a memory dump process unit configured to read data in the first memory area, and to write the data to a dump file after the operating system is reactivated.

Abstract: Various embodiments are disclosed herein including systems and methods for implementing exception-based error handling in asynchronous, parallel, multi-threaded, and other distributed systems. Embodiments implement exception-based error handling in asynchronous workflow systems, providing try/catch blocks and tree-based cancellation of pending and currently executing activities.

Abstract: This document discusses, among other things, a method of testing an Application Programming Interface (API) call that includes receiving data identifying a schema associated with web services together with an API call. Various example embodiments may relate to accessing a data repository associated with the schema to identify an API response corresponding to the API call. In some example embodiments, a message is returned that is based on a determination of whether the API call is valid. The example message may simulate an API response from web services.

Abstract: In a computer system, a memory dump of a multi-threaded process can be created to contain information on all the threads without terminating the process, if the process uses user threads.

Abstract: A useful embodiment of the invention is directed to a method associated with a computer program comprising one or more basic blocks, wherein the program defines and uses multiple data structures, such as the list of all customers of a bank along with their account information. The method includes identifying one or more invariants, wherein each invariant is associated with one of the data structures. The method further includes determining at specified times whether an invariant has been violated. Responsive to detecting a violation of one of the invariants, the detected violation is flagged as an anomaly.

Abstract: Accessing a problem report data store including customer problem reports. Each customer problem report includes configuration and platform data. Calculating a number of instances each platform is stored, and identifying platforms that satisfy a platform threshold. Calculating a number of instances each configuration is stored, and identifying configurations that satisfy a configuration threshold. Calculating a number of instances each platform is associated with each configuration, and generating a data structure with a plurality of nodes and edges. Each of the nodes identifies one of the platforms and configurations. The weight of the edge connecting a platform to a configuration indicates a number of instances that the platform is associated with the configuration in the data store. Identifying a weighted edge that satisfies a weight threshold, where the weighted edge connects a first platform to a first configuration and, in response, generating a test case for development of a software product.

Abstract: A stack trace associated with an application program is received and at least one recognizable term is searched for in the stack trace. A digital signature is generated from at least a portion of the stack trace that includes the at least one recognizable term. If the digital signature matches a known digital signature among a plurality of known digital signatures, the stack trace is grouped with other stack traces associated with the known digital signature. Method call graphs in grouped stack traces may be analyzed to determine common pathways leading to an error.

Abstract: A solution is proposed for analyzing a test of a software program comprising a plurality of software components, the test comprising a plurality of test cases each one for exercising a set of corresponding exercised software components. A corresponding method comprises the steps of receiving an indication of each failed test case whose current execution has failed, retrieving a suspicion attribute of each failed test case indicative of a change to the corresponding exercised software components since a previous execution of the failed test case, retrieving a change attribute of each failed test case indicative of a change to the failed test case since the previous execution thereof, retrieving a regression attribute of each failed test case indicative of a regression of the failed test case since the previous execution thereof, and classifying each failed test case into a plurality of disjoint classes according to the corresponding suspicion attribute, change attribute and regression attribute.

Abstract: A multithreaded computing environment for capturing diagnostic data includes initiating a trap delay component having a delay threshold in response to a monitor determining that the computing environment is in a predetermined invalid state. The multithreaded computing environment for capturing diagnostic data also includes recording, by a first thread, diagnostic data for the computing environment. The trap delay component delays the step of recording diagnostic data until the monitor determines that the predetermined invalid state has been repeated for at least one of a total count or a period corresponding to a predetermined indicator that it is a state other than a transient state of the computing environment. The transient state corresponds to a transition of the computing environment by one or more other threads from a first valid state to a second valid state.

Abstract: The embodiments provide a data processing apparatus including a runtime check identifier configured to determine, in response to a request to execute a function of the application, whether a runtime check descriptor corresponding to the function is stored in a database and select the runtime check descriptor if the runtime check descriptor is determined as stored in the database. The selected runtime check descriptor provides, in part, at least one configuration check of a component related to an execution of the function. The data processing apparatus also includes a system component configured to invoke a system management tool to perform the at least one configuration check, and a runtime check controller configured to receive results of the at least one configuration check and perform at least one action specified in the selected runtime check descriptor based on the received results.

Abstract: Systems and methods are disclosed herein to a method for reusing test automation framework across multiple applications, the method comprises receiving a selection of one or more test scripts from a user to test an application; creating an execution list containing every selected test script; loading the instructions of the test script into the computer-readable memory when the test script is found in the test script repository; executing the test script testing the application according to the instructions defined in the test script and according to computer instructions defined by the utility functions or the common functions when the test script calls either the common functions or the utility functions; checking the application's status after the test terminates operation; and recovering and closing the application if the application failed before executing a second test script testing the application.

Abstract: Systems and methods are disclosed herein to a method for reusing test automation framework across multiple applications, the method comprises receiving a selection of one or more test scripts from a user to test an application; creating an execution list containing every selected test script; loading the instructions of the test script into the computer-readable memory when the test script is found in the test script repository; executing the test script testing the application according to the instructions defined in the test script and according to computer instructions defined by the utility functions or the common functions when the test script calls either the common functions or the utility functions; checking the application's status after the test terminates operation; and recovering and closing the application if the application failed before executing a second test script testing the application.

Abstract: Systems and methods are disclosed herein to a method for reusing test automation framework across multiple applications, the method comprises receiving a selection of one or more test scripts from a user to test an application; creating an execution list containing every selected test script; loading the instructions of the test script into the computer-readable memory when the test script is found in the test script repository; executing the test script testing the application according to the instructions defined in the test script and according to computer instructions defined by the utility functions or the common functions when the test script calls either the common functions or the utility functions; checking the application's status after the test terminates operation; and recovering and closing the application if the application failed before executing a second test script testing the application.

Abstract: A machine and methods for reassign the execution order of program steps of a multi-step test program is disclosed. In an embodiment a machine for evaluating an error in a software program includes a microprocessor coupled to a memory, wherein the microprocessor is programmed to evaluate the error by (a) providing program steps of the software program, (b) assigning a position number to each program step, (c) performing an evaluation run on the program steps, (d) evaluating a performance of each program step, (e) rearranging the position number of each program step based on the performance of each program step, and (f) repeating steps (c)-(e).

Abstract: In accordance with aspects of the disclosure, systems and methods are provided for monitoring one or more classes for detecting suspected memory leaks in a production environment. The systems and methods may include identifying which of the one or more classes hold at least one static or non-static field of collection or array type, accessing the one or more classes that hold the at least one static or non-static fields of collection or array type, and tracking a size for each field of each class by periodically sampling the size of each field over an interval, processing the size data for each field of each class, and detecting suspected memory leaks of each class by identifying which of the one or more fields of each class exhibits suspect behavior in the size over the interval.

Abstract: Testing a system under test includes intercepting, within a proxy system, a request from a client system sent to the system under test. The request is analyzed within the proxy system and sent to the system under test. Within the proxy system, a response from the system under test sent to the client system is intercepted. The response is instrumented creating a modified response indicating test coverage according to the request. The modified response is sent to the client system.

Abstract: An Entity Types File (ETF) is automatically generated from a high-level software description, where the software description describes software to be managed by middleware to achieve high availability. An ETF generation method comprises receiving the software description that describes interfaces and dependency between components of the software; verifying the software description in accordance with constraints imposed by middleware specifications; based on the verified software description, automatically creating a hierarchy of entity types and associations among the entity types compliant with the middleware specifications; and outputting the entity types and the associations as the ETF for subsequent generation of a configuration of the middleware for availability management.

Abstract: A process for determining a problematic condition while running software includes: loading a first pattern data set having a symptom code module, a problematic condition determination module, and a set of responsive action module(s), generating a runtime symptom code in response to a first problematic condition being caused by the running of the software on the computer, determining that the runtime symptom code matches a symptom code corresponding to the first pattern data set, determining that the first problematic condition caused the generation of the runtime symptom code, and taking a responsive action from a set of responsive action(s) that corresponds to the first problematic condition.

Abstract: Embodiments provided a formalized set of intermediate analysis contexts that are relevant for analysis checks of target code. Such intermediate analysis context may include, but are not limited to, the development phase of targeted code, the type or state of the targeted code, a source manipulating the targeted code, a purpose for the targeted code, or other development or runtime requirements. Accordingly, embodiments dynamically identify a current analysis context under which targeted code is being developed and can then execute rules based on knowledge of what contexts the rule(s) may apply. More specifically, analysis rules can describe (e.g., via metadata) those context conditions under which a rule can run. Based on such description and the current context, those rules that have been configured to apply to such context conditions can be executed.

Abstract: A method of determining whether a set of constraints is satisfiable may include identifying a set of constraints associated with a software module. The method may also include modeling a string associated with a string constraint of the set of constraints as a parameterized array. Further, the method may include determining the satisfiability of the set of constraints based on a representation of the string constraint as a quantified expression. The satisfiability of the set of constraints may also be based on elimination of a quantifier associated with the quantified expression such that the string constraint is represented as a numeric constraint. The representation of the string constraint as a quantified expression may be based on the parameterized array that is associated with the string.