Abstract: Two user sessions can run concurrently on the same computer. A module executed by a first user instantiates a session manager in a first user session. The session manager receives input identifying a second user and providing credentials for the second user. A backup is made of auto-run and logon registry keys. A control file is created that directs actions in the second user session. The second user's credentials are registered in the registry file. The first session continues to execute while the second user is automatically logged on based on the registry auto login keys. The session manager is notified that login of the second user is complete. The session manager rewrites the auto login keys to the first user keys stored in the backup. The second user is logged off. The first user is automatically reconnected based on the rewritten registry keys.

Abstract: A system and method for testing in a database system. In one embodiment, a method includes receiving an indication of one or more changes to a software application, wherein each change corresponds to a different version of the software application. The method further includes generating one or more virtual machines for a version of the software application in response to the indication, wherein the one or more virtual machines test the version of the software application.

Abstract: A mechanism for performing verification of template integrity of monitoring templates used for customized monitoring of system activities. A method of embodiments of the invention includes calculating a first hash code for a monitoring template, the monitoring template to customize a performance monitor to serve as a universal monitor to facilitate a plurality of monitoring tools to perform monitoring of activities of a plurality of system components of the computer system, extracting the first hash code from the monitoring template, and calculating a second hash code for the monitoring template. The method further includes verifying integrity of the monitoring template by comparing the first hash code with the second hash code, and the integrity of the monitoring template is determined to be satisfactory if the first hash code matches the second hash code.

Abstract: Techniques are provided for isolating faults in a software program by providing at least two code paths that are capable of performing the same operation. When a fault occurs while the one of the code paths is being used to perform an operation, data that indicates the circumstances under which the fault occurred is stored. For example, a fault-recording mechanism may store data that indicates the entities that were involved in the failed operation. Because they were involved in an operation that experienced a fault, one or more of those entities may be “quarantined”. When subsequent requests arrive to perform the operation, a check may be performed to determine whether the requested operation involves any of the quarantined entities. If the requested operation involves a quarantined entity, a different code path is used to perform the operation, rather than the code path from which the entity is quarantined.

Abstract: A service based application integrated testing apparatus, system and method is provided. The service based application integrated testing apparatus comprises an application integrated testing unit performs an integrated test on the at least one component service and the service based application by use of a control flow and a data flow, which are generated from an interaction between the at least one component service and the service based application.

Abstract: Disclosed is a novel computer implemented system, on demand service, computer program product and a method that leverages combined concrete and symbolic execution and several fault-localization techniques to create a uniquely powerful tool that automatically detects failures and localizes faults in PHP Web applications. The fault-localization techniques evaluated combine variations on the Tarantula algorithm with a technique based on maintaining a mapping between executed statements and the fragments of output they produce, mapping of conditional results, and values returned from function calls. These techniques have been implemented in a tool called Apollo, and evaluated by localizing 75 randomly selected faults that were exposed by automatically generated tests in four PHP applications. Our findings indicate that, using our best technique, 87.

Abstract: A system including a vendor computer system. The vendor computer includes a test controller and a resource controller. The test controller is configured to provide a central access point to the vendor computer system and to manage test cases. The resource controller is configured to control testing of software products. The resource controller allocates cloud resources in a cloud network to test the software products via the test case.

Abstract: In one embodiment, a method of providing a test framework in an on-demand services environment can include: accessing a plurality of tests via plug-ins to a core platform of the test framework; receiving, by a user interface, a selection of tests for execution from the plurality of tests, where the selected tests are configured to test a plurality of layers of a product; executing, by an execution engine coupled to the core platform, the selected tests; storing test results for the executed selected tests on a configurable repository; and reporting the stored test results in a summarized form on the user interface.

Abstract: A method for optimizing tests of a software application. The method includes determining a test run time for each test of a plurality of tests of a software application; and dividing the tests into a plurality of test groups. The method further includes assigning a worker system of a plurality of worker systems to each test group; and causing the worker systems to run the tests.

Abstract: A method and system for information processing and test case generation. The system includes: a pattern storage module for storing at least one resource identifier patterns, where the resource identifier patterns are extracted from a server code of a web application by analyzing the server code; a client code analyzer module for analyzing a client code generated from the server code and finding at least one event sequences matching with the resource identifier patterns; and a test case generator module for fetching a client state established from the client code, executing the event sequences on the client state, and generating a test case, where the test case includes a second resource identifier generated as an execution result of the event sequence.

Abstract: A method for testing a software application used in a database system. The method includes receiving multiple changes to the software application, and running a plurality of tests on the software application. The method further includes determining if any of the tests fail, and if any of the tests fail, identifying which changes caused the failures.

Abstract: In one embodiment, a method includes analyzing one or more first numeric constraints and one or more first string constraints associated with a software module including one or more numeric variables and string variables; inferring one or more second numeric constraints applying to specific ones of the string variables; inferring one or more second string constraints applying to specific ones of the numeric variables; representing each one of the first and second numeric constraints with an equation; representing each one of the first and second string constraints with a finite state machine; and validating the software module with respect to one or more requirements associated with the software module by attempting to solve for a solution including one or more values for specific ones of the numeric and string variables that satisfies all the first and second numeric constraints, all the first and second string constraints, and all the requirements.

Abstract: A mobile device test framework is used in combination with client controllers and device controllers so that a single mobile device API test can be used with mobile devices having different operating system platforms. The client controllers can provide information specific to the client and the device controllers can provide information needed to apply the test to each of the mobile device platforms. The test framework can navigate through the controls of the mobile device GUIs and input information. The test framework can then check that the text and images displayed by the mobile devices match the expected information.

Abstract: Embodiments of the invention generally relate to injection context based static analysis of computer software applications. Embodiments of the invention may include selecting a sink within a computer software application, tracing a character output stream leading to the sink within the computer software application, determining an injection context of the character output stream at the sink, where the injection context is predefined in association with a state of the character output stream at the sink, identifying any actions that have been predefined in association with the identified injection context, and providing a report of the actions.

Abstract: A program trace is obtained and events of the program trace are traversed. For each event identified in traversing the program trace, a trace slice of which the identified event is a part is identified based on the parameter instance of the identified event. For each trace slice of which the identified event is a part, the identified event is added to an end of a record of the trace slice. These parametric trace slices can be used in a variety of different manners, such as for monitoring, mining, and predicting.

Abstract: Testing a dashboard framework includes creating a model that captures the states of a GUI application and validates the states of the application by comparing it with benchmarks. The testing can include user interaction between the captured states of the GUI application. The ability to provide testing based upon recorded states of a web application can enable the test system to adapt to changes to the GUI software during product development or modification. Testing a dashboard framework is more efficient and flexible testing methods for GUI software.

Abstract: User interface elements are identified and cataloged into a user interface inventory database keyed on a global user interface element identifier. Information is collected for user interface elements activated in an executing application or applications. Scenario information is collected and is used to update the user interface inventory database. Scenario information includes information concerning user interface element usage, state changes, etc. in time. The described information can be collected over a period of time and from a number of different computer systems. The information can be analyzed to determine and quantify usage and testing of user interface elements. The analyzed information can be used to determine how thoroughly a user interface element has been tested, how often the user interface element works as expected, most commonly used user interface elements and other information. The collected information can be used to track, quantify and identify ownership of user interface elements.

Abstract: In a method, system, and computer-readable medium having instructions for performing asynchronous testing of an application that is occasionally connected to an online services system, metadata describing at least a portion of an online services database is retrieved and the at least a portion of the online services database is authorized for replication at a software application, information is determined for an entity for an application database from the metadata, a request is sent for a database using the software application interface and the request has an asynchronous operation call to the database for the entity, an execution of the asynchronous operation call is recorded within a callback function, a response is received for the asynchronous operation call, and a result is determined for the software application performance.

Abstract: A staggered execution environment is provided to safely execute an application program against software failures. In an embodiment, the staggered execution environment includes one or more probe virtual machines that execute various portions of an application program and an execution virtual machine that executes the same application program within a time delay behind the probe virtual machines. A virtualization supervisor coordinates the execution of the application program on one or more probe virtual machines. The probe virtual machines are used to detect and correct software failures prior to the execution virtual machine encountering them. The virtualization supervisor embargos output data in order to ensure that erroneous data is not released which may adversely affect external processes.

Abstract: Techniques for debugging applications are provided. Access to an application is controlled by a wrapper. The wrapper intercepts calls to the application and records the calls. The calls are then passed to the application for processing. The recorded calls form a log which may be analyzed or mined to detect error conditions or undesirable performance characteristics associated with the application independent of source associated with the application.

Abstract: In one embodiment, analyze client-tier source code of a client-server software application to extract one or more software modules that handle user-input data of the software application. For each one of the software modules, extract from the software module one or more user-input constraints placed on the user-input data, comprising: analyze source code of the software module to determine one or more failure points in the source code; perform symbolic execution on the software module to extract one or more first expressions that cause the software module to reach the failure points, respectively; obtain a second expression as the disjunction of all the first expressions; obtain a third expression as the negation of the second expression; and extract the user-input constraints from the third expression. Determine one or more user-input data that satisfy all the user-input constraints.

Abstract: Embodiments of methods and systems for analyzing performance of an application are provided. In that regard, an embodiment of a method for analyzing performance, among others, comprises collecting performance metric data from the application over time; segmenting the performance metric data into time segments representing sets of contiguous time samples which exhibit similar performance metric behaviour; determining the presence of an anomaly in a time segment; and correlating the anomalous segment with other data available to the system to determine the cause of the anomaly.

Abstract: The present invention is directed to methods and systems of testing computer-readable code. The method includes executing a first testing module in a computer browser; launching a second testing module in the computer browser under control of the first testing module; locating an executable portion of a web-based application with the first testing module and ascertaining operational characteristics of the executable portion with the second testing module; and producing test results from the operational characteristics.

Abstract: Dynamically isolating application servers, wherein only active application servers are indicated to client applications to prevent access to inactive application servers by the client applications. A central server of a distributed system determines a state of application servers in a system, and generates a list of application servers that includes all application servers of the system including an indication of the state of the application servers. The central server also generates a filtered list of application servers that excludes inactive application servers or application servers in an inactive mode. The filtered list is passed to client applications, which enables the client applications to only access the active application servers, but not access the inactive application servers.

Abstract: Systems, devices, methods, and articles of manufacture employing repair modules are provided. The modules may be automatically deployed in conjunction with dependency mechanisms upon identifying a malfunctioning application. The modules may be specifically tailored for certain diagnosis or repair and may be selected for deployment to a second application using information regarding the malfunction of a first application.

Abstract: This document discusses, among other things, a method of testing an Application Programming Interface (API) call that includes receiving data identifying a schema associated with web services together with an API call. Various example embodiments may relate to accessing a data repository associated with the schema to identify an API response corresponding to the API call. In some example embodiments, a message is returned that is based on a determination of whether the API call is valid. The example message may simulate an API response from web services.

Abstract: A method for testing an application in a virtual computer system includes transmitting a request to select one of first and second conditions of a test of the application from a first virtual machine to execute the test of the application to a second virtual machine to control the virtual computer system via a virtual computer monitor, generating, if the virtual machine monitor receives the request to select the one of the first and second conditions of the test of the application, a clone of the first virtual machine by the virtual machine monitor, and executing the test of the application based on the first condition in the first virtual machine while executing the test of the application based on the second condition in the generated clone of the first virtual machine.

Abstract: A computerized method, computer system, and a computer program product for processing an execution request within different computing environments. Execution requests and generated reference information are forwarded to the different computing environments, where the requests are processed using the reference information. Results of the processed execution requests are collected from the different computing environments. The results are compared to find any discrepancy, possibly giving indication of a software or hardware error.

Abstract: The invention aims to provide a method and a system on chip able to detect at once hardware and software errors to prevent manipulations for retrieving cryptographic keys, inserting or suppressing instructions to bypass security processes, modifying programs or memory content etc. The system on chip comprises a core including at least two processors, registers, and a data consistency check module. The core is connected to at least one set of memories containing zones for instructions of a first program and of a second program, said instructions being to be executed respectively by the first and second processor, which respectively produce and store result data into the registers and the memories.

Abstract: A computer readable medium storing a program causing a computer to execute a process for verification support, the process includes: acquiring information of a timing of transmission of a process request for operating a program to-be-verified; acquiring first record information of a transfer process in a time zone corresponding to the acquired timing of the transmission, from a transfer device which transfers the process request to any of a plurality of information processing devices capable of running the program to-be-verified and which records the transfer process; specifying the information processing device to which the process request has been transferred, on the basis of the acquired first record information of the transfer process; and acquiring second record information of a process in the time zone corresponding to the timing of the transmission, from the specified information processing device.

Abstract: Test template may comprise a source code template instruction associated with source code commands. The source code template instruction is utilized in generation of a test. The generation of instructions associated with the source code template instruction takes into account utilization of shared resources by both the source code commands and by generated instructions that are generated by other template instructions.

Abstract: A method provides for a way to test coverage data used in testing small computing platforms by assigning unique signatures to each node in the control flow graph and embedding control function calls. Signatures are embedded into the program during compilation time using the custom parser. When the program is executed the “exercised” signatures sequence is checked for correctness and used for deriving test coverage metric. This metric is used for improving unit and black-box tests. Thus, a way to collect the path-based test coverage with minimal memory and code/size impact on target system is provided.

Abstract: An online marketplace for distributing software applications is established. From the online marketplace, devices are enabled to select respective ones of the software applications and initiate testing of the selected software applications in connection with testing tools operating in respective secure testing environments that shield the devices from potential adverse effects arising from testing the selected software applications. The testing tools generate testing data relating to one or more criteria for certifying the selected software applications. For each of one or more of the selected software applications, a determination is made whether or not to classify the software application as a certified software application based on an evaluation of the testing data generated during the testing of the software applications initiated by a plurality of the devices.

Abstract: The consistency of the heading expressions used in each screen in a plurality of evaluated screens is exhaustively and reliably evaluated. The GUI evaluation system comprises: GUI information storage means for storing GUI information that concerns heading included in an evaluation target screen and includes information indicative of heading expression which is the expression used for the heading; heading group specification means for grouping headings included in each evaluation target screen by expression used for the headings in accordance with the GUI information stored in the GUI information storage means; and heading expression evaluation means for evaluating a consistency of heading expressions between a plurality of evaluation target screens by comparing heading groups that are grouped by the heading group specification means and included in all possible combinations of two of the plurality of evaluation target screens.

Abstract: One embodiment described herein is directed to a method practiced in a computing environment. The method includes acts for determining test suite effectiveness for testing for concurrency problems and/or product faults. The method includes identifying a plurality of synchronization primitives in a section of implementation source code. One or more of the synchronization primitives are iteratively modified and a same test suite is run for each iteration. For each iteration, a determination is made whether or not the test suite returns an error as a result of modifying one or more synchronization primitives. When the test suite does not return an error, the method includes providing to a user an indication which indicates at least one of a test adequacy hole for the test suite; an implementation source code fault; or an equivalent mutant of the implementation source code.

Abstract: The present invention is related to a method, a system and a computer readable device for authenticated configuration used for configuration of software probes in software modules to be tested in an electrical mobile device. The invention will create and make use of a configuration file by inserting an authentication signature, Probe Identifications (PID) and Probe Locations (PL).

Abstract: A system for providing software performance counters includes an operating system that receives a first request of a first application to monitor performance of a second application, the first request identifying a type of event to monitor during the execution of the second application. The operating system determines that the event is a software event, monitors the performance of the second application with respect to the type of the software event, and updates a counter associated with the type of the software event based on the monitoring. Further, the operating system receives a second request of the first application for performance data associated with the type of the software event counter, and provides the value of the counter to the first application.

Abstract: A method of analyzing a computer program under test (CPUT) using a system comprising a processor and a memory can include performing, by the processor, static analysis upon the CPUT and runtime analysis upon at least a portion of the CPUT. A static analysis result and a runtime analysis result can be stored within the memory. Portions of the CPUT analyzed by static analysis and not by runtime analysis can be determined as candidate portions of the CPUT. The candidate portions of the CPUT can be output.

Abstract: A software quality assurance tool (“IVRT”) for VoiceXML applications is described. IVRT makes speech and telephony irrelevant to the testing of VoiceXML logic. IVRT follows a machine-readable “Test Plan” to execute the logic of an application. The Plan provides the results of telephony interactions. Testing is done without live callers, and runs at computer speed. A Plan contains any number of calls, to guide the application execution through all logic paths. The tool executes the application in a live environment with respect to all non-telephony functions, particularly web interactions, to test the application's web logic. IVRT executes multiple threads, acting as simultaneous callers, to provide controlled load web logic testing. The tool summarizes Plan “coverage”. For regression testing, IVRT tests an updated application with its original Test Plan and compares the log to previous logged output. Differences indicate potential regression failures.

Abstract: The present invention provides a method, test-bed and computer program product for testing an application installed on a wireless communication device. The wireless communication device communicates one or more messages wirelessly to a server through a test-bed. The test-bed is connected with the server and provides one or more testing parameters for the one or more messages. A tester, testing the application, assigns a probability to the one or more messages. Further, the tester assigns a probability to the one or more testing parameters. Thereafter, the messages are re-communicated between the server and wireless communication device through the test-bed. Subsequently, the one or more messages are identified by the test-bed and one or more wireless network conditions are emulated based on the probabilities assigned to the one or more messages and the one or more testing parameters.

Abstract: A method is provided for generating a test case for testing a program, which can include analyzing instructions of the program to identify basic blocks and superblocks, each basic block containing at least one executable instruction, and each superblock containing a plurality of basic blocks. The method can include executing instructions by a processor to perform determining respective weights of superblocks, each weight representing a number of basic blocks which require execution when the superblock is executed; determining the constraints which cause a superblock having a high weight to be executed, and using the determined constraints to generate a test case which, upon execution of the program, causes the high weight superblock to be executed.

Abstract: A method and system is provided for verifying and certifying the safety logic of a manufacturing automation system including safety logic, where the logic may include one or more safety modules, routines, programs and tasks or a combination thereof; testing specifications corresponding to the safety logic; one or more formal model generators adapted for automatically transforming the safety logic and testing specifications through a logic parser into their respective mathematical models, formatted for example, as a Petri-net or binary decision diagram; a safety logic verifier configured for automatically comparing the safety logic formal model against the testing specification formal model to verify the safety logic model for the purpose of certifying the safety logic. The testing specifications may include testing of safety logic behavior including reaching safe state, remaining in safe state without reset, recovering from safe state with reset and remaining active with false alarm detection.

Abstract: Random sequences are generated based on a stochastic generative model having multiple random variates. Inputs representative of the stochastic generative model are received. The inputs include a first random variate having a finite set of alphabets, a second random variate having a set of alphabets, and a third random variate having a finite set of alphabets. Outputs representative of the random sequences are generated based on the stochastic generative model. The outputs include a first random sequence that is a finite-length random sequence of alphabets randomly selected from the first random variate, a second random sequence having a set of alphabets selected from the second random variate, and a third random sequence having a set of alphabets randomly selected from the third random variate.

Abstract: Embodiments of the invention are directed to systems, methods, and computer program products configured to automatically, consistently, and efficiently generate standardized model validation reports in a systematic fashion. In one embodiment, the system is configured to: select a validation metric from a plurality of validation metrics; select a model from a plurality of models; access a datastore comprising scores generated using the selected model; generate validation data from the selected validation metric using the scores in the datastore; and generate a report from the validation data.

Abstract: Embodiments of the invention provide a table-free technique for detecting all temporal and spatial memory access errors in programs supporting general pointers. Embodiments of the invention provide such error checking using constant-time operations. Embodiments of the invention rely on fat pointers, whose size is contained within standard scalar sizes (up to two words) so that atomic hardware support for operations upon the pointers is obtained along with meaningful casts in-between pointers and other scalars. Optimized compilation of code becomes possible since the scalarized-for-free encoded pointers get register allocated and manipulated. Backward compatibility is enabled by the scalar pointer sizes, with automatic support provided for encoding and decoding of fat pointers in place for interaction with unprotected code.

Abstract: Detecting defects in deployed systems, in one aspect, identify one or more monitoring agents used in a computer program. Total execution metric of the computer program and execution metric associated with the one or more monitoring agents are measured and the measure execution metric is compared with a specified overhead criteria. The execution of the one or more monitoring agents is adjusted based on the comparing step while the computer program is executing to meet the specified overhead criteria.

Abstract: The present disclosure generally relates to systems and devices that enable computer software or hardware systems to be evaluated. In an embodiment, an evaluation processing device can receive a set of needs or requirements for a computer software or hardware system from a user or organization. The evaluation processing device may determine software or hardware configurations that may be suitable for the user based on the set of needs, and configure one or more evaluation devices with software of hardware based on the determination. The evaluation processing device can allow the user to evaluate the software of hardware configurations by utilizing the one or more configured evaluation devices. Additionally, the integration device can receive information related to the evaluation from the one or more evaluation devices and generate a report based on the information.

Abstract: The present invention features an operational system test method, comprising defining a fault model, inserting a test agent, hooking a test location, collecting test information, and removing the test agent. The invention also features an operational system test method, comprising defining a fault model, inserting a test agent, identifying a memory area according to a test location, hooking the identified memory area, collecting test information, and removing the test agent.

Abstract: Information handling system manufacture through a burn rake that burns images and tests information handling systems is managed with a cascade first-in-first-out manufacture by allowing a predetermined burn time for each information handling system at each burn location. The predetermined burn time includes a projected burn time, a burn variation buffer and a standard repair time buffer that ensures a complete burn for substantially all information handling systems. Increasing the number of systems having a complete burn supports first-in-first out loading and unloading of information handling systems at burn locations so that the burn manufacture process occurs in a consistent cascade that proceeds down the length of the burn rack from a first end to a second end.

Abstract: The present invention provides a system, computer program product, and a computer implemented method for analyzing a set of two or more communicating applications. The method includes executing a first application, such as a client application, and executing a second application, such as a server application. The applications are communicating with each other. A correlation is recorded between the applications and an execution characteristic exhibited on execution. An oracle is used to determine an analysis of the first application that has been executed. The execution of the first application causes a change of state in the second application and/or a change control flow in the second application. Code fragment in the first application and/or the second application are prioritized based on an evaluation produced by the oracle, and based on the correlation between the code fragments that have been executed and the execution characteristic exhibited by the code fragments.