Abstract: A computer-implemented method, system, and computer program product for a web-based integrated test and debugging system is provided. The method includes configuring a proxy widget on a server to communicate with a debug widget on a browser, and configuring the proxy widget to communicate with an integrated development environment (IDE) external to the server. The method also includes running a process on the server associated with one or more process-control widgets on the browser. The method further includes polling the IDE via the proxy widget to access a debug and test infrastructure of the IDE for debug data associated with the process, and relaying the debug data associated with the process from the proxy widget to the debug widget to provide web-based integration of testing and debugging on the browser while the process is running on the server.

Abstract: Systems, methods, and other embodiments associated with graphical user interface input element identification are described. One example system identifies a graphical user interface (GUI) element through which an input to an application was received based on comparing images generated from data provided by the application. Data that describes the GUI element may then be provided.

Abstract: The present subject matter is directed to systems and methods for automating the testing of multi-function systems, such as naming registration systems and the like. A method of testing a registry, and the like, may include providing a command phrase including an add command and at least one function that includes an artificial attribute for a domain added by the add command. The command phrase may specify an operation, a protocol, and an object. The operation may include at least one of add, delete, or update domain. The protocol may include at least one of RRP and EPP. One or more parameters associated with the command phrase may be provided and may include an expected response code and/or a variable. One or more additional parameters that are associated with the command phrase may be determined and a database may be accessed to provide the one or more additional parameters.

Abstract: A method of improving an object-oriented programming environment by creating objects that automatically test themselves to determine if the object is being used properly. Each programming object in a library of programming objects includes an initialization routine for testing the programming object. If the initialization routine detects an programmer errors in the use of the programming object, the initialization routine will display a message describing the detected error.

Abstract: A configuration information verification apparatus includes an alive monitoring information collecting unit for collecting alive monitoring information from a plurality of configuration items constituting a network, a logical formula creating unit for referring to configuration information that represents information about connection relationships between the configuration items and creating a logical formula with respect to each configuration item by performing an AND operation on configuration items positioned on a route leading to corresponding configuration item, and assigning a “true” value to the logical formula if the alive monitoring information indicates that the corresponding configuration item is operating normally and assigning a “false” to the logical formula if the alive monitoring information indicates that the corresponding configuration item is not operating normally; and a logical formula verifying unit for verifying, from a plurality of logical formulae, whether an inconsistent logical form

Abstract: A system comprises a first computer on which a software program is executed. The software program causes an operation to be performed. The system also comprises a second computer coupled to the first computer and executes a different version of the software program. The second computer automatically duplicates the operation on the different version of the software program. An activity server is also coupled to the first and second computers to analyze a result of the operation on the first computer against a result of the operation on the second computer and to generate a notification when the result of the operation on the second computer is different.

Abstract: An aspect of the present invention identifies deprecated routines invoked by a software application implementing subtype polymorphism by examination of the software application, without having to execute the software instructions. In one embodiment, upon receiving software instructions constituting the software application, the polymorphic data types, variables of the data types, and a corresponding set of assignments for each variable are identified in the received software instructions. The specific instructions containing invocations of routines associated with the identified variables are also found. In response to finding the invocations, the routines that are invoked corresponding to the specific instructions are determined. The specific (determined) routines that are deprecated are ascertained and a report is thereafter generated indicating the specific routines.

Abstract: Certain example embodiments relate to systems and/or methods for determining and/or executing an appropriate subset of tests in response to a code change. In certain example embodiments, hash digests or other unique values for code structures (such as, for example, classes, methods, and/or other structural elements) may be created. Tests associated those associated code structures may be identified. New hash digests or other unique values may be generated for the code structures after the source code has been modified. In response to a mismatch as between the existing and new hash digests or other unique values, a list of associated tests for possible subsequent execution may be retrieved. Certain example embodiments additionally or alternatively provide an incremental but consistent way of analyzing performance issues, e.g., in connection with a profiler.

Abstract: This disclosure generally relates to assigning and simultaneously running multiple client-side experiments on client devices. A file includes information regarding experiments that are available, including information regarding “layers,” which are logical, imaginary containers in which each experiment “resides.” Each experiment is associated with one layer. For each experiment, the file includes information regarding a location and size of the experiment within the layer. When the client device takes an action, a software module identifies a value of an identifier associated with the action. Each such identifier is associated with one or more of the layers. The software module can calculate, for each of the associated layers, a location within the layer based on the identifier value. The computer software module can identify, based on the information in the file, each experiment that overlaps with the calculated location within each layer and cause each identified experiment to be activated.

Abstract: A test script editor that easily can be used by anybody in the development team, including non-programmer business analyst testers. The test script editor enables building maintainable and stable test scripts by simple selecting from a set of accessible actions (a combination of the test object and the associated test method). The accessible actions can be calculated by application state engine by calculating all state transitions of preceding actions and subsequent actions in the script. The test script editor can provide context sensitive navigation help for appending steps at the end of the script, inserting steps within the script, changing existing steps and deleting steps.

Abstract: A system and method for supporting a virtual appliance is provided. In particular, a support engine may include an update server that can manage a workflow to update an appliance in response to detecting upstream updates to one or more software components that have been installed for the appliance. For example, the workflow may generally include managing a rebuild the appliance to install the upstream updates and further managing an integration test to verify that the rebuilt appliance behaves correctly with the upstream updates installed. In addition, the support engine may further include a support analysis manager that can analyze the software components that have been installed for the appliance in view of various heuristic rules to generate a support statement indicating whether support is available for the appliance.

Abstract: An architecture for a test script editor that can be used by anybody in the development team, including non-programmer business analyst testers. Software testers can generate test scripts for validating and verifying software without navigating all possible actions or keywords. The current application state is described with one or more test objects. Each test object has one or more associated test methods and each test method can describe one or more state transitions. Only test methods accessible through test objects in the current application state are displayed to the software tester. The current state changes only if the state transition described by the test method selected by the software tester indicates a change from the current state.

Abstract: A method of improving a traffic pattern through web page nodes of a website is provided, including selecting web page nodes. The traffic pattern includes a sequence of nodes. Each node represents a first page having a link to a second page in a subsequent node. A visitor to a node prior to a conversion node either navigates to a subsequent node or fails to progress to a subsequent node. The method also includes, for each web page, identifying display elements on the web page node that are associated with a decreased probability that the user progresses through the traffic pattern to a subsequent web page node in the predetermined traffic pattern, determining a metric representing an impact on a conversion attributable to the display elements, ranking the plurality of web page nodes based on the metrics for each web page node.

Abstract: A method includes accessing a page of Web application that includes an interactive form having at least one field for entry of data, the interactive form rendered by the Web application based on code for the interactive form. The method also includes extracting input validation code from the code, the input validation code including at least one constraint on data entered into the at least one field. The method additionally includes extracting the at least one constraint based on an analysis of the input validation code and solving, for the at least one field, for a string value based at least on the at least one constraint for the at least one field. The also includes automatically entering, into the at least one field, the string value. The method additionally includes automatically submitting the interactive form, including the string value entered into the at least one field.

Abstract: Software testers can generate test scripts for validating and verifying software without navigating all possible actions or keywords. The current application state is described with one or more test objects. Each test object has one or more associated test methods and each test method can describe one or more state transitions. Only test methods accessible through test objects in the current application state are displayed to the software tester. The current state changes only if the state transition described by the test method selected by the software tester indicates a change from the current state.

Abstract: A framework for developing and testing a software wizard formalizes, through constraint functions, relationships between different pages of the software wizard. A sequence of user interface (UI) pages of a software wizard is generated in accordance with this framework by carrying out the steps of displaying a first UI page that includes a first UI element for causing a transition to a next UI page of the software wizard, wherein the first UI page is associated with one or more constraint functions, detecting an input event that triggers the one or more constraint functions of the first UI page to produce an output that identifies the next UI page in the sequence of UI pages of the software wizard, and transitioning to the next UI page based on the output.

Abstract: A method includes creating a macro plan for a test project, creating a micro plan for the test project, wherein the micro plan and the macro plan are based on at least one common parameter, and reconciling the macro plan and the micro plan by identifying deviations between the macro plan and the micro plan based on the at least one common parameter.

Abstract: A method and system are provided for automatically testing a program for automation systems (e.g., programmable logic controllers) with regard to maintaining programming guidelines for program design for automation systems. A copy of at least part of a safety-related program is obtained from a development system for automation systems as a copy to be tested. The program copy to be tested is loaded into a test device for testing programs. The test device has access to programming guidelines for program testing. The test device automatically performs the program test with regard to maintaining programming guidelines, and outputs the test result.

Abstract: A system and method for analyzing a concurrent program employ asynchronous function calls for communication and recursion. A control flow graph is constructed based on a context-sensitive pointer analysis, whereupon encountering a function pointer, a points-to set of the function pointer is computed in a context-sensitive fashion to determine a set of potential function calls. The context-sensitive pointer analysis is terminated when no new potential function calls are encountered and where the potential function calls may contribute new data races other than those that exist in the contexts traversed thus far. To decide this, a characterization of pointer aliasing based upon complete update sequences is employed. A set of contexts that may contribute to different data races are enumerated by tracking update sequences for function and lock pointers and pointers that are shared or point to shared memory locations. Data race detection is carried out on the control flow graph.

Abstract: A system that incorporates teachings of the present disclosure may include, for example, a computer-readable storage medium operating in a web server having computer instructions for receiving from an Internet browser a request to create a viewing profile for a web page, creating the viewing profile by generating an asynchronous script for processing at least a portion of data supplied by a web service, embedding the asynchronous script in the web page, and presenting at the Internet browser the updated web page with the embedded asynchronous script. Additional embodiments are disclosed.

Abstract: A method is used in managing quality testing. Quality tests are mapped to characteristics of a product under test. Based on the mapping and a result of a previously executed quality test, a respective relevance level is determined for each of the quality tests. Based on the relevance levels, a priority is determined among the quality tests.

Abstract: This invention relates to a management method, more particularly by recording or external control, of software operations performed within the execution of an application process executed on a computer. This management applies in particular to the recording of operations in the form of logging data, or to a replay of operations according to a given execution corresponding to a running previously logged running This method applies in particular to operations returning at least one result datum to the managed process, and comprises the carrying out of at least one complementary management phase for the managed operation, this complementary management depending on the deterministic or non deterministic nature of the managed operation or of its result.

Abstract: A validation tool providing real-time validation of interactive content applications includes a static analysis engine that extrapolates the timeline of an application and the application's behavior over that timeline. The static analysis engine watches various types of data associated with the application's markup document and works through an editor to inform the user if the application has exceeded defined limits as the application is being built. The validation tool is further configured with a dynamic simulator that is arranged as a state machine that shares state information with the static analysis engine to enable the validation tool to display useful information such as pixel buffer usage at a given time code. The validation tool is further configured to provide a real-time application preview with which the user may interact to immediately evaluate cause and effect of any changes that are made in the application code using the editor.

Abstract: Various embodiments include at least one of systems, methods, and software to receive input configuring tests within a computing environment to expose users to standard application or website experiences or test experiences. In some embodiments, multiple tests may be configured to run orthogonally within user experiences without affecting the results of one another. Some such embodiments preserve the ability to execute certain tests in a non-orthogonal manner while other tests are allowed to execute orthogonally.

Abstract: One embodiment of the present invention provides a system that inserts faults to test code paths. The system starts by placing fault-inserting method calls at join points within methods in program code. The system then executes the program code during a testing process. As a method is executed during the testing process, the system executes the corresponding fault-inserting method. This fault-inserting method checks a configuration database to determine whether a fault is to be simulated for the method and, if so, simulates a fault for the method.

Abstract: Embodiments of the present invention provide a system profiler that can be used on any processor architecture. In particular, instead of copying an entire stack every time, the stack is divided into blocks of a fixed size. For each block, a hash value is computed. As stack blocks are sent out of the kernel, the hash value and a copy of the block contents is kept in a user space cache. In the kernel, the hash codes of sent stack blocks are tracked in a table. During system profiling, the kernel module sampling the call stack determines if that stack block was previously sent by checking for the hash value in the kernel table. If the hash matches an entry in the kernel table, then only the hash value is sent. If the hash value is not in the table, the entire block and the hash value is sent.

Abstract: A finite domain approximation for symbolic terms of a symbolic state is derived, given some finite domains for basic terms of the symbolic state. A method is executed recursively for symbolic sub-terms of a symbolic term, providing a domain over-approximation that can then be provided to a solver for determining a more accurate domain. The method can be applied to a wide array of system terms, including, for example, object states, arrays, and runtime types.

Abstract: A system and method for receiving an image of compiled user code, scanning the image to determine each of a plurality of functions included in the user code and creating a separately compiled executable module corresponding to selected ones of the plurality of functions, wherein the module includes instructions to create a stack trace for the selected ones of the functions.

Abstract: System and method for executing a graphical program on a first computer and providing a user interface of the graphical program on a second computer, where the graphical program includes a plurality of interconnected function icons representing graphical data flow of a function. Information indicating a plurality of graphical programs on the first computer, e.g., a list, may be displayed on the second computer, and user input specifying the graphical program on the first computer received to the second computer, e.g., selecting the graphical program from the list of graphical programs. The graphical program is executed on the first computer, and information describing the user interface of the graphical program is provided to the second computer during execution. The user interface of the graphical program is displayed on the second computer, facilitating interaction between a user of the second computer and the graphical program executing on the first computer.

Abstract: An embedded processor system includes an integrated development environment and an embedded processor operating system. The embedded processor operating system is operable to run on the embedded processor system, and a command queue is operable to receive commands from a debugging module external to the embedded processor system. A command queue processing module is operable to change settings in the embedded processor system in response to commands in the command queue.

Abstract: Code coverage detection for interpreted scriptable programming languages avoids source code modification. Each program element of the script is performed by (a) using a debugger to proactively computationally indicate in a coverage data structure that the element was reached, and integrally (b) running non-logger executable code which corresponds to the element. Coverage of lines, statements, and other program elements during script execution can be measured even though the source code has not been instrumented with injected log statements. Proactively generated breakpoints pass control from each coverage-tracked program element into a code coverage debugger which updates the coverage data structure. Comments are skipped. Code coverage detection may be invoked from a command line, an Integrated Development Environment, or another context. The coverage data structure is correlated with the source code to produce a coverage map that is displayed to users showing which source code was performed.

Abstract: A method for assessing software parallelization may include the steps of analyzing the structure of a software code, splitting the software code into a multiplicity of code portions based on the structure of the software code, ascertaining a complexity value based on the analysis of the structure of the software code for each of the multiplicity of code portions, ascertaining an effort value based on the complexity value for each of the code portions, wherein the effort value indicates the effort required for parallelizing the code potion, and ascertaining an efficiency value for each of the multiplicity of code portions, wherein the efficiency value assesses the efficiency of parallelization of each of the multiplicity of code portions based on a ratio between the ascertained effort value and a useful value which indicates the expected performance gain as a result of the parallelization of the respective code portion.

Abstract: A method is implemented in a computer infrastructure having computer executable code tangibly embodied on a computer readable storage medium having programming instructions. The programming instructions are operable to receive a tool error output determined by a code inspection tool and select at least one defect classification mapping profile based on the code inspection tool. Additionally, the programming instructions are operable to map the tool error output to one or more output classifications using the selected at least one defect classification mapping profile and generate at least one report based on the one or more output classifications.

Abstract: A probe management system identifies a probe module for an application, which includes a semaphore table that has entries for a plurality of probe points in the application. An entry includes a semaphore variable value for a probe point. The probe management system identifies one or more probe points that are to be activated from an introspection user script. The user script is for examining the execution of the application at one or more of the probe points in the application. The probe management system adjusts the semaphore variable values for the identified probe points in the semaphore table in the probe module to represent to the application that a probe point is to be activated and causes the application to activate the identified probe points based on the adjusted semaphore variable values in the semaphore table.

Abstract: A test coverage analysis method and corresponding apparatus are disclosed, wherein, by executing the program under test using one or more test cases, generating one or more heapdump files containing the call stack information of the program under test, and analyzing the call stack information in the one or more heapdump files, the coverage information of the one or more test cases in terms of functions in the program under test is obtained.

Abstract: The execution of anti-virus programs can be accelerated in a virtual desktop environment. In one embodiment, a server hosts a plurality of virtual machines. Before performing a virus scan on a file, the server computes a signature value of the file, compares the signature value with the stored signature values in a central database, and performs virus scan on the file according to the result of the comparison. If the signature value exists in the central database, the virus scan on the file can be skipped.

Abstract: Disclosed is a verification method and system for a localized computer software application, the method and system comprising identifying, for a current graphical object generated by a graphical user interface of the localized application, a resource corresponding to the current graphical object; comparing the content of the current graphical object with the identified resource; and generating an error event when the content does not match the identified resource.

Abstract: A method for repairing an error in a software application, including receiving an error including an error description detailing the error, identifying, using a plurality of commands, a network address of a client computer executing the software application and a file system location on the client computer, transmitting, using the plurality of commands, an error tool file to the client computer at the network address, storing, using the plurality of commands, the error tool file on the client computer at the file system location, installing, using the plurality of commands, an error tool on the client computer using the error tool file, executing, using the plurality of commands, the error tool on the client computer, repairing the error in the software application after executing the error tool, and receiving feedback in the form of an execution log from the error tool.

Abstract: A graphical user interface (GUI) tool analysis system helps determine whether to purchase or license automated testing tools. The system provides guidance, e.g., to test managers, for making decisions on expenditures for the automated test tools. As a result, the test managers need not make purchasing decisions ad hoc, based on their own personal experience and perceived benefits of implementing a tool based automatic testing approach versus a manual testing approach.

Abstract: A system and method for program verification includes generating a product transaction graph for a concurrent program, which captures warnings for potential errors. The warnings are filtered to remove bogus warnings, by using constraints from synchronization primitives and invariants that are derived by performing one or more dataflow analysis methods for concurrent programs. The dataflow analysis methods are applied in order of overhead expense. Concrete execution traces are generated for remaining warnings using model checking.

Abstract: A method for analyzing a set of potential bug statements in source code. The method including obtaining a set of static program analyses; recursively reducing the set of potential bug statements in the source code by: selecting a static program analysis for each recursion from the set of static program analyses in order from least time consuming to most time consuming; evaluating the set of potential bug statements using the static program analysis of the set of static program analyses to determine a subgroup of bug free statements of the set of potential bug statements in each recursion; and removing the subgroup of the bug free statements from the set of potential bug statements to reduce the set of potential bug statements in each recursion; thereby filtering at least one subgroup of bug free statements out of the set of potential bug statements in the source code.

Abstract: A method is disclosed for the computer-aided determination of the optimization potential of a software system including a plurality of modules that can interact with each other at least to some point during execution of the software system. At least one module to be examined is selected from the plurality of modules, in at least one embodiment, and is examined with respect to the effects of an optimization of the at least one module to be examined on the overall consumption of resources of the software system. A respective consumption of resources of one or more modules not to be examined of the plurality of modules is varied according to at least one predetermined criterion, thereby obtaining a modified software system. The overall consumption of resources of the modified software system is determined taking into consideration the variation of the modules not to be examined.

Abstract: A concurrency testcase generation includes providing a concurrency testcase template for features built into a concurrency testcase generation infrastructure that requires no compilation. Through the concurrency testcase template, testers may input directives for managing activities of concurrent threads, directives for configuring timing tests by the concurrent threads, directives for configuring responses to errors by the concurrent threads, and directives for configuring logging of data for the concurrent threads. The directives for managing activities of the concurrent threads may include directives for managing creation of the concurrent threads, directives for customizing actions of each concurrent thread, directives for managing a sequence of the concurrent threads, directives for exchanging of information between the concurrent threads, and directives for configuring throughput for the concurrent threads. The inputted directives collectively define the concurrency testcase.

Abstract: A method and apparatus for dependency tracking in a JavaScript is disclosed. The method comprises defining a plurality of properties as JavaScript property objects, evaluating at least one expression containing at least one property object in the plurality of property objects to define at least one dependent property, notifying the at least one dependent property when a state of the property object changes, and updating the state of the at least one dependent property based on the changed state of the property object.

Abstract: A computerized method for detecting errors in program code including searching for lines of command codes in the program code, wherein a line of command code includes a set of command codes and a set of indices; separating the sets of command codes from the sets of indices, wherein the sets of indices are a matrix; parsing the sets of command codes to locate three or more consecutive lines of command codes, which have the same sets of command codes; for the three or more consecutive lines of command codes, generating sets of vertical indices from vertically aligned indices in the matrix; determining if each set of vertical indices does not match at least one known series in a set of known series; and reporting to a user computer each set of vertical indices that does not match the at least one known series.

Abstract: An embodiment can include one or more computer-readable media storing executable instructions that when executed on processing logic process variable signals. The media can store one or more instructions for receiving executable code that includes constructs with variable signals for processing the variable signals, and for performing a coverage measurement on the executable code based on information about one or more of the variable signals processed by the executable code. The media can store one or more instructions for producing a coverage result based on the coverage measurement, the coverage result identifying a degree of coverage for the executable code when the executable code processes the variable signals.

Abstract: An improved software testing system is described. In various embodiments, the improved software testing system receives a set of keywords identifying logic of a software application that is to be tested, associates each keyword of the set of keywords with a test component that exercises a function of the software application to be tested; derives a model of a behavior of the software application to be tested, and tests the software application based on the keyword and the derived model.

Abstract: The invention provides a method and system for testing a software component, by instrumenting the software component under test with a component able to modify the execution of the component under test and able to generate an event corresponding to the performed modification, and by verifying that the order and the content of the event received match a predefined sequence.

Abstract: A system and method are provided to integrate profiling and debugging. In one embodiment, a profiling infrastructure is generated, the profiling infrastructure having profiling components capable of performing profiling sessions. An integrated infrastructure is generated by associating the profiling infrastructure with a debugging infrastructure, the debugging infrastructure having debugging components capable of performing debugging sessions. The profiling sessions and the debugging sessions are simultaneously performed via the integrated infrastructure.

Abstract: In accordance with disclosed embodiments, there are provided methods, systems, and apparatuses for assigning code lines to clusters with storage and other constraints in an on-demand service environment including, for example, receiving as input, a plurality of code lines for test within a host organization; determining available resource capacity for each of a plurality of clusters within the host organization; determining required resource capacity for each of the plurality of code lines for test within the host organization; sorting the plurality of clusters according to the determined available resource capacity for each; sorting the plurality of code lines according to the determined required resource capacity for each; and allocating the plurality of code lines amongst the plurality of clusters based on the sorting of the plurality of clusters and based further on the sorting of the plurality of code lines. Other related embodiments are disclosed.