Abstract: The installation of multiple applications by an installer is executed in a mode that does not display an error message in a display device. Upon an installation performed by the installer ending, the result of the installation performed by the installer is determined. As a result of the determination, an installer that failed at the installation is caused to re-execute the installation of the application whose installation failed in a mode that displays an error message in the display device. As a result of the re-execution, an error message is displayed in the display device by the installer that failed at the installation.

Abstract: An application under test may be run in a test mode that receives a series of test scenarios and produces a set of test results under the control of a verification application. The verification application utilizes “typed-data” (i.e., data having known types that are associated with the data itself, e.g., XML-based data) such that a number of parameters can be set for each event and a number of result parameters can be checked for each result in at least one script. A series of scripts can be combined into an action file that may invoke scripts and override parameters within the invoked scripts. The events can be sent and received using a number of messaging protocols and communications adapters.

Abstract: A design tool provides global resource conflict management. The design tool identifies a conflict in requested values of a global resource during development of an embedded application. The design tool further calculates new values of the global resource, and proposes the new values of the global resource as an alternative to the requested values to assist a user in resolution of the conflict.

Abstract: A system includes a platform server with a software platform on which platform targeting applications (PTAs) execute. An update server may be coupled to the platform server to provide an update to this software platform. Responsive to notification to independent software vendors of the PTAs, results of regression testing performed on at least some of the PTAs can be received in a test server, which may enable commitment of the update based on at least some of the results.

Abstract: APIs to test a device are described. In one or more implementations, a device includes a housing, one or more sensors supported by the housing, and one or more modules disposed within the housing that are implemented at least partially in hardware. The one or more modules are configured to process inputs detected using the one or more sensors and expose one or more application programming interfaces to a robot to cause the robot to perform one or more operations that are detectable by the one or more sensors, the one or more operations usable to test detection performed by the one or more sensors and the processing of the inputs performed by the one or more modules.

Abstract: A method and system to remotely log debug information is described. A computer executing program code generates debug information upon the occurrence of an error in execution. The debug information is then sent to a remote computer using a network adaptor. In one embodiment, the computer executing the program is Extensible Firmware Interface (EFI) compliant.

Abstract: A method for implementing a software installation process so as to install, modify or uninstall a software program. The software installation process has a plurality of sequential steps, and the method comprises recording, for each sequential step commenced, step metadata identifying the sequential step so that the step metadata is associated with the software program. The step metadata is recorded in recoverable storage.

Abstract: A method and apparatus for testing code is provided. The method includes inserting at least one token in program code, wherein each token comprises a code element able to provide a value during runtime, establishing a baseline code version and an executing code version from the program code, and subjecting the executing code version to various testing conditions using a processing device. Subjecting the executing code version to various testing conditions comprises periodically evaluating at least one executing code token having one associated executing error detection value against the at least one baseline code token having one associated baseline error detection value and reporting an error when at least one executing code token and associated executing error detection pair fails to match at least one baseline code token and associated baseline error detection pair.

Abstract: Embodiments of the invention relate to the conversion and execution of functional tests. In one embodiment, a current test step of a manual functional test is executed. The test includes a set of test steps each including at least one action and one target of the action. The test is associated with an application that includes a plurality of objects to be tested. At least two of the objects are determined to be associated with the target of the test step. A user is prompted to provide a selection of one of the at least objects for association with the target of the test step. A new test step is generated. The new test step associates the object selected by the user with the target of the current test step. The new test step is designated for automatic execution in place of the current test step for subsequent executions thereof.

Abstract: Methods, media, and systems for detecting anomalous program executions are provided. In some embodiments, methods for detecting anomalous program executions are provided, comprising: executing at least a part of a program in an emulator; comparing a function call made in the emulator to a model of function calls for the at least a part of the program; and identifying the function call as anomalous based on the comparison. In some embodiments, methods for detecting anomalous program executions are provided, comprising: modifying a program to include indicators of program-level function calls being made during execution of the program; comparing at least one of the indicators of program-level function calls made in the emulator to a model of function calls for the at least a part of the program; and identifying a function call corresponding to the at least one of the indicators as anomalous based on the comparison.

Abstract: The present disclosure is directed to a control system for a machine. The control system has an electronic module containing at least one programmable controller. The at least one programmable controller stores a plurality of code modules, and be configured to identify from the plurality of code modules a module that contains a code fault. The at least one programmable controller identifies the code fault by executing, with the at least one programmable controller, the code module, writing a code execution status to a designated memory location on the electronic module, and identifying, based on the code module execution status, the code module that contains the code fault.

Abstract: The testing of programming code for a web service, such as code for a web service application program or for a web service application programming interface (API), is automatically performed. A set of web service requests is generated based on potential input values for fields of the requests that are included in a spreadsheet. The web service requests are firstly processed via execution of a production version of the programming code to generate a set of production web service responses, where the production version of the programming code is assumed to generate accurate web service responses. The web service requests are then processed via execution of a new version of the programming code to generate a set of new web service responses. The web service responses of the new and production sets are compared to determine whether the new version of the programming code functions accurately.

Abstract: A data reconstruction system, method and computer program product are provided. In use, one of a plurality of computers receiving data over a network is identified. In addition, the data received by the computer is reconstructed in a manner that is independent of the computer.

Abstract: Embodiments of the invention include methods, apparatuses, and systems for automatically identifying a synchronization sub-pattern associated with a test pattern. A test and measurement instrument is triggered in response to a first instance of a trigger pattern in a data stream. A trigger-to-trigger counter begins counting at the time of the first trigger event. The test and measurement instrument is again triggered in response to a second instance of the trigger pattern in the data stream. The count is ended at this time. The count is then compared to a predefined length of the test pattern, and if equal, it is automatically determined that the trigger pattern is the unique synchronization sub-pattern associated with the test pattern.

Abstract: An approach to detection and repair of application level semantic errors in deployed software includes inferring aspects of correct operation of a program. For instance, a suite of examples of operations that are known or assumed to be correct are used to infer correct operation. Further operation of the program can be compared to results found during correct operation and the logic of the program can be augmented to ensure that aspects of further examples of operation of the program are sufficiently similar to the examples in the correct suite. In some examples, the similarity is based on identifying invariants that are satisfied at certain points in the program execution, and augmenting (e.g., “patching”) the logic includes adding tests to confirm that the invariants are satisfied in the new examples. In some examples, the logic invokes an automatic or semi-automatic error handling procedure if the test is not satisfied.

Abstract: A system and method for performing performance testing of video game software from a host computer or external to the game platforms. The system includes a plurality of game platforms, of one, two, or more configurations, running a video game and a communications hub communicatively linked with the game platforms. The testing system includes a metrics gathering framework linked with the communications hub. During operation, the metrics gathering framework requests a metric value from the game platforms via the communication hub, receives the metric values from the game platforms, and stores the metric values in memory of the computer system. In this manner, the majority of the performance test is performed externally or “off-console” so as to avoid polluting the testing environment such as by hindering game performance. The testing may include determining a metric value is out-of-tolerance, and, in response, requesting additional performance data to facilitate troubleshooting.

Abstract: A test device may include an application that accesses online content. In some examples, a test intermediary and/or a test user interface (UI) are downloaded to the test device in response to a request by the application for obtaining the content from a network location. The test intermediary may be positioned to receive communications between the application and the content during testing of the content and/or the application. For example, the test intermediary may intercept metrics and other callbacks passed between the content and the application during manual or automated testing. In some instances, the test intermediary may provide the metrics and/or other test outputs for display in the test user UI rendered on the test device. The content may be rendered to be functional within the test UI, and the existence of the test intermediary and/or the test UI may be transparent to the application and the content.

Abstract: The system enables a call center to manage requests from remote computing clients for service. The system provides a number of software tools that allow technicians to perform routine maintenance and correct problems remotely. At the front-end, the system enables requests to be submitted by customers via various mediums, accesses a calendar to determine technician availability, determines the urgency of the request, and schedules an appropriate technician to address the reported problem. The system further includes tools that enable a technician to access a remote computing client to perform a number computer maintenance and diagnostics. Other tools enable the technician to correct problems that are detected through diagnostics. Calls to the call center are recorded and maintained in order to track pending issues and identify potential areas of improvement.

Abstract: An apparatus includes a network interface, memory, and a processor. The processor is coupled with the network interface and memory. The processor is configured to analyze a first set of data associated with a plurality of data sources. Analyzing the first set of data associated with the plurality of data sources determines a plurality of relationships among the first set of data. The processor is configured to store indications of the plurality of relationships among the first set of data. An indication of a relationship indicates a possible software defect. The processor is configured to generate rules based, at least in part, on the first set of data associated with a plurality of data sources. A rule indicates a possible software defect.

Abstract: Test data for a software services (e.g., a Web service) can be automatically generated from a user-provided specification. The user-provided specification may identify mandatory data elements along with data elements to be tested. Test categories may be defined to specify the type of test to be performed. A value provider may serve as a source of data values for the generated test data.

Abstract: Provided are techniques for receiving an error inject script that describes one or more error inject scenarios that define under which conditions at least one error inject is to be executed and compiling the error inject script to output an error inject data structure. While executing code that includes the error inject, an indication that an event has been triggered is received, conditions defined in the one or more error inject scenarios are evaluated using the error inject data structure, and, for each of the conditions that evaluates to true, one or more actions defined in the error inject script for the condition are performed.

Abstract: A system and method for associating a state with a distributed system and transitioning component states with recovery to reverse transitioning attempts includes defining a global state representing an overall provisioning state of a plurality of components involved in a system wherein a set of global states are employed as provisioning checkpoints. Individual software component methods are defined for transitioning from one state to another. Individual states are associated with a global state. A rollback method is defined by which a destination global state may be rolled back to a previous global state in an event of a failure.

Abstract: A system and method thereof for performing loss-less migration of an application group. In an exemplary embodiment, the system may include a high-availability services module structured for execution in conjunction with an operating system, and one or more computer nodes of a distributed system upon which at least one independent application can be executed upon. The high-availability services module may be structured to be executable on the one or more computer nodes for loss-less migration of the one or more independent applications, and is operable to perform checkpointing of all state in a transport connection.

Abstract: A system and method for predictive analysis includes generating an execution trace on an instrumented version of source code for a multithreaded computer program. Interleavings which potentially lead to a violation in the program are statically generated by performing a static predictive analysis using a Universal Causality Graph (UCG) to generate alternative interleavings that might lead to an error. The UCG includes a unified happens-before model for the concurrent program and a property being analyzed. The interleavings are symbolically checked to determine errors in the program.

Abstract: A system and method for efficiently and easily capturing data dumps generated by a network device is disclosed. In one embodiment, a storage management device is disposed between a network device and a storage device. The network device is programmed with a virtual address that is associated with the storage management device. Upon generating a data dump, the network device writes the data dump to the virtual address where the storage management device receives the data dump and redirects it to a long-term storage location. Additionally, the storage management device can generate a record of each data dump that indicates the network device that generated the data dump and where the data dump was stored.

Abstract: A system and method for recovering from a failure is disclosed. A preferred embodiment comprises downloading a first patch into a base station, installing the first patch, loading the first patch, and validating the first patch. Once the first patch has been validated, a second patch may be downloaded, installed, loaded, and verified. This incremental remediation approach allows for the conservation of resources if the system is non-recoverable, as this will become evident prior to a complete download and install is performed.

Abstract: A dynamic instrumentation method and apparatus which may trace, debug, and profile the execution of a running program without affecting the operation of the program, are provided. According to the method, a break instruction is inserted and executed at start of execution of a first instruction and immediately after execution of the last instruction of a function constituting the program. Environment values of the function before and after execution may be identified. The program may be dynamically instrumented without being affected by any tracing or debugging operations.

Abstract: The development of automated tests that span end-to-end business processes, such as may be executed in part by each of multiple Enterprise Resource Planning systems, is a very complex activity. Beside expert know-how of various tools, such end-to-end business process testing requires various test automation tools to cover complex business processes to provide automated tests. Various embodiments herein are built on an approach for building and connecting automated end-to-end tests that combines test scripts from multiple test tools. These embodiments include functionality to assemble test scripts from multiple test tools into a single, composite test script that allows passing of information between the test scripts during performance of an end-to-end automated process test. These and other embodiments are illustrated and described herein.

Abstract: A method for diagnosing declarative source elements in an application, such as in debugging markup source elements or visual elements in an application, is disclosed. Diagnosis information is associated with an object source of a visual element. The diagnosis information is provided for the visual element during the runtime of the application.

Abstract: Systems, methods and computer program products are described herein for testing a system that is designed to optimize the execution of code within an application or other computer program based on profile data collected during the execution of such code. The embodiments described herein utilize what is referred to as a “profile data mutator” to mutate or modify the profile data between the point when it is collected and the point when it is used to apply an optimization. By mutating the profile data at this point, testing of a system for optimized code execution can be significantly more thorough. Furthermore, such profile data mutation leads to a more scalable and efficient testing technique for profile-guided systems for optimized code execution.

Abstract: Analyzing simulated operation of a computer including loading user-defined dynamically linked analysis libraries that each include specifications of events to be traced for analysis, including: executing, in separate hardware threads, one trace buffer handler for each analysis library, and associating, with each trace buffer handler, one or more analysis functions; translating static binary instructions for the simulated computer into binary instructions for the executing computer, including: inserting, into the translation, implementing code for each specification of an event to be traced and inserting, into the translation for each static instruction, a memory address of a separate static instruction buffer; executing the translation, including executing the implementing code and generating, in a trace buffer, one or more trace records for each specified event; and processing the trace buffer, including calling analysis functions and associating by the analysis functions through the separate static instruct

Abstract: A method and a device for handling exceptions in an embedded system are disclosed. The method comprises: establishing an exception callback linked list for an application program when the application program is running; registering an exception handling function and the corresponding relation between the exception handling function and the exception information into the exception callback linked list by the application program; when the exception is captured, searching the corresponding relation between the exception handling function and the exception information to locate an exception handling function matching the captured exception, according to the exception information of the captured exception; after a matched exception handling function is located, calling and executing the matched exception handling function to perform the exception handling.

Abstract: A method includes capturing data that is representative of actions performed by each of a plurality of human user operated clients as they interact with an online software application, loading at least one or more portions of the captured data into one or more automated simulation clients, and using the one or more automated simulation clients to perform load testing of an online server system. A system includes a data capturing stage, one or more automated simulation clients, and a configuration stage.

Abstract: A method and system for collecting data for diagnosing a failure of a computer hardware device. After an indication of the failure of the computer hardware device that results in a full system crash is received, an address translation table of a central processing unit (CPU) of the computer hardware device is collected. A format of call stack frames of an operating system (OS) image of the computer hardware device is retrieved. Based on the collected address translation table and the retrieved format of the plurality of call stack frames, the call stack frames are retrieved and output to a computer file.

Abstract: A system and method for testing in a database system. In one embodiment, a method includes receiving an indication of one or more changes to a software application, wherein each change corresponds to a different version of the software application. The method further includes generating one or more virtual machines for a version of the software application in response to the indication, wherein the one or more virtual machines test the version of the software application.

Abstract: Systems and methods of debugging client applications may provide for detecting a runtime error in a first version of a client application, and obtaining a second version of the client application server in response to the runtime error. The second version of the client application may be used to conduct a diagnosis of the runtime error.

Abstract: A software preload arrangement uses a central server to store the software repository(ries) for various computer instruction files offered for preload into a system being manufactured. To execute the preload, a client workstation is used to execute the actual preload steps for a system under test (SUT). When the SUT needs a given piece of the software release, data is moved down to the client from the server and cached there for delivery to the system under test. In accordance with an important characteristic of this invention, the caching is predictive. That is, data is held in or moved to the client workstation based upon recent activity, so that the time needed to prepare a preload for a system under test is shortened.

Abstract: Based on a functional coverage by a test suite, a functional coverage model of a System Under Test (SUT) may be defined to represent all covered combinations of functional attributes. Based on an n-wise combination criteria, a subset of the possible combinations of values may be determined. A subset of the test suite may be selected such that the selected subset is operative to cover the subset of the determined possible combinations of values. The disclosed subject matter may be used to reduce a size of the test suite while preserving the n-wise combinations coverage of the original test suite.

Abstract: A data reconstruction system, method and computer program product are provided. In use, one of a plurality of computers receiving data over a network is identified. In addition, the data received by the computer is reconstructed in a manner that is independent of the computer.

Abstract: In managing testing on a testbed environment a test automator executes an operation specified in a test script to be performed on a testbed environment, wherein the operation refers to a particular role identifier identifying one of a plurality of roles hosted within the testbed environment by at least one host in the testbed environment, wherein the operation does not refer to any of the at least one host. The test automator performs the operation on a particular host of the at least one host of the testbed environment using at least one value from a host description file for calling the particular host assigned to the particular role identifier in a configuration file.

Abstract: In managing testing on a testbed environment a test automator executes an operation specified in a test script to be performed on a testbed environment, wherein the operation refers to a particular role identifier identifying one of a plurality of roles hosted within the testbed environment by at least one host in the testbed environment, wherein the operation does not refer to any of the at least one host. The test automator performs the operation on a particular host of the at least one host of the testbed environment using at least one value from a host description file for calling the particular host assigned to the particular role identifier in a configuration file.

Abstract: In accordance with embodiments, there are provided mechanisms and methods for debugging an assertion. These mechanisms and methods for debugging an assertion can enable improved interpretation and analysis of data validation results, more efficient development associated with data validation, etc.

Abstract: A system and method for handling exceptions in a multi-threaded computing environment. Information, such as that relating to an error state or pertaining to the propagation history of an exception, is stored in a separate object from the exception object itself. The separate propagation information object is accessible to the plurality of threads that are used to execute a user task. The separate object allows rich diagnostic information pertaining to the exception and its propagation through multiple threads to be presented to the developer of the software.

Abstract: A method, system and computer program product for testing testable code of an application comprises sending a request, from a computer-implemented client to a remote test orchestrator, for a list identifying any test agents registered with the remote test orchestrator; and receiving, by the computer-implemented client from the remote test orchestrator, a list identifying the test agent registered with the remote test orchestrator.

Abstract: A computer-implemented method detects a stability change in a first computer system, and compares a first set of software applications installed on the first computer system to each set of software applications installed on a plurality of other computer systems. The method then identifies a second computer system from among the plurality of other computer systems, wherein the set of software applications installed on the second computer system includes all of the first set of software applications except for a given software application. The given software application is then identified as the cause of the stability change in the first computer system. The computer systems are preferably virtual machines being managed by a management module, such as a provisioning manager. The method may be used to detect both increases in stability and instability.

Abstract: Dynamic concolic execution of an application. A first hypotheses pertaining to a nature of test payloads that satisfy a specified property, and that are expected to satisfy a condition tested by the application's program code, can be generated. A plurality of first test payloads to test first hypothesis can be synthesized and submitted to the application during respective executions of the application. Whether each of the first test payloads actually satisfy the condition tested by the application's program code can be determined. When at least one of the first test payloads does not actually satisfy the condition tested by the application's program code, a second hypotheses that is expected to satisfy the condition tested by the application's program code can be generated. A plurality of second test payloads to test the second hypothesis can be synthesized and submitted to the application during respective executions of the application.

Abstract: Dynamic concolic execution of an application. A first hypotheses pertaining to a nature of test payloads that satisfy a specified property, and that are expected to satisfy a condition tested by the application's program code, can be generated. A plurality of first test payloads to test first hypothesis can be synthesized and submitted to the application during respective executions of the application. Whether each of the first test payloads actually satisfy the condition tested by the application's program code can be determined. When at least one of the first test payloads does not actually satisfy the condition tested by the application's program code, a second hypotheses that is expected to satisfy the condition tested by the application's program code can be generated. A plurality of second test payloads to test the second hypothesis can be synthesized and submitted to the application during respective executions of the application.

Abstract: A method is provided for managing changes to a computer system. The method includes generating a database configured with fields identifying one or more component changes and potential problems associated with each one or more component changes; populating the fields of the database with information as a change is made to a computer system; monitoring the computer system for issuance of error alerts; comparing issued error alerts against entries of potential problems in the database; and identifying a set of at least one of the component changes as a potential cause of the issued error alert based on the result of the comparing step. The method executes a corrective process in response to the identification of the potential cause of the issued error and updates the database entry of the set of at least one of the component changes to reflect the issued error as a confirmed error thereof.

Abstract: An error in a web page displayed on a device is detected. The error is assigned to a bucket to indicate a type of the error, and a record describing the current state of the device is generated. Both an indication of the bucket and the record describing the current state of the device are then sent to a server. At the server, error information including error records and bucket identifiers are received from multiple devices. Each error record describes a current state of one of the multiple devices at a time when an error in a web page displayed on the one device was detected. Each bucket identifier corresponds to one of the error records and describes a type of the error associated with that error record. The error records are grouped into multiple baskets based at least in part on the current state information in the error records.

Abstract: Execution statistics are gathered that represent results of execution of a validation check that evaluates code performance within an executing application. A determination is made as to whether the gathered execution statistics for the execution of the validation check match configured criteria to disable the validation check. The validation check is programmatically disabled in response to determining that the gathered execution statistics for the execution of the validation check match the configured criteria to disable the validation check.