Abstract: In one embodiment, a plurality of test data entries are successively displayed via a graphical user interface (GUI), with each of the test data entries including at least a test result identifier and a corresponding test result. For at least one of the test data entries, a user-selectable mechanism is provided via the GUI. When the user-selectable mechanism is selected, additional data related to a particular one of the test data entries is caused to be displayed via the GUI. Other embodiments are also disclosed.

Abstract: In one embodiment, a method for inferring relationships between test results receives sequential test data from a tester performing tests on a number of devices under test (DUTs); upon receiving a DUT identifier, determines if a data structure exists for the DUT identified by the one of the DUT identifiers; upon determining that the data structure does not exist, creates the data structure associates i) any test results associated with the one of the DUT identifiers with ii) the data structure; and upon determining that the data structure exists, creates a child data structure, as a child of the data structure, and associates i) the any test results associated with the one of the DUT identifiers with ii) the child data structure, wherein the child data structure inferentially indicates that the test results associated therewith are retest results.

Abstract: In an embodiment, there is disclosed a system for derivation of missing data objects from test data. The system may include a data populator having code for: (1) generating data objects from the test data, (2) arranging the data objects in a tree structure, (3) deriving the missing data objects from the tree structure, and (4) populating the missing data objects into the tree structure; a data model in communication with the data populator; and a plurality of clients in communication with the data model. In an embodiment, a method of derivation of missing data objects from test data is disclosed. The method may include generating data objects from the test data; arranging the data objects in a tree structure; deriving the missing data objects from the tree structure; and populating the missing data objects into the tree structure. Other embodiments are also disclosed.

Abstract: In one embodiment, a method for logging test results, has steps for: A) accessing a stream of test data associated with a tester performing tests on a number of devices under test; B) selecting items of the test data to be logged to a data store, the selecting being performed in accord with a number of test data formatting selections; and C) logging the selected items of the test data.

Abstract: There are disclosed systems and methods for coordinating test results of devices within a group. In an embodiment, the system may include code to assign identifiers to test results of a first test execution, receive a user-specified beginning point, and assign identifiers to test results of a second test execution. Each device is assigned an identical identifier for the test results of the first test execution and for the test results of the second test execution. In an embodiment, the method may include assigning identifiers to test results of a first test execution; specifying a beginning point; and assigning identifiers to test results of a second test execution. Each one of the devices is assigned an identical identifier for the test results of the first execution and for the test results of the second test execution. Other embodiments are also disclosed.

Abstract: There are disclosed systems and methods for selectively logging test data. In an embodiment, a system includes code to monitor test data generated by a plurality of devices and to generate statistics related to the test data; and code to in response to the statistics related to the test data, selectively adjust a tester that generates the test data, to modify the test data logged by the tester for the plurality of devices. In one embodiment, a method includes monitoring the test data generated by a plurality of devices and generating statistics related to the test data; and in response to the statistics related to the test data, selectively adjusting a tester that generates the test data, to modify the test data obtained from the devices. Other embodiments are also disclosed.

Abstract: In one embodiment, a method of generating a formatted data set in accord with a number of formatting rules includes the steps of A) indexing, with a standard data name referenced by one of the formatting rules, a mapping set comprising a first number of mapping pairs, each mapping pair comprising 1) a custom data name and 2) a corresponding standard data name; B) if a custom data name corresponding to the standard data name referenced by the formatting rule is found in the mapping set, C) accessing test data associated with a tester performing tests on a number of devices under test; D) identifying a data item in the test data that is associated with the custom data name corresponding to the standard data name referenced by the formatting rule; and E) then, formatting the data item associated with the custom data name in accord with the formatting rule referencing the standard data name.

Abstract: In one embodiment, a method of operating a number of data formatters 1) blocks execution of a tester's test processes that generate test results, the test results pertaining to test of at least one device under test (DUT); 2) launches a number of data formatters, operable to format the test results, while execution of the test processes is blocked; and 3) upon determining that the number of data formatters has successfully launched, removing the block. Other embodiments are also disclosed.

Abstract: In one embodiment, a method for inferring relationships between test results 1) receives sequential test data from a tester performing tests on a number of devices under test (DUTs); 2) upon receiving a DUT identifier, determines if a data structure exists for the DUT identified by the one of the DUT identifiers; 3) upon determining that the data structure does not exist, creates the data structure and associates i) any test results associated with the one of the DUT identifiers with ii) the data structure; and 4) upon determining that the data structure exists, creates a child data structure, as a child of the data structure, and associates i) the any test results associated with the one of the DUT identifiers with ii) the child data structure, wherein the child data structure inferentially indicates that the test results associated therewith are retest results. Other embodiments are also disclosed.

Abstract: In response to an ordered sequence of events corresponding to execution of a plurality of tests on at least one device under test, a method: creates a plurality of data objects, some of which correspond to logical groupings of test results implied by ones of the events; relates ones of the data objects to others of the data objects in a hierarchical tree structure; relates data corresponding to ones of the events, the data including the test results, to ones of the data objects in the hierarchical tree structure; stores variable values that are related to ones of the data objects in a plurality of variable lists that correspond to the ones of the data objects; and associates each of the variable lists with corresponding ones of the data objects. The method also provides a number of data formatters access to the plurality of data objects and data associated with the tree structure. Other embodiments are also disclosed.

Abstract: In an embodiment, there is disclosed a system for processing test data, including a data populator having code for: (1) generating data objects from test data, (2) arranging data objects in a tree structure, and (3) generating tokens referring to data objects; code for releasing data objects for reclamation of memory for data objects having no references thereto, and clients having code for: (1) receiving tokens generated by the data populator, (2) reading data objects referred to by tokens, and (3) deleting tokens after reading data objects. In an embodiment, a method of processing data objects from test data is disclosed, including generating data objects from test data; arranging data objects in a tree structure; generating tokens referring to data objects; and reclaiming memory storing data objects having no references from tokens or child data objects. Other embodiments are also disclosed.

Abstract: In an embodiment, there is disclosed a system for selectively processing test data using subscriptions in a multi-formatter architecture. The system includes a set of designators specifying types of data; a set of formatters for writing data to files; and a monitor for polling the formatters for designators and for reviewing the data. In an embodiment, a method of selectively processing test data using subscriptions in a multi-formatter architecture is disclosed. The method includes specifying types of data with a set of designators; polling each one of a set of data formatters to identify specified types of data needed for writing data to files; and reviewing data to identify data corresponding to the designators identified in the polling of the formatters; and storing data corresponding to the designators identified in the polling of the formatters. Other embodiments are also disclosed.

Abstract: In an embodiment, there is disclosed a system for derivation of missing data objects from test data. The system may include a data populator having code for: (1) generating data objects from the test data, (2) arranging the data objects in a tree structure, (3) deriving the missing data objects from the tree structure, and (4) populating the missing data objects into the tree structure; a data model in communication with the data populator; and a plurality of clients in communication with the data model. In an embodiment, a method of derivation of missing data objects from test data is disclosed. The method may include generating data objects from the test data; arranging the data objects in a tree structure; deriving the missing data objects from the tree structure; and populating the missing data objects into the tree structure. Other embodiments are also disclosed.

Abstract: In one embodiment, and in response to a plurality of events, 1) a plurality of data objects are created in memory, 2) data corresponding to ones of the events is related to ones of the data objects, and 3) the data is stored in the memory. At least some of the data objects correspond to logical groupings of data implied by ones of the events. During or after creation of the data objects, a number of data formatters are provided access to the plurality of data objects and data in the memory. Other embodiments are also disclosed.

Abstract: In one embodiment, one or more data structures that define associations between a plurality of configuration keys and a plurality of configuration values are accessed, and a highest priority configuration value is retrieved for each of the plurality of configuration keys. The configuration values are stored in the data structure in one or more of a plurality of configuration layers, with each of the configuration layers conferring a priority to the configuration values stored therein. Configuration values for at least some of the configuration keys are simultaneously specifiable in multiple ones of the configuration layers. A data formatting process is configured in accord with the retrieved configuration values for the configuration keys. Other embodiments are also disclosed.

Abstract: In one embodiment, apparatus includes a data populator that is provided to 1) receive a plurality of events, 2) create a plurality of data objects in memory, with at least some of the data objects corresponding to logical groupings of data implied by ones of the events, 3) relate data corresponding to ones of the events to ones of the data objects, and 4) store the data in the memory. A number of data formatters 1) accesses ones of the data objects, and 2) retrieves and format the data that is related to the data objects, the data being retrieved in response to notifications received by the data formatter(s). A notification manager receives indications of events from the data populator, and provides notifications of ones of the events to one or more of the data formatters. Other embodiments are also disclosed.

Abstract: In one embodiment, a computer implemented method for formatting data involves 1) automatically comparing data associated with a test result, the known data types being associated with test result types, to known data types to determine a best match test result type for the test result; and 2) automatically formatting the data associated with the test result in accord with one or more data formatting rules that are associated with the best match test result type. Other embodiments are also disclosed.

Abstract: In one embodiment, a system for formatting test data is provided with at least one data formatter to i) upon receiving notifications of test events, retrieve test data from a data store, and ii) generate a number of test records based on the test data. The system is also provided with an abort handler to, in response to an abort event, cause at least one of the data formatters to complete the generation of its number of test records based on currently available test data in the data store. Other embodiments are also disclosed.

Abstract: In one embodiment, there is disclosed a system for accumulation of summaries of test data. The system includes a data populator having code to: (1) generate data objects from the test data and store the data objects in a data model, (2) arrange the data objects in a tree structure, (3) generate summaries of the test data, (4) store the summaries of the test data in the tree structure, and (5) delete the data objects. The system also includes a number of clients in communication with the data model, the clients having code to: (1) selectively read the test data from the data objects stored in the data model, and (2) read the summaries of the test data stored in the tree structure. Other embodiments are also disclosed.

Abstract: In one embodiment, a system for formatting test data is provided with at least one data formatter to i) upon receiving notifications of test events, retrieve test data from a data store, and ii) generate a number of test records based on the test data. The system is also provided with an abort handler to, in response to an abort event, cause at least one of the data formatters to complete the generation of its number of test records based on currently available test data in the data store. Other embodiments are also disclosed.