Abstract: The disclosed technology teaches TCP session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The disclosed architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.

Abstract: Disclosed is a method of efficient testing by selective UI interaction, through test script sections including setup, execution and verification, applied to an AUT that operates in both API mode and UI) mode, including providing a test environment that, when testing the UI mode of the AUT, defaults to ignoring the UI mode during setup and supplying setup values stored in a file directly to an API without rendering or interacting with UI elements in the setup section of the script. The method includes encountering an override directive in the setup section of the test script, which mandates interaction with a specified UI element in the setup section, and responsive to the directive, overriding of the default of ignoring the specified UI element in the setup section, rendering the specified UI element, and applying a bot to interact with and supply setup values from the file to the specified UI element.

Abstract: The disclosed technology teaches enhancing error messages from tests, providing an error annotation memory in which to store annotations of errors for reference upon recurrence of the errors. Following one or more tests, the technology includes parsing an error log and causing display to a user of one or more errors including error codes, and receiving from the user, for at least some of the errors, a respective error source category and/or problem resolution hint. The method also includes storing an error code and the respective error source category and/or problem resolution hint, received from the user, as an annotation in the error annotation memory. Further taught is receiving and correlating a subsequent error including a subsequent error code, with the error source category and/or problem resolution hint available from the error annotation memory, and enhancing a message accompanying the subsequent error and causing display of the enhanced message.

Abstract: The disclosed technology for utilizing already-provisioned components in a test scenario without need to purge and re-provision the already provisioned components includes interpreting first and second sections of a test script. In the first section, the method includes encountering a reusable-resource-tag and a first instance of requesting provisioning of an associated resource, and provisioning the associated resource and designating the associated resource as reusable. In the second section, the disclosed method includes encountering a second instance of requesting provisioning of the associated resource, determining that the associated resource was designated as being reusable, and reusing an already provisioned instance of the associated resource instead of provisioning a new instance and instead of destroying the already provisioned instance and re-provisioning the associated resource.

Abstract: The disclosed technology teaches testing with a test parameter data structure, applied to an AUT that operates in both API and UI mode, processing a configurable script to test in both modes. UI mode renders and interacts with UI elements utilizing values stored in the structure, used by the script in both modes, providing display mark-up in the script that is rendered in UI mode and formats fields to receive data that map to specific elements, leaving to be completed a mapping connection between the fields in the display and specific elements in the structure. The method includes providing a mapping of fields to elements, based on names, and while processing the script in UI mode, rendering the mark-up from the script, using a bot to interact with and complete the mark-up, applying the mapping to identify elements to complete fields, and causing processing of the fields in the mark-up.

Abstract: The present invention relates to testing signals on a coaxial home network that carries a digital video signal. It has direct application to testing Multimedia over Coax Alliance (MoCA) standards-compliant networks and applies to similar networks such as Data Over Cable Service Interface Specification (DOCSIS), Ethernet, and Wi-Fi. An embedded expert system can guide an inexperienced operator through the process of evaluating and resolving problems with a home network with little operator input.

Abstract: The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.

Abstract: Disclosed is a method of calibrating phase alignment of signals from multiple transmit antennas on multiple channels during OTA testing of a MIMO DUT, including generating a noisy test signal by adding noise to a signal pattern and transmitting the noisy test signal to the DUT on first and second channels OTA and sweeping a relative phase of the signal pattern, but not the added noise, in the first and second channels, while receiving from the DUT reports of a SNR for a received signal on at least one of the first channel and subsequently on the second channels. The method also includes analyzing variation in the SNR to determine phase alignment of the first and second channels, as received and processed by the DUT and using the determined phase alignment to perform OTA testing of the DUT. The method can also include receiving a RSRP and/or a RSSI.

Abstract: The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.

Abstract: The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.

Abstract: The disclosed technology teaches training a NR VMOS score generator by generating synthetically impaired images from FR video using filters tuned to generate impaired versions and applying a FR VMOS generator to pairs of unimpaired FR images from the FR video and the impaired versions of the FR images to create ground truth scores for the impaired versions. The disclosed method also includes training by machine learning model an image evaluation classifier using the ground truth scores and the impaired versions to generate NR VMOS scores, and storing coefficients of the image evaluation classifier for use as the NR VMOS score generator. Also disclosed is generating a NR VMOS score by invoking the trained NR VMOS score generator, with stored coefficients generated by feeding the trained NR VMOS score generator with images captured from scenes in a video to be scored, and evaluating the images to generate NR VMOS scores.

Abstract: The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.

Abstract: An SQL interceptor inserted as a proxy between a database client and the corresponding database server intercepts a constrained application-generated SQL query and composes a new data request. Parameter values in the SQL query determine whether the new data request is sent to a database server or a web service provider. A reserved table name specified in the SQL query triggers a rewrite of the data request. Parameter values in the query are used to select among a plurality of executable modules to use for rewriting the data request. Special data encoding and formats need to be used based on the source of data that will receive and respond to the rewritten data request. For example, communication between a database client and server may use a vendor-specific, non-standard binary encoding, and XML and JSON response data must be reformatted as an SQL response for processing by the database client.

Abstract: The disclosed technology addresses the problem of testing performance of RU scheduling algorithms used by an OFDMA enabled AP to support multiple clients, using a two-armed test harness with a wired connection to one side of an AP under test and multiple wireless clients coupled in RF communication with the AP. The wireless clients can be connected over the air or conductively to antenna(s) of the AP under test. The test harness generates test traffic. A sniffer radio listens to RU allocation and schedules traffic broadcast by the AP to multiple clients. A recording module records the RU allocation and traffic and a report generator categorizes the recorded resource allocation with the scheduling traffic heard by the sniffer radio and provides resource allocation statistics. The wireless clients are connected conductively or OTA to antennas of the AP under test. One sniffer radio replaces multiple sniffers used in prior test systems.

Abstract: The disclosed methods and systems of using TWAMP measurement architecture for testing a large network include a control-client running on a first network host initializing memory for test session parameters used to originate a test, parsing a configuration file to populate the memory with IP addresses, ports and QoS parameters for control-servers and session-reflectors; and originating test sessions using the test session parameters.

Abstract: The disclosed technology teaches delivering scarce test equipment resources to a user within a test organization: receiving a test graph that specifies equipment capabilities needed, by class and times when the capabilities are needed. The technology includes maintaining an inventory of equipment resources and capabilities, by class, and responsive to the user invoking the graph, scheduling the needed equipment: identifying alternative resources responsive to the need and selecting a group of resources to schedule; bundling the group of resources to schedule into an immediate bundle needed to start the test and a deferred bundle needed later, after the start of the test; and queuing a deferred bundle reservation for a later time, after the scheduled start of the test. During the test, the technology includes notifying the user of availability of the equipment resources in the deferred bundle when they become available and marking the deferred bundle as in use.

Abstract: The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.

Abstract: The disclosed methods for reducing the port setup time for a large number of TWAMP test sessions for performance measurement testing of telecommunication transport networks include parsing a configuration file to populate an accept-port data structure with proposed receiver ports for communication from a session-sender to session-reflectors; repeatedly and in parallel, from a control client, communicating with receiving servers to set up pairwise test sessions using receiver port allocations from the accept-port data structure, and receiving and checking blocks of Accept-Session messages from the receiving server and handling either case of acceptance of the proposed receiver port or of counter proposal of an alternate-and-available port to be used for the measurement session; and allocating the alternate-and-available port and updating the accept-port data structure by storing the alternate-and-available port received in the particular Accept-Session message; and using the stored ports to initiate TWAMP mess

Abstract: Systems, methods, and devices for creating test and testing a plurality of touchscreen devices are described. The methods comprise creating a test script by recording the touch events performed on a touchscreen device by a technician. The method of recording touch events for later use as a test script is faster and requires less programming knowledge, compared to manually writing a test script. This is beneficial if a new test script is needed quickly because a technician can perform a desired touch sequence on a device recording the sequence and then distribute the recorded sequence to be played on a plurality of devices to be tested. The recorded sequence may include a plurality of sequential touch events. Additionally, the recorded sequence may include conditional statements used to determining the timing of simulating one of the touch events in the sequence.

Abstract: The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors.