Abstract: The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.

Abstract: The disclosed system for testing a massive MIMO beamforming antenna array of arbitrary size includes an anechoic chamber, and a mount for a MIMO array antenna positioned in the chamber, wherein the array has at least 8×4 antenna elements that are individually activated to steer transmissions from the array. The system includes dual element antenna probes positionable in the anechoic chamber, with feeds coupling one or more UE sources to the antenna probes; and the UE sources generate RF in OTA communication with the array, emulating multiple UE devices. Additionally the system includes base station electronics coupled to the array, and a test controller coupled to the base station electronics. The test controller signals the UE sources OTA via the array to invoke a connection to the UE sources and measure OTA channel performance between the array and the multiple UE devices emulated, the performance including at least throughput.

Abstract: The disclosed technology teaches alerting a network operator to deteriorated wireless network conditions with granularity and reduced false alerts, including receiving tracked performance indicators (KPIs) for multiple components of voice, data and messaging and accessing a mapping for combining the performance indicators into quality sub-indicators for individual users and into key quality indicators (KQI) for the individual users. This includes smoothing the current KQI measures of performance over time to reduce the impact of brief transitory events, accessing a weekly profile of KQIs, and comparing KQIs for a current time window to past KQIs for a corresponding time window for the individual users operating mobile devices in part of the cellular network that is a focus of interest. Based on the comparing, the disclosed technology includes generating alerts that report out-of-range current KQIs within the focus of interest that are persistently out-of-range for longer than a configurable time.

Abstract: A utilization test generates the multiple dimensions of resource load on the first computer, the multiple dimensions including at least two of: a processor utilization dimension, a main memory utilization dimension, a mass storage utilization dimension, and a network utilization dimension. The utilization test performs iterations of attempts to generate said each dimension of the resource load on the first computer, in an amount equal to a changeable target utilization of said each dimension of the resource load on the first computer. The utilization test adjusts the adjusted utilization to attempt to correct for inequality between (i) the actual utilization of a particular one of the multiple dimensions of the resource load on the first computer, and (ii) the changeable target utilization of the particular one of the multiple dimensions of the resource load on the first computer.

Abstract: A method is provided for generating and transmitting a test signal for an over-the-air test of a device-under-test that is in simulated motion. The method includes dithering Doppler shifts of a carrier frequency of the test signal on sub-path components of the test signal to produce slightly different frequencies per sub-path component, wherein the sub-path components are at a first and second polarization orientations. Dithering Doppler shifts can include dithering a first sub-path component at the first polarization orientation while keeping this sub-path component at the second polarization orientation at the original Doppler shift of the carrier frequency of the test signal, or keeping a first sub-path component at the first polarization orientation at the carrier frequency of the test signal while dithering this sub-path component at the second polarization orientation. Dithering Doppler shifts can include dithering sub-path components at the first and the second polarization orientation.

Abstract: An SQL interceptor inserted as a proxy between a database client and the corresponding database server intercepts a constrained application-generated SQL query and composes a new data request. Parameter values in the SQL query determine whether the new data request is sent to a database server or a web service provider. A reserved table name specified in the SQL query triggers a rewrite of the data request. Parameter values in the query are used to select among a plurality of executable modules to use for rewriting the data request. Special data encoding and formats need to be used based on the source of data that will receive and respond to the rewritten data request. For example, communication between a database client and server may use a vendor-specific, non-standard binary encoding, and XML and JSON response data must be reformatted as an SQL response for processing by the database client.

Abstract: The disclosed technology teaches TCP session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The disclosed architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.

Abstract: The operation of testing device for troubleshooting failures in a MoCA LAN system is disclosed that discovers devices on a MoCA LAN. These automatically discovered devices are then sent a large number of data packets that elicit a response from the recipient. The packets transmitted for which no corresponding response is received are counted as lost packets, and the packet loss results for each tested device enables identifying the source of a failure in the network.

Abstract: The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors.

Abstract: The disclosed systems and methods for conducted massive MIMO array testing uses an efficient method of utilizing hardware resources for emulating signals from a massive MIMO base station transceiver to a MIMO mobile unit as dictated by a channel model; and also for emulating signals from a MIMO mobile unit to a massive MIMO BS transceiver, as dictated by a channel model. The system uses a phase matrix combiner to emulate the angular behavior of the propagation using virtual probes, combined with a radio channel emulator to create the temporal, multipath, and correlation behavior of the propagation. Using a phase matrix function increases the number of antenna elements that can be utilized in a massive MIMO array emulation while keeping the required number of fading channels within the radio channel emulator at a reduced number, thus forming a cost effective, yet realistic test system for massive MIMO testing.

Abstract: The disclosed methods and systems of using TWAMP measurement architecture for testing a large network include a control-client running on a first network host initializing memory for test session parameters used to originate a test, parsing a configuration file to populate the memory with IP addresses, ports and QoS parameters for control-servers and session-reflectors; and originating test sessions using the test session parameters.

Abstract: The disclosed methods for reducing the port setup time for a large number of TWAMP test sessions for performance measurement testing of telecommunication transport networks include parsing a configuration file to populate an accept-port data structure with proposed receiver ports for communication from a session-sender to session-reflectors; repeatedly and in parallel, from a control client, communicating with receiving servers to set up pairwise test sessions using receiver port allocations from the accept-port data structure, and receiving and checking blocks of Accept-Session messages from the receiving server and handling either case of acceptance of the proposed receiver port or of counter proposal of an alternate-and-available port to be used for the measurement session; and allocating the alternate-and-available port and updating the accept-port data structure by storing the alternate-and-available port received in the particular Accept-Session message; and using the stored ports to initiate TWAMP mess

Abstract: The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.

Abstract: The disclosed technology teaches training a NR VMOS score generator by generating synthetically impaired images from FR video using filters tuned to generate impaired versions and applying a FR VMOS generator to pairs of unimpaired FR images from the FR video and the impaired versions of the FR images to create ground truth scores for the impaired versions. The disclosed method also includes training by machine learning model an image evaluation classifier using the ground truth scores and the impaired versions to generate NR VMOS scores, and storing coefficients of the image evaluation classifier for use as the NR VMOS score generator. Also disclosed is generating a NR VMOS score by invoking the trained NR VMOS score generator, with stored coefficients generated by feeding the trained NR VMOS score generator with images captured from scenes in a video to be scored, and evaluating the images to generate NR VMOS scores.

Abstract: The present invention relates to testing signals on a coaxial home network that carries a digital video signal. It has direct application to testing Multimedia over Coax Alliance (MoCA) standards-compliant networks and applies to similar networks such as Data Over Cable Service Interface Specification (DOCSIS), Ethernet, and Wi-Fi. An embedded expert system can guide an inexperienced operator through the process of evaluating and resolving problems with a home network with little operator input.

Abstract: An SQL interceptor inserted as a proxy between a database client and the corresponding database server intercepts a constrained application-generated SQL query and composes a new data request. Parameter values in the SQL query determine whether the new data request is sent to a database server or a web service provider. A reserved table name specified in the SQL query triggers a rewrite of the data request. Parameter values in the query are used to select among a plurality of executable modules to use for rewriting the data request. Special data encoding and formats need to be used based on the source of data that will receive and respond to the rewritten data request. For example, communication between a database client and server may use a vendor-specific, non-standard binary encoding, and XML and JSON response data must be reformatted as an SQL response for processing by the database client.

Abstract: Systems, methods, and devices for creating a test performance monitoring and reporting system that is adaptive for use with different types of mobile devices are disclosed. The test performance monitoring and reporting system adapts itself to be interoperable with different models of mobile device by combining sequences of deterministic logic blocks with device-specific asset libraries. Logic blocks can be added to or removed from the sequence. Logic blocks implement different operations of mobile devices, including using assets, launching applications, and replaying sequences of command interface interactions recorded from test users. The asset library contains assets corresponding to mobile device elements that can be manipulated by users. These assets are device-specific, and a test script can be adapted to fit a particular mobile device model by replacing the existing assets in the script with assets from the asset library of the particular mobile device.

Abstract: A tester system described herein enables a user (e.g., a field technician) to efficiently and conveniently upgrade, evaluate and troubleshoot customer premises networks and equipment. The tester system includes a dedicated tester device that is wirelessly coupled to a handheld device. In response to user input, the handheld device remotely controls the dedicated tester device to execute a testing routine to evaluate one or more customer premises wired and/or wireless networks.

Abstract: At least some of the illustrative embodiments are methods including: executing a test program on a computer system coupled to a server, the test program emulating virtual users by instantiating a first user instance by calling a first reentrant function, the first user instance exiting the first reentrant function upon encountering a blocking statement in the first reentrant function; instantiating a second user instance by calling the first reentrant function, the second user instance exiting the first reentrant function upon encountering a blocking statement in the first callable function; reentering the first user instance by again calling the first reentrant function, the first reentrant function resuming execution within the reentrant function after the first blocking statement; and reentering the second user instance by calling the first reentrant function, the first reentrant function resuming execution within the reentrant function after the second blocking statement.

Abstract: The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.