Abstract: The technology disclosed enables the automatic definition of monitoring alerts for a web page across a plurality of variables such as server response time, server CPU load, network bandwidth utilization, response time from a measured client, network latency, server memory utilization, and the number of simultaneous sessions, amongst others. This is accomplished through the combination of load or resource loading and performance snapshots, where performance correlations allow for the alignment of operating variables. Performance data such as response time for the objects retrieved, number of hits per second, number of timeouts per sec, and errors per second can be recorded and reported. This allows for the automated ranking of tens of thousands of web pages, with an analysis of the web page assets that affect performance, and the automatic alignment of performance alerts by resource participation.

Abstract: The disclosed technology teaches detecting abnormal behavior of a UE mobile device, including a network data analytics function component, in communication with core network components of a cellular network, subscribing to location change-related events that report a change event for a UE device connection to and/or drop or handover from a cell. Included is analyzing location change-related events to detect abnormal handover behavior when the UE device changes its selection of a base station or cell more than N times in not more than M minutes, and reporting the detected abnormal handover behavior with an identifier of the UE mobile device involved and the involved cell's ID. The technology also applies to a group of UE devices selected for analysis, by device, geography or custom-defined affinity, with selection changes among a set of base stations or neighboring cells, each selected at least twice by the UE device in M minutes.

Abstract: Systems, methods, and devices for creating a test performance monitoring and reporting system that is adaptive for use with different types of mobile devices are disclosed. The test performance monitoring and reporting system adapts itself to be interoperable with different models of mobile device by combining sequences of deterministic logic blocks with device-specific asset libraries. Logic blocks can be added to or removed from the sequence. Logic blocks implement different operations of mobile devices, including using assets, launching applications, and replaying sequences of command interface interactions recorded from test users. The asset library contains assets corresponding to mobile device elements that can be manipulated by users. These assets are device-specific, and a test script can be adapted to fit a particular mobile device model by replacing the existing assets in the script with assets from the asset library of the particular mobile device.

Abstract: The disclosed methods and systems of using TWAMP measurement architecture for testing a large network include a control-client running on a first network host initializing memory for test session parameters used to originate a test, parsing a configuration file to populate the memory with IP addresses, ports and QoS parameters for control-servers and session-reflectors; and originating test sessions using the test session parameters.

Abstract: The disclosed technology teaches ad hoc testing a connection between subscriber mobile phone and counterpart location with which the subscriber is having trouble, including positioning a test harness near the location, remote from the subscriber and from a service technician. The harness includes a controller, two mobile phones with an audio cross-over cable connection between, and control connections between controller and phones. The cable feeds output of respective speakers to respective microphones and inhibits transmission between the phones of signals for button presses.

Abstract: The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors.

Abstract: At least three uses of the technology disclosed are immediately recognized. First, a video stream classifier can be trained that has multiple uses. Second, a trained video stream classifier can be applied to monitor a live network. It can be extended by the network provider to customer relations management or to controlling video bandwidth. Third, a trained video stream classifier can be used to infer bit rate switching of codecs used by video sources and content providers. Bit rate switching and resulting video quality scores can be used to balance network loads and to balance quality of experience for users, across video sources. Balancing based on bit rate switching and resulting video quality scores also can be used when resolving network contention.

Abstract: The disclosed methods for reducing the port setup time for a large number of TWAMP test sessions for performance measurement testing of telecommunication transport networks include parsing a configuration file to populate an accept-port data structure with proposed receiver ports for communication from a session-sender to session-reflectors; repeatedly and in parallel, from a control client, communicating with receiving servers to set up pairwise test sessions using receiver port allocations from the accept-port data structure, and receiving and checking blocks of Accept-Session messages from the receiving server and handling either case of acceptance of the proposed receiver port or of counter proposal of an alternate-and-available port to be used for the measurement session; and allocating the alternate-and-available port and updating the accept-port data structure by storing the alternate-and-available port received in the particular Accept-Session message; and using the stored ports to initiate TWAMP mess

Abstract: The disclosed technology teaches TCP session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The disclosed architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.

Abstract: Some tests can be implemented as services. A network provider can deploy (“push”) a test to a container resident on one or more devices of the network, either at installation, periodically, or when a problem is reported. When a customer reports an issue, services running on one or more devices of the customer's installation can cause the containerized tests to be run. For example, the central office of the network provider can initiate a request to run the test through the internet (or other connection) by the container. In some implementations, there is an overlap of the service based test set with traditional technician initiated test sets forming a hybrid testing architecture.

Abstract: The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.

Abstract: The technology disclosed is a method of testing handling of secure communication sessions of clients with servers by device or system under test (DUT). The method includes (i) establishing a secure communication session between the client and the server while the client and the server transitions past a standards-required verification step or validation step without performing the required verification or validation, (ii) establishing a secure communication session between the client and the server while the client and the server reuse standards-required security mechanisms without generating or obtaining new standards-required security mechanisms, or (iii) establishing a secure communication session between the client and the server while the client and the server generate and transmit content contrary to an established standard-based procedure that poses certain requirements of the content.

Abstract: The disclosed methods for reducing the port setup time for a large number of TWAMP test sessions for performance measurement testing of telecommunication transport networks include parsing a configuration file to populate an accept-port data structure with proposed receiver ports for communication from a session-sender to session-reflectors; repeatedly and in parallel, from a control client, communicating with receiving servers to set up pairwise test sessions using receiver port allocations from the accept-port data structure, and receiving and checking blocks of Accept-Session messages from the receiving server and handling either case of acceptance of the proposed receiver port or of counter proposal of an alternate-and-available port to be used for the measurement session; and allocating the alternate-and-available port and updating the accept-port data structure by storing the alternate-and-available port received in the particular Accept-Session message; and using the stored ports to initiate TWAMP mess

Abstract: A transmission control protocol (TCP) session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The TCP session processing architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.

Abstract: The present invention relates to testing signals on a coaxial home network that carries a digital video signal. It has direct application to testing Multimedia over Coax Alliance (MoCA) standards-compliant networks and applies to similar networks such as Data Over Cable Service Interface Specification (DOCSIS), Ethernet, and Wi-Fi. An embedded expert system can guide an inexperienced operator through the process of evaluating and resolving problems with a home network with little operator input.

Abstract: Computer networks include multiple hardware and software devices, each working together to provide a favorable user experience to an operator. Many of these devices are built to standards that have been published by international standards organizations. These standards include functional test criteria that, when executed successfully, assure functionality of the device within a group of devices. The technology disclosed maintains libraries of canned tests based on these published standards. In addition, the technology disclosed can collect, adapt, and execute sets of predefined transactions to a target test network. This will validate that the target test network can scale up to a desired combination of transactions of different types. This is accomplished by manipulating example transaction sets captured from probes or routers that save network accounting records from a model network.

Abstract: The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.

Abstract: The disclosed technology teaches automating evaluation of QoE for data communication services in a wireless network—accessing performance indicators, mappings for the performance indicators to SKQIs in a SKQI parameters table, and mappings for SKQIs to KQIs in an SKQI-to-KQI mapping table. The disclosed method includes configuring first and second functions that, respectively, roll up performance indicators into SKQIs based on parameters stored in the SKQI parameters table to calculate SKQI scores and weights, and roll up SKQIs into KQIs and QoE based on parameters stored in SKQI-to-KQI and SKQI-to-QoE mapping tables, to calculate KQI and QoE scores. Also disclosed is generating first SQL statements that invoke the first function to calculate the SKQIs and second SQL statements that invoke the second function to calculate KQIs and QoE, storing generated first and second SQL statements in non-volatile storage and calculating KQIs and QoE using the automatically generated SQL statements.

Abstract: The disclosed technology teaches alerting a network operator to deteriorated wireless network conditions with granularity and reduced false alerts, including receiving tracked performance indicators (KPIs) for multiple components of voice, data and messaging and accessing a mapping for combining the performance indicators into quality sub-indicators for individual users and into key quality indicators (KQI) for the individual users. This includes smoothing the current KQI measures of performance over time to reduce the impact of brief transitory events, accessing a weekly profile of KQIs, and comparing KQIs for a current time window to past KQIs for a corresponding time window for the individual users operating mobile devices in part of the cellular network that is a focus of interest. Based on the comparing, the disclosed technology includes generating alerts that report out-of-range current KQIs within the focus of interest that are persistently out-of-range for longer than a configurable time.

Abstract: The disclosed systems and methods for conducted massive MIMO array testing uses an efficient method of utilizing hardware resources for emulating signals from a massive MIMO base station transceiver to a MIMO mobile unit as dictated by a channel model; and also for emulating signals from a MIMO mobile unit to a massive MIMO BS transceiver, as dictated by a channel model. The system uses a phase matrix combiner to emulate the angular behavior of the propagation using virtual probes, combined with a radio channel emulator to create the temporal, multipath, and correlation behavior of the propagation. Using a phase matrix function increases the number of antenna elements that can be utilized in a massive MIMO array emulation while keeping the required number of fading channels within the radio channel emulator at a reduced number, thus forming a cost effective, yet realistic test system for massive MIMO testing.