Abstract: Disclosed is using service-based controllers to manage test agents and performance of multi-agent tests running on a network, a connection-interrupted agent losing connection to a first controller, calling home after the loss, and being connected to a second controller which, after being connected to the agent, accesses a list of active tests which should be running, directing the agent to stop running tests that are not on the list and receiving from the agent a state report on running tests on the list. Additionally, instantiating and setting states of fresh primary and peer coordination FSMs using the state report from the test agent, establishing coordination interactions with additional controllers of additional test agents that are participating with the connection-interrupted agent in the active tests, and the connection-interrupted agent continuing to conduct active tests and directing results to the second controller without need to tear down and restart the active tests.

Abstract: The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors.

Abstract: At least three uses of the technology disclosed are immediately recognized. First, a video stream classifier can be trained that has multiple uses. Second, a trained video stream classifier can be applied to monitor a live network. It can be extended by the network provider to customer relations management or to controlling video bandwidth. Third, a trained video stream classifier can be used to infer bit rate switching of codecs used by video sources and content providers. Bit rate switching and resulting video quality scores can be used to balance network loads and to balance quality of experience for users, across video sources. Balancing based on bit rate switching and resulting video quality scores also can be used when resolving network contention.

Abstract: The disclosed technology teaches testing a mesh network using new service application level KPIs that extend the TWAMP measurement architecture. A control-client receives and parses a configuration file to populate memory with IP addresses, ports, and test session parameters for disclosed KPIs used to originate two-way test sessions from a first network host; with control-servers and session-reflectors.

Abstract: The disclosed technology teaches testing with a test parameter data structure, applied to an AUT that operates in both API and UI mode, processing a configurable script to test in both modes. UI mode renders and interacts with UI elements utilizing values stored in the structure, used by the script in both modes, providing display mark-up in the script that is rendered in UI mode and formats fields to receive data that map to specific elements, leaving to be completed a mapping connection between the fields in the display and specific elements in the structure. The method includes providing a mapping of fields to elements, based on names, and while processing the script in UI mode, rendering the mark-up from the script, using a bot to interact with and complete the mark-up, applying the mapping to identify elements to complete fields, and causing processing of the fields in the mark-up.

Abstract: Disclosed is a method of calibrating phase alignment of signals from multiple transmit antennas on multiple channels during OTA testing of a MIMO DUT, including generating a noisy test signal by adding noise to a signal pattern and transmitting the noisy test signal to the DUT on first and second channels OTA and sweeping a relative phase of the signal pattern, but not the added noise, in the first and second channels, while receiving from the DUT reports of a SNR for a received signal on at least one of the first channel and subsequently on the second channels. The method also includes analyzing variation in the SNR to determine phase alignment of the first and second channels, as received and processed by the DUT and using the determined phase alignment to perform OTA testing of the DUT. The method can also include receiving a RSRP and/or a RSSI.

Abstract: The disclosed technology teaches delivering scarce test equipment resources to a user within a test organization: receiving a test graph that specifies equipment capabilities needed, by class and times when the capabilities are needed. The technology includes maintaining an inventory of equipment resources and capabilities, by class, and responsive to the user invoking the graph, scheduling the needed equipment: identifying alternative resources responsive to the need and selecting a group of resources to schedule; bundling the group of resources to schedule into an immediate bundle needed to start the test and a deferred bundle needed later, after the start of the test; and queuing a deferred bundle reservation for a later time, after the scheduled start of the test. During the test, the technology includes notifying the user of availability of the equipment resources in the deferred bundle when they become available and marking the deferred bundle as in use.

Abstract: At least three uses of the technology disclosed are immediately recognized. First, a video stream classifier can be trained that has multiple uses. Second, a trained video stream classifier can be applied to monitor a live network. It can be extended by the network provider to customer relations management or to controlling video bandwidth. Third, a trained video stream classifier can be used to infer bit rate switching of codecs used by video sources and content providers. Bit rate switching and resulting video quality scores can be used to balance network loads and to balance quality of experience for users, across video sources. Balancing based on bit rate switching and resulting video quality scores also can be used when resolving network contention.

Abstract: The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.

Abstract: The technology disclosed is a method of testing handling of secure communication sessions of clients with servers by device or system under test (DUT). The method includes (i) establishing a secure communication session between the client and the server while the client and the server transitions past a standards-required verification step or validation step without performing the required verification or validation, (ii) establishing a secure communication session between the client and the server while the client and the server reuse standards-required security mechanisms without generating or obtaining new standards-required security mechanisms, or (iii) establishing a secure communication session between the client and the server while the client and the server generate and transmit content contrary to an established standard-based procedure that poses certain requirements of the content.

Abstract: The disclosed technology teaches dispersion analysis of individual UE devices, measuring the span of cellular locations in a 5G network over which the bulk of a user's data, voice minutes and text messaging usage take place. Dispersion analysis also measures the span of cellular locations over which the bulk of a user's transactions and failed transactions take place, providing insights into camping behavior on specific cellular locations and hot spot formation. The technology disclosed includes new collection and filtering of location data to pinpoint cellular communication challenges encountered by users as well as system improvement and remediation opportunities. Additionally, this technology enables reporting of the detected behavior and related hot spots formation analysis with identifiers of UE mobile devices involved. The technology also applies to 3G 4G and future mobile networks and can be utilized for a group of UE devices selected for analysis, by device, geography, or affinity.

Abstract: A testing method is provided for diagnosing faults in a multimedia over coax alliance (MoCA) local area network (LAN) including a WiFi segment. The method including, responsive to selection of a test sequence that includes testing of the WiFi segment, causing display of instructional images that depict how an operator couples the test hardware to a wireless component, invoking the test hardware to perform a test by automatically selecting, in dependence upon a problem generically identified by a user, a test and invoking the test, and automatically evaluating results returned by the test, without user interpretation of the results returned, to determine at least one of (i) whether to report a recommendation to replace/repair an identified component, and (ii) whether to (a) repeat the causing display of instructional images, (b) invoke the test hardware to perform an additional test and (c) automatically evaluate results returned by the additional test.

Abstract: The disclosed technology teaches techniques for generating a high quantity of internet traffic flows, such as in the form of data packets, to stress test network components by using range variable field modifiers. The techniques generate a large scale of flows at a relatively fast speed by using a process that may involve a finite state machine feedback loop and a multiple range variable field modifier process. Start and end range pointers for range entries of data packet modifiers are stored in memory and used with pointer and counter values, which are varied and updated in a relatively fast feedback loop. Data packet modifiers may be selected based on the pointer and counter values and are used to modify or generate data packets.

Abstract: A method of a test controller controlling a test platform to run test applications is provided, wherein an authenticated connection exists between the test platform and a phone home service through which secure tunnel information for the test controller has been obtained. The method including the test controller (i) generating an instruction to load and prepare a test application, the instruction including a URL for a repository that stores the test application as a component executable on the test platform, (ii) transmitting the generated instruction to the test platform over an initiated first secure tunnel between the test platform and the test controller, and (iii) controlling the test platform to perform a requested test using the test application using an established second secure tunnel between (a) the test platform or the test application and (b) the test controller.

Abstract: A fan tray for an enclosure containing devices to be cooled is provided. The fan tray includes a top cover having a top surface and a bottom surface facing opposite the top surface, wherein, when the fan tray is mated to the enclosure, (i) the top surface is exposed relative to outside the enclosure and (ii) the bottom surface is contained within the enclosure, a fan-receiving portion extending from the bottom surface of the top cover and configured to receive one or more fans, and one or more electrical connectors configured to provide electrical power to the one or more fans.

Abstract: The disclosed technology takes into account mobility behavior and interactions with a serving cellular network of a UE mobile device, when determining network interaction parameters for the UE, including providing an identifier of the UE to a NWDAF component that subscribes to receive notices that report changed or changing events, including a change in connectivity to any cell for any UE and any service usage on the cell and performs a dispersion analysis by analyzing the incoming notices to determine multiple dispersion indices as the UE mobile device changes its selection of a base station or a cell or a slice. Also included are network elements receiving the dispersion analysis for the UE mobile device and performing a policy update and/or a radio access network (RAN) decision for the UE mobile device based on at least the dispersion analysis. The technology also applies to 3G, 4G and future mobile networks.

Abstract: The disclosed technology for utilizing already-provisioned components in a test scenario without need to purge and re-provision the already provisioned components includes interpreting first and second sections of a test script. In the first section, the method includes encountering a reusable-resource-tag and a first instance of requesting provisioning of an associated resource, and provisioning the associated resource and designating the associated resource as reusable. In the second section, the disclosed method includes encountering a second instance of requesting provisioning of the associated resource, determining that the associated resource was designated as being reusable, and reusing an already provisioned instance of the associated resource instead of provisioning a new instance and instead of destroying the already provisioned instance and re-provisioning the associated resource.

Abstract: The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.

Abstract: The disclosed technology teaches detecting abnormal behavior of a UE mobile device, including a network data analytics function component, in communication with core network components of a cellular network, subscribing to location change-related events that report a change event for a UE device connection to and/or drop or handover from a cell. Included is analyzing location change-related events to detect abnormal handover behavior when the UE device changes its selection of a base station or cell more than N times in not more than M minutes, and reporting the detected abnormal handover behavior with an identifier of the UE mobile device involved and the involved cell's ID. The technology also applies to a group of UE devices selected for analysis, by device, geography or custom-defined affinity, with selection changes among a set of base stations or neighboring cells, each selected at least twice by the UE device in M minutes.

Abstract: The disclosed technology teaches enhancing error messages from tests, providing an error annotation memory in which to store annotations of errors for reference upon recurrence of the errors. Following one or more tests, the technology includes parsing an error log and causing display to a user of one or more errors including error codes, and receiving from the user, for at least some of the errors, a respective error source category and/or problem resolution hint. The method also includes storing an error code and the respective error source category and/or problem resolution hint, received from the user, as an annotation in the error annotation memory. Further taught is receiving and correlating a subsequent error including a subsequent error code, with the error source category and/or problem resolution hint available from the error annotation memory, and enhancing a message accompanying the subsequent error and causing display of the enhanced message.