Abstract: The disclosed technology teaches enhancing error messages from tests, providing an error annotation memory in which to store annotations of errors for reference upon recurrence of the errors. Following one or more tests, the technology includes parsing an error log and causing display to a user of one or more errors including error codes, and receiving from the user, for at least some of the errors, a respective error source category and/or problem resolution hint. The method also includes storing an error code and the respective error source category and/or problem resolution hint, received from the user, as an annotation in the error annotation memory. Further taught is receiving and correlating a subsequent error including a subsequent error code, with the error source category and/or problem resolution hint available from the error annotation memory, and enhancing a message accompanying the subsequent error and causing display of the enhanced message.

Abstract: The disclosed technology teaches TCP session processing architecture for conducting numerous TCP sessions during testing of a network-under-test: multiple processor cores running, allocated to TCP session handling, and program instructions configured to distribute processing of each TCP session across multiple cores with a first set of cores allocated to handle TCP control, a second set of cores allocated to handle TCP packet transmission, and a third set of cores allocated to handle TCP packet receiving. The disclosed architecture also includes a shared memory accessible to the first, second and third sets of cores, that holds PCBs for each of numerous TCP sessions during the testing with update access controlled by an atomic spinlock processor instruction that each TCP state machine running on a core must engage to secure the update access to a respective PCB, in order to proceed with state processing of its respective TCP session.

Abstract: Disclosed is a method of efficient testing by selective UI interaction, through test script sections including setup, execution and verification, applied to an AUT that operates in both API mode and UI) mode, including providing a test environment that, when testing the UI mode of the AUT, defaults to ignoring the UI mode during setup and supplying setup values stored in a file directly to an API without rendering or interacting with UI elements in the setup section of the script. The method includes encountering an override directive in the setup section of the test script, which mandates interaction with a specified UI element in the setup section, and responsive to the directive, overriding of the default of ignoring the specified UI element in the setup section, rendering the specified UI element, and applying a bot to interact with and supply setup values from the file to the specified UI element.

Abstract: The disclosed technology for preparing digital samples for synthesis of RF to simulate channels and GNSS satellites using GPUs includes receiving simulated position and velocity of an antenna, dividing the cycle into points to be converted into the synthesized signal, and computing the points. A first LUT includes pseudo random sequences combinable to produce a code that varies over time for encoding the channel, and a second LUT specifies linear combinations of the pseudo random sequences in the first LUT that produce channel codes to produce the digital sample points. Also included is using GPUs to generate the channel code for a point by mapping the channel code and time position, combining the code with data to be encoded, repeatedly applying the using and combining to produce points, using multiple GPU cores to encode sample points concurrently in the cycle, and sending an ordered sequence of points to a converter.

Abstract: The disclosed technology teaches enhancing error messages from tests, providing an error annotation memory in which to store annotations of errors for reference upon recurrence of the errors. Following one or more tests, the technology includes parsing an error log and causing display to a user of one or more errors including error codes, and receiving from the user, for at least some of the errors, a respective error source category and/or problem resolution hint. The method also includes storing an error code and the respective error source category and/or problem resolution hint, received from the user, as an annotation in the error annotation memory. Further taught is receiving and correlating a subsequent error including a subsequent error code, with the error source category and/or problem resolution hint available from the error annotation memory, and enhancing a message accompanying the subsequent error and causing display of the enhanced message.

Abstract: The disclosed technology for utilizing already-provisioned components in a test scenario without need to purge and re-provision the already provisioned components includes interpreting first and second sections of a test script. In the first section, the method includes encountering a reusable-resource-tag and a first instance of requesting provisioning of an associated resource, and provisioning the associated resource and designating the associated resource as reusable. In the second section, the disclosed method includes encountering a second instance of requesting provisioning of the associated resource, determining that the associated resource was designated as being reusable, and reusing an already provisioned instance of the associated resource instead of provisioning a new instance and instead of destroying the already provisioned instance and re-provisioning the associated resource.

Abstract: The disclosed technology teaches testing with a test parameter data structure, applied to an AUT that operates in both API and UI mode, processing a configurable script to test in both modes. UI mode renders and interacts with UI elements utilizing values stored in the structure, used by the script in both modes, providing display mark-up in the script that is rendered in UI mode and formats fields to receive data that map to specific elements, leaving to be completed a mapping connection between the fields in the display and specific elements in the structure. The method includes providing a mapping of fields to elements, based on names, and while processing the script in UI mode, rendering the mark-up from the script, using a bot to interact with and complete the mark-up, applying the mapping to identify elements to complete fields, and causing processing of the fields in the mark-up.

Abstract: The present invention relates to testing signals on a coaxial home network that carries a digital video signal. It has direct application to testing Multimedia over Coax Alliance (MoCA) standards-compliant networks and applies to similar networks such as Data Over Cable Service Interface Specification (DOCSIS), Ethernet, and Wi-Fi. An embedded expert system can guide an inexperienced operator through the process of evaluating and resolving problems with a home network with little operator input.

Abstract: Disclosed is a method of providing dilution of precision (DOP) forecasts for GNSS navigation and optionally degree of confidence, for routing of vehicles or alerting humans in vehicles: accessing a 3D map of an area including structure solids and generating cuboids in spaces not contained in the structure solids, and iteratively over time increments, calculating GNSS satellites visible from the cuboids using the 3D map and, using at least the calculated visibility, determining a DOP forecast for GNSS signals observable in the cuboids at the time increments. The disclosed method also includes compressing the calculated DOP forecast spatially and temporally, and distributing the compressed DOP forecast via a content delivery network (CDN), responsive to queries from requestors to an API of the CDN, whereby the requestors' systems can take into account the DOP forecast for routing the vehicles or alerting the humans in the vehicles to a predicted navigation impairment.

Abstract: The technology disclosed teaches a method of path planning using a GNSS Forecast, requesting the GNSS Forecast of signal obscuration on behalf of a vehicle travelling in a region, receiving and using the Forecast to plan a path or route that has GNSS signals available over the path or route that satisfy a predetermined criterium. Also taught are GNSS Forecasts and planned paths or routes for a plurality of flying vehicles used by a flight control system, requesting the GNSS Forecast of signal obscuration on behalf of a flying autonomous or automated vehicle travelling in a region, receiving and using the Forecast and to plan a path with GNSS signals available over the path that satisfy predetermined criteria including accommodating real-time changes in flight paths, without leaving space, that satisfies the predetermined criteria. Also taught is certifying performance of GNSS receivers used on a flying vessel.

Abstract: The technology disclosed teaches a method of improving accuracy of a GNSS receiver that has a non-directional antenna, with the receiver sending CDN a request for predictive data for an area that includes the receiver. Responsive to the query, the method includes receiving data regarding LOS visibility for the receiver with respect to individual satellites, and the receiver using the data for satellite selection, for choosing some and ignoring other individual satellites. Also disclosed is using the data to exclude from satellite selection at least one individual satellite based on lack of LOS visibility to the individual satellite. Further disclosed is recognizing and rejecting spoofed GNSS signals received by a GNSS receiver that has a non-directional antenna, in response to a CDN response to a request for predictive data for an area that includes the receiver, with the receiver comparing the data with measures of signals received from individual satellites.

Abstract: The technology disclosed relates to implementing a virtual test platform (VTP) and running virtual test applications (VTAs) from an unsecured location. Using a phone home service, the VTP establishes a secure tunnel connection with a test controller. The VTP receives configuration information for a VTA from the test controller. If the VTA is not stored on the VTP, the VTP retrieves the VTA from a repository specified by the test controller. The configuration information from the test controller includes information needed for the VTP to set up a second secure tunnel. The VTP establishes the second secure tunnel and launches the VTA. The VTP relays information sent through the second tunnel to the VTA, and also relays messages from the VTA back to the test controller.

Abstract: Disclosed is a method of calibrating phase alignment of signals from multiple transmit antennas on multiple channels during OTA testing of a MIMO DUT, including generating a noisy test signal by adding noise to a signal pattern and transmitting the noisy test signal to the DUT on first and second channels OTA and sweeping a relative phase of the signal pattern, but not the added noise, in the first and second channels, while receiving from the DUT reports of a SNR for a received signal on at least one of the first channel and subsequently on the second channels. The method also includes analyzing variation in the SNR to determine phase alignment of the first and second channels, as received and processed by the DUT and using the determined phase alignment to perform OTA testing of the DUT. The method can also include receiving a RSRP and/or a RSSI.

Abstract: The technology disclosed provides a method of testing handling of HTTPS sessions of a plurality of clients with a plurality of servers by a switching, bridging or routing device (i.e., a DUT), where the testing is conducted by a test system coupled to ports on the DUT. The method includes using client state machines running on at least four processor cores, communicating through the DUT with server state machines running on at least four additional processor cores. The method also includes, for each connection between a client represented by a client state machine and a server represented by a server state machine, setting up an HTTPS session by negotiating an encryption protocol and completing an HTTPS handshake. Further, the method includes following the setup of between 100,000 HTTPS sessions and 10,000,000 HTTPS sessions, conducting a stress test including combining payload data and header information without using the negotiated encryption.

Abstract: The disclosed technology teaches training a NR VMOS score generator by generating synthetically impaired images from FR video using filters tuned to generate impaired versions and applying a FR VMOS generator to pairs of unimpaired FR images from the FR video and the impaired versions of the FR images to create ground truth scores for the impaired versions. The disclosed method also includes training by machine learning model an image evaluation classifier using the ground truth scores and the impaired versions to generate NR VMOS scores, and storing coefficients of the image evaluation classifier for use as the NR VMOS score generator. Also disclosed is generating a NR VMOS score by invoking the trained NR VMOS score generator, with stored coefficients generated by feeding the trained NR VMOS score generator with images captured from scenes in a video to be scored, and evaluating the images to generate NR VMOS scores.

Abstract: The disclosed technology provides resource locators keyed to resource names with failover alternate resource locators keyed to resource positions on user interfaces in a test environment: providing a central repository for resource locators and storing a set of alternative locator expressions for a resource in the central repository. The set includes first resource locators keyed to resource names on UIs and respective second resource locators keyed to resource positions on UIs that can be evaluated when the resource name in the respective first resource locator is invalid. The method invokes a resource location navigator to locate a particular resource using a first resource locator keyed to a resource name on the user interface, automatically invoking the resource location navigator using the second resource locator keyed to the resource position after failure of locating the particular resource using the resource name, and accessing the particular resource using the second resource locator.

Abstract: The technology disclosed relates to a method for storing and time-correlating real-time and queryable test results of a test of a device under test (DUT). The method includes initiating the test applied to the DUT to collect real-time data from a multitude of data streams for multiple aspects of the DUT, the collected data including counters and fact-type values, the collected data having imperfectly synchronized time bases and the collected data being collected from different sources asynchronously at different times, specifying a recording time interval for recording the data collected among multiple databases, recording data according to the specified recording time interval, such that each piece of the recorded data is associated with a particular time interval, and at a conclusion of the test, correlating the recorded data with the test configuration data about a test state in the respective time intervals.

Abstract: An SQL interceptor inserted as a proxy between a database client and the corresponding database server intercepts a constrained application-generated SQL query and composes a new data request. Parameter values in the SQL query determine whether the new data request is sent to a database server or a web service provider. A reserved table name specified in the SQL query triggers a rewrite of the data request. Parameter values in the query are used to select among a plurality of executable modules to use for rewriting the data request. Special data encoding and formats need to be used based on the source of data that will receive and respond to the rewritten data request. For example, communication between a database client and server may use a vendor-specific, non-standard binary encoding, and XML and JSON response data must be reformatted as an SQL response for processing by the database client.

Abstract: The disclosed technology addresses the problem of testing performance of RU scheduling algorithms used by an OFDMA enabled AP to support multiple clients, using a two-armed test harness with a wired connection to one side of an AP under test and multiple wireless clients coupled in RF communication with the AP. The wireless clients can be connected over the air or conductively to antenna(s) of the AP under test. The test harness generates test traffic. A sniffer radio listens to RU allocation and schedules traffic broadcast by the AP to multiple clients. A recording module records the RU allocation and traffic and a report generator categorizes the recorded resource allocation with the scheduling traffic heard by the sniffer radio and provides resource allocation statistics. The wireless clients are connected conductively or OTA to antennas of the AP under test. One sniffer radio replaces multiple sniffers used in prior test systems.

Abstract: The disclosed methods and systems of using TWAMP measurement architecture for testing a large network include a control-client running on a first network host initializing memory for test session parameters used to originate a test, parsing a configuration file to populate the memory with IP addresses, ports and QoS parameters for control-servers and session-reflectors; and originating test sessions using the test session parameters.