Patents by Inventor Winston Wencheng Liu

Winston Wencheng Liu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 12210890
    Abstract: One method occurs at an impairment test system.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: January 28, 2025
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Winston Wencheng Liu, Razvan Ionut Stan, Thomas Ameling
  • Patent number: 12177107
    Abstract: The subject matter described herein includes methods, systems, and computer readable media for non-intrusive queue analysis. A method for non-intrusive queue analysis occurs at a test analyzer of a test system, the test analyzer for analyzing packet queue performance of a system under test (SUT). The method comprising: receiving, via at least one mirrored ingress port of the SUT, a plurality of copied ingress test packets; receiving, via at least one mirrored egress port of the SUT, a plurality of copied egress test packets; correlating, using a correlation technique, the plurality of copied ingress test packets and the plurality of copied egress test packets; and generating, using the correlated packets, at least one packet queue performance metric associated with the SUT.
    Type: Grant
    Filed: February 8, 2023
    Date of Patent: December 24, 2024
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Thomas Ameling, Razvan Ionut Stan, Winston Wencheng Liu, Dan Mihailescu
  • Publication number: 20240338307
    Abstract: Methods, systems, and computer readable media for emulating and testing data flows in distributed computing systems. An example system includes a workload abstractor configured for receiving monitored traffic in a distributed computing system performing a machine learning task and generating, using the monitored traffic, a test environment-agnostic workload model for the machine learning task and storing the test environment-agnostic workload model in a workload model repository with one or more other workload models. The system includes a test controller configured for selecting a test case for the machine learning task and a testbed mode for the test case; executing the test case by translating the test environment-agnostic workload model into a testbed-specific workload model for the testbed mode; and reporting, based on executing the test case, one or more performance metrics for the machine learning task.
    Type: Application
    Filed: April 5, 2023
    Publication date: October 10, 2024
    Inventors: Winston Wencheng Liu, Konstantin Belov, Ankur Pankaj Sheth, Dan Mihailescu
  • Publication number: 20240267317
    Abstract: The subject matter described herein includes methods, systems, and computer readable media for non-intrusive queue analysis. A method for non-intrusive queue analysis occurs at a test analyzer of a test system, the test analyzer for analyzing packet queue performance of a system under test (SUT). The method comprising: receiving, via at least one mirrored ingress port of the SUT, a plurality of copied ingress test packets; receiving, via at least one mirrored egress port of the SUT, a plurality of copied egress test packets; correlating, using a correlation technique, the plurality of copied ingress test packets and the plurality of copied egress test packets; and generating, using the correlated packets, at least one packet queue performance metric associated with the SUT.
    Type: Application
    Filed: February 8, 2023
    Publication date: August 8, 2024
    Inventors: Thomas Ameling, Razvan Ionut Stan, Winston Wencheng Liu, Dan Mihailescu
  • Patent number: 11949566
    Abstract: Methods, systems, and computer readable media for testing a system under test (SUT). An example system includes a distributed processing node emulator configured for emulating a multi-processing node distributed computing system using a processing node communications model and generating intra-processing node communications and inter-processing node communications in the multi-processing node distributed computing system. At least a portion of the inter-processing node communications comprises one or more messages communicated with the SUT by way of a switching fabric. The system includes a test execution manager configured for managing the distributed processing node emulator to execute a pre-defined test case, monitoring the SUT, and outputting a test report based on monitoring the SUT during execution of the pre-defined test case.
    Type: Grant
    Filed: September 6, 2022
    Date of Patent: April 2, 2024
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Winston Wencheng Liu, Dan Mihailescu, Matthew R. Bergeron
  • Publication number: 20240080244
    Abstract: Methods, systems, and computer readable media for testing a system under test (SUT). An example system includes a distributed processing node emulator configured for emulating a multi-processing node distributed computing system using a processing node communications model and generating intra-processing node communications and inter-processing node communications in the multi-processing node distributed computing system. At least a portion of the inter-processing node communications comprises one or more messages communicated with the SUT by way of a switching fabric. The system includes a test execution manager configured for managing the distributed processing node emulator to execute a pre-defined test case, monitoring the SUT, and outputting a test report based on monitoring the SUT during execution of the pre-defined test case.
    Type: Application
    Filed: September 6, 2022
    Publication date: March 7, 2024
    Inventors: Winston Wencheng Liu, Dan Mihailescu, Matthew R. Bergeron
  • Patent number: 11855872
    Abstract: Methods, systems, and computer readable media for network traffic generation using machine learning. An example method includes collecting first traffic from a production data center environment. At least a portion of the first traffic comprises live computer network traffic transiting the production data center environment. The method includes collecting second traffic from an emulated data center testbed device. At least a portion of the second traffic comprises testbed traffic that transits an emulated data center switching fabric of the emulated data center testbed device. The method includes training a traffic generation inference engine using the first traffic and the second traffic. The method includes generating, using the traffic generation inference engine, test traffic to test or stimulate a network system under test (SUT).
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: December 26, 2023
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Winston Wencheng Liu, Dan Mihailescu, Razvan Ionut Stan, Thomas Ameling
  • Patent number: 11729087
    Abstract: One example method occurs at a test system implemented using at least one processor, the method comprising: sending, via an application programming interface (API) and to a first traffic generator, a first instruction for setting a rate of background test packets sent to or via a system under test (SUT) for a test session; sending the background test packets to or via the SUT during the test session; receiving, from at least one feedback entity, feedback indicating at least one traffic metric associated with the background test packets sent to or via the SUT during the test session; generating, using the feedback, a second instruction for adjusting the rate of background test packets sent during the test session; and providing, via the API and to the first traffic generator, the second instruction for adjusting the rate of background test packets sent to or via the SUT during the test session.
    Type: Grant
    Filed: December 3, 2021
    Date of Patent: August 15, 2023
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Matthew R. Bergeron, Thomas Ameling, Winston Wencheng Liu, Razvan Ionut Stan
  • Publication number: 20230179506
    Abstract: One example method occurs at a test system implemented using at least one processor, the method comprising: sending, via an application programming interface (API) and to a first traffic generator, a first instruction for setting a rate of background test packets sent to or via a system under test (SUT) for a test session; sending the background test packets to or via the SUT during the test session; receiving, from at least one feedback entity, feedback indicating at least one traffic metric associated with the background test packets sent to or via the SUT during the test session; generating, using the feedback, a second instruction for adjusting the rate of background test packets sent during the test session; and providing, via the API and to the first traffic generator, the second instruction for adjusting the rate of background test packets sent to or via the SUT during the test session.
    Type: Application
    Filed: December 3, 2021
    Publication date: June 8, 2023
    Inventors: Matthew R. Bergeron, Thomas Ameling, Winston Wencheng Liu, Razvan Ionut Stan
  • Publication number: 20230171177
    Abstract: Methods, systems, and computer readable media for network traffic generation using machine learning. An example method includes collecting first traffic from a production data center environment. At least a portion of the first traffic comprises live computer network traffic transiting the production data center environment. The method includes collecting second traffic from an emulated data center testbed device. At least a portion of the second traffic comprises testbed traffic that transits an emulated data center switching fabric of the emulated data center testbed device. The method includes training a traffic generation inference engine using the first traffic and the second traffic. The method includes generating, using the traffic generation inference engine, test traffic to test or stimulate a network system under test (SUT).
    Type: Application
    Filed: July 6, 2021
    Publication date: June 1, 2023
    Inventors: Winston Wencheng Liu, Dan Mihailescu, Razvan Ionut Stan, Thomas Ameling
  • Patent number: 11621908
    Abstract: The subject matter described herein includes methods, systems, and computer readable media for stateless service traffic generation. A method for stateless service traffic generation occurs at a network equipment test system. The method includes generating, at a first transmit port associated with the network equipment test system, a first test packet flow comprising one or more packets, wherein the first test packet flow indicates a match and action instruction for triggering an action at a second transmit port associated with the network equipment test system; sending the first test packet flow toward a node associated with a data center under test (DCUT); receiving the first test packet flow from the node associated with the DCUT; and performing, using the match and action instruction, the action at the second transmit port associated with the network equipment test system.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: April 4, 2023
    Assignee: Keysight Technologies, Inc.
    Inventors: Winston Wencheng Liu, Matthew R. Bergeron, Kingshuk Mandal, Alon Regev, Dan Mihailescu, Soumava Das
  • Patent number: 11570050
    Abstract: A method for configuring a network service system for performing a network service using AR comprises: at a user device executing an AR cabling application: communicating, to an AR cabling subsystem of the network service system, network service task identification information usable for identifying at least one testing or monitoring case (TMC) definition provisioned within the network service system; receiving, from the AR cabling subsystem of the network service system, cabling instructions based on the network service task identification information, wherein the cabling instructions is for instructing the user to perform a cabling task associated with the at least one TMC definition, wherein the cabling task involves connecting at least one cable to one or more physical ports of a physical resource of the network service system; and providing, via a display and using at least one AR element, the cabling instructions for instructing the user to perform the cabling task.
    Type: Grant
    Filed: November 30, 2020
    Date of Patent: January 31, 2023
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Thomas Ameling, Winston Wencheng Liu, Razvan Ionut Stan
  • Publication number: 20230006912
    Abstract: Methods, systems, and computer readable media for network traffic generation using machine learning. An example method includes collecting first traffic from a production data center environment. At least a portion of the first traffic comprises live computer network traffic transiting the production data center environment. The method includes collecting second traffic from an emulated data center testbed device. At least a portion of the second traffic comprises testbed traffic that transits an emulated data center switching fabric of the emulated data center testbed device. The method includes training a traffic generation inference engine using the first traffic and the second traffic. The method includes generating, using the traffic generation inference engine, test traffic to test or stimulate a network system under test (SUT).
    Type: Application
    Filed: July 6, 2021
    Publication date: January 5, 2023
    Inventors: Winston Wencheng Liu, Dan Mihailescu, Razvan Ionut Stan, Thomas Ameling
  • Patent number: 11483228
    Abstract: One method occurs at a test controller of a network test system implemented using at least one processor.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: October 25, 2022
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Winston Wencheng Liu, Matthew R. Bergeron
  • Publication number: 20220253324
    Abstract: One method occurs at an impairment test system.
    Type: Application
    Filed: February 9, 2021
    Publication date: August 11, 2022
    Inventors: Winston Wencheng Liu, Razvan Ionut Stan, Thomas Ameling
  • Publication number: 20220247661
    Abstract: One method occurs at a test controller of a network test system implemented using at least one processor.
    Type: Application
    Filed: January 29, 2021
    Publication date: August 4, 2022
    Inventors: Winston Wencheng Liu, Matthew R. Bergeron
  • Patent number: 11405302
    Abstract: According to one method, the method occurs at a test system implemented using at least one processor. The method includes receiving test configuration information associated with a test session for configuring a test infrastructure connecting at least one test application and a system under test (SUT), wherein the test infrastructure includes at least two CTI devices that are dynamically configurable to perform one or more test related functions; configuring, using test configuration information, the test infrastructure to handle traffic for the test session; initiating the test session, wherein the test session involves using the at least two CTI devices and the at least one test application to test the SUT; and obtaining and reporting test results associated with the test session.
    Type: Grant
    Filed: March 11, 2021
    Date of Patent: August 2, 2022
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Winston Wencheng Liu, Konstantin Belov, Matthew R. Bergeron
  • Publication number: 20220173967
    Abstract: A method for configuring a network service system for performing a network service using AR comprises: at a user device executing an AR cabling application: communicating, to an AR cabling subsystem of the network service system, network service task identification information usable for identifying at least one testing or monitoring case (TMC) definition provisioned within the network service system; receiving, from the AR cabling subsystem of the network service system, cabling instructions based on the network service task identification information, wherein the cabling instructions is for instructing the user to perform a cabling task associated with the at least one TMC definition, wherein the cabling task involves connecting at least one cable to one or more physical ports of a physical resource of the network service system; and providing, via a display and using at least one AR element, the cabling instructions for instructing the user to perform the cabling task.
    Type: Application
    Filed: November 30, 2020
    Publication date: June 2, 2022
    Inventors: Thomas Ameling, Winston Wencheng Liu, Razvan Ionut Stan
  • Publication number: 20220014457
    Abstract: The subject matter described herein includes methods, systems, and computer readable media for stateless service traffic generation. A method for stateless service traffic generation occurs at a network equipment test system. The method includes generating, at a first transmit port associated with the network equipment test system, a first test packet flow comprising one or more packets, wherein the first test packet flow indicates a match and action instruction for triggering an action at a second transmit port associated with the network equipment test system; sending the first test packet flow toward a node associated with a data center under test (DCUT); receiving the first test packet flow from the node associated with the DCUT; and performing, using the match and action instruction, the action at the second transmit port associated with the network equipment test system.
    Type: Application
    Filed: May 13, 2021
    Publication date: January 13, 2022
    Inventors: Winston Wencheng Liu, Matthew R. Bergeron, Kingshuk Mandal, Alon Regev, Dan Mihailescu, Soumava Das
  • Patent number: 11212260
    Abstract: A method for dynamic firewall configuration for accessing service hosted in virtual networks includes monitoring, in a virtual network, changes in an Internet protocol (IP) address of a service hosted in a virtual network. The method further includes detecting a change the IP address of the service hosted in the virtual network. The method further includes communicating notification of the change in IP address to a firewall policy management interface. The method further includes, automatically configuring a firewall to allow access to the service hosted in the virtual network.
    Type: Grant
    Filed: March 24, 2018
    Date of Patent: December 28, 2021
    Assignee: KEYSIGHT TECHNOLOGIES, INC.
    Inventors: Kristopher Len Raney, Winston Wencheng Liu, Matthew R. Bergeron