Abstract: Creation of a virtual overlay for a multipath network with tiered topology is disclosed. A virtual-node module may group network nodes connected within a common tier, which is initially the tier furthest from the core. This module may also group network nodes at a consecutive tier, closer to the core, that connect a pairs of groupings in the common tier by links between the common and consecutive tiers. Groupings with a common network node may be combined and designated as virtual nodes. A virtual-link module may sum bandwidths for network links between virtual-node pairs with nodes in both the common and consecutive tiers. A check module may combine virtual nodes and links and network nodes and links not yet virtualized in a graph, which it may check for a cycle. An iteration module may iterate both tiers toward the core, triggering further grouping, summing, and updating until no loop exists.

Abstract: Systems and methods are disclosed for aggregating data capable of diagnosing unique datacenter issues. Traffic statistic collection may be moved from intermediate, datacenter nodes to end hosts providing reports for aggregation and correlation with events at an analytic controller, uncovering implications for such events. To track metrics and/or diagnose datacenter issues not addressed in traffic statistics, information locally available to the end hosts may be combined and/or correlated with traffic statistics. Examples may involve information about: virtual and physical computing resources; a sub-cluster; an application and/or process utilized by a datacenter task; a task/job type; an implementation phase; an initiating user; a task priority; link utilization and/or other traffic statistics relative to the foregoing.

Abstract: Systems and methods are disclosed for traffic engineering and traffic flow control in a datacenter. Flow agents may be provided at hosts that may be operable to control a rate at which a traffic flow is sent from one point to another within a datacenter to facilitate differing levels of Quality of Service (QoS). The differing levels of QoS may be implemented by differing sizes of bandwidth allocations assigned remotely by a traffic engineering controller. The traffic engineering controller may distribute the differing allocations of bandwidth to the flow agents corresponding to the traffic flows to keep the traffic flow rates within the bandwidth allocation. An augmenting function may also be applied at the traffic engineering controller to maximize bandwidth utilization by checking for unutilized bandwidth and reallocating such bandwidth in accordance with one or more QoS.

Abstract: Systems and methods are disclosed for generating traffic statistics for a datacenter. Distributed, parallel processing may be used to generate traffic statistics from data sets about traffic in a datacenter. To reduce data sets from which such statistics are derived to manageable sizes and relevant processing times for distributed, parallel processing, traffic agents may be provided at end hosts in the datacenter. The traffic agents may summarize data traffic over large numbers of packets in terms of the various sockets over which they are transmitted. Reports on the various sockets may be sent by the various flow agents that monitor them to an analytic controller. The analytic controller may aggregate, provide flow-path information for, further reduce, and/or provision the resultant data for distributed parallel processing.

Abstract: Creation of a virtual overlay for a multipath network with tiered topology is disclosed. A virtual-node module may group network nodes connected within a common tier, which is initially the tier furthest from the core. This module may also group network nodes at a consecutive tier, closer to the core, that connect a pairs of groupings in the common tier by links between the common and consecutive tiers. Groupings with a common network node may be combined and designated as virtual nodes. A virtual-link module may sum bandwidths for network links between virtual-node pairs with nodes in both the common and consecutive tiers. A check module may combine virtual nodes and links and network nodes and links not yet virtualized in a graph, which it may check for a cycle. An iteration module may iterate both tiers toward the core, triggering further grouping, summing, and updating until no loop exists.

Abstract: Systems and methods are disclosed for generating traffic statistics for a datacenter. Distributed, parallel processing may be used to generate traffic statistics from data sets about traffic in a datacenter. To reduce data sets from which such statistics are derived to manageable sizes and relevant processing times for distributed, parallel processing, traffic agents may be provided at end hosts in the datacenter. The traffic agents may summarize data traffic over large numbers of packets in terms of the various sockets over which they are transmitted. Reports on the various sockets may be sent by the various flow agents that monitor them to an analytic controller. The analytic controller may aggregate, provide flow-path information for, further reduce, and/or provision the resultant data for distributed parallel processing.

Abstract: Systems and methods are disclosed for classifying traffic flows. A traffic agent operable to collect classification information for one or more traffic flows may be deployed at an end host communicatively coupled to a data-center network. The traffic agent, deployed in a user space independent of the operating system, may compare the classification information for a given traffic flow to a metric value. Where the classification information achieves a certain threshold indicated by the metric value, the traffic agent may classify the traffic flow as an elephant flow. In some examples, a library may be included with the traffic agent that may include a modified send function. The modified send function may provide classification information to the traffic agent indexed to the traffic flow for which it is called so that the traffic agent may analyze the classification information to potentially provide a classification for the traffic flow.

Abstract: Systems and methods are disclosed for aggregating data capable of diagnosing unique datacenter issues. Traffic statistic collection may be moved from intermediate, datacenter nodes to end hosts providing reports for aggregation and correlation with events at an analytic controller, uncovering implications for such events. To track metrics and/or diagnose datacenter issues not addressed in traffic statistics, information locally available to the end hosts may be combined and/or correlated with traffic statistics. Examples may involve information about: virtual and physical computing resources; a sub-cluster; an application and/or process utilized by a datacenter task; a task/job type; an implementation phase; an initiating user; a task priority; link utilization and/or other traffic statistics relative to the foregoing.

Abstract: In one exemplary aspect, a method of managing computer network traffic flow quality of service includes the step of configuring a configurable network device to provide a specified quality of service to a data packet with a specified quality of service configuration based on a quality of service classification port number in a data packet header of the data packet. At the source node, a data packet is generated. At the source node, replacing the destination port number in the data packet header with a quality of service classification port number. At the source node, the destination port number is included in an options field of the data packet's header. The data packet is communicated to the configurable network device. At the destination node, receiving the data packet, replacing the quality of service classification port number with the original destination port number, and forwarding the packet to a destination process.

Abstract: In one exemplary aspect, a method of managing computer network traffic flow quality of service includes the step of configuring a configurable network device to provide a specified quality of service to a data packet with a specified quality of service configuration based on a quality of service classification port number in a data packet header of the data packet. At the source node, a data packet is generated. At the source node, replacing the destination port number in the data packet header with a quality of service classification port number. At the source node, the destination port number is included in an options field of the data packet's header. The data packet is communicated to the configurable network device. At the destination node, receiving the data packet, replacing the quality of service classification port number with the original destination port number, and forwarding the packet to a destination process.

Abstract: Systems and methods are disclosed for traffic engineering and traffic flow control in a datacenter. Flow agents may be provided at hosts that may be operable to control a rate at which a traffic flow is sent from one point to another within a datacenter to facilitate differing levels of Quality of Service (QoS). The differing levels of QoS may be implemented by differing sizes of bandwidth allocations assigned remotely by a traffic engineering controller. The traffic engineering controller may distribute the differing allocations of bandwidth to the flow agents corresponding to the traffic flows to keep the traffic flow rates within the bandwidth allocation. An augmenting function may also be applied at the traffic engineering controller to maximize bandwidth utilization by checking for unutilized bandwidth and reallocating such bandwidth in accordance with one or more QoS.

Abstract: Systems and methods are disclosed for classifying traffic flows. A traffic agent operable to collect classification information for one or more traffic flows may be deployed at an end host communicatively coupled to a data-center network. The traffic agent, deployed in a user space independent of the operating system, may compare the classification information for a given traffic flow to a metric value. Where the classification information achieves a certain threshold indicated by the metric value, the traffic agent may classify the traffic flow as an elephant flow. In some examples, a library may be included with the traffic agent that may include a modified send function. The modified send function may provide classification information to the traffic agent indexed to the traffic flow for which it is called so that the traffic agent may analyze the classification information to potentially provide a classification for the traffic flow.

Abstract: Systems and methods are disclosed for generating traffic statistics for a datacenter. Distributed, parallel processing may be used to generate traffic statistics from data sets about traffic in a datacenter. To reduce data sets from which such statistics are derived to manageable sizes and relevant processing times for distributed, parallel processing, traffic agents may be provided at end hosts in the datacenter. The traffic agents may summarize data traffic over large numbers of packets in terms of the various sockets over which they are transmitted. Reports on the various sockets may be sent by the various flow agents that monitor them to an analytic controller. The analytic controller may aggregate, provide flow-path information for, further reduce, and/or provision the resultant data for distributed parallel processing.