Abstract: Provided are systems and methods for sampling packets based on large flow detection, for network visibility monitoring. In some implementations, provided is an integrated circuit. The integrated circuit may include large-flow detection logic and a sampling determination logic. The integrated circuit may be operable to received packet information describing a packet a cycle of a clock input. The packet may be associated with a packet flow being transmitted through a network. The integrated circuit may further be operable to determine, using the large-flow detection logic, whether the packet is associated with a large packet flow or a small packet flow. Upon determining that the packet is associated with a small packet flow, the integrated circuit may update the sampling determination logic.

Abstract: Provided are systems and methods for network visibility monitoring. In some implementation, provided is an integrated circuit. The integrated circuit may include a large-flow detection logic operable to determine whether a packet is associated with a large packet flow or a small packet flow, a large-flow caching logic operable to store information about packet flows, a sampling logic operable to sample packets, and a unique-flow estimation logic. The integrated circuit may be operable to receive packets from a network during a pre-determined interval, The integrated circuit may further determine an estimate of the number of unique flows represented by the packets, identify large packet flows by identifying packets associated with the large packet flows, store information about the large packet flows, determine packets associated with small packet flows, and sample the packets determined to be associated with the small packet flows to create packet samples.

Abstract: Provided are systems and methods for large flow detection for network visibility monitoring. In some implementations, provided is an integrated circuit. The integrated circuit may be operable to receive packet information describing a packet at a cycle of a clock input. The packet may be associated with a packet flow being transmitted across a network. The integrated circuit may further generate a key using information identifying the packet flow provided by the packet information. The integrated circuit may further read a value for a counter from a counter memory using the key. The integrated circuit may determine whether the packet is associated with a large flow or a small flow using the counter and a packet size provided by the packet information. Upon determining that the packet is associated with a large flow, the integrated circuit may update an entry in a flow memory using the packet information.

Abstract: Apparatus for routing requests from a plurality of connected clients to a plurality of connected servers comprises a processor, memory and a network interface. The processor is configured to run a plurality of identical processes, each being for receiving requests and connecting each received request to a server. For each process, the processor is configured to maintain a queue of requests in memory, determine a number of queued requests that may be connected to a server, and attempt to connect this number of queued requests. The processor then accepts further requests, and if the queue is not empty, places the further requests in the queue, and if the queue is empty, attempts to connect the further requests. The processor determines the number of queued requests that may be connected to a server in dependence upon the length of the queues of all the processes and the number of available connections.

Abstract: Apparatus for processing requests from a plurality of connected clients for data stored by a plurality of connected servers comprising a processor, memory, storage, a network interface, and a user input device is disclosed. The processor is configured to receive requests from the connected clients via the network interface, select a connected server to route each requests to, thereby defining a selected server per request, create a connection per request to its selected server using the network interface, route the requests to their selected servers using the connections, and monitor the connections while the selected servers service the requests, so as to create monitored connection data for each connection. The monitored connection data is stored in data structures that are referenced by a buffer, and upon creation of a data structure relating to the most recently created connection, reference to the oldest data structure in the buffer is removed.

Abstract: Apparatus for processing requests from a plurality of connected clients for data stored by a plurality of connected servers comprising a processor, memory, storage, a network interface, and a user input device is disclosed. The processor is configured to receive requests from the connected clients via the network interface, select a connected server to route each requests to, thereby defining a selected server per request, create a connection per request to its selected server using the network interface, route the requests to their selected servers using the connections, and monitor the connections whilst the selected servers service the requests, so as to create monitored connection data for each connection. The monitored connection data is stored in data structures that are referenced by a buffer, and upon creation of a data structure relating to the most recently created connection, reference to the oldest data structure in the buffer is removed.

Abstract: Apparatus for routing requests from a plurality of connected clients to a plurality of connected servers comprises a processor, memory and a network interface. The processor is configured to run a plurality of identical processes, each being for receiving requests and connecting each received request to a server. For each process, the processor is configured to maintain a queue of requests in memory, determine a number of queued requests that may be connected to a server, and attempt to connect this number of queued requests. The processor then accepts further requests, and if the queue is not empty, places the further requests in the queue, and if the queue is empty, attempts to connect the further requests. The processor determines the number of queued requests that may be connected to a server in dependence upon the length of the queues of all the processes and the number of available connections.

Abstract: Network traffic is distributed between a plurality of networked computers. The traffic comprises requests that are received into the network and replicated to each computer. For each request, each computer makes a decision based on attributes of the request as to whether to process or ignore the request, such that each request is processed by only one computer. Each computer periodically broadcasts a signal to each of the other computers to confirm that it is online. When a first computer is no longer online, the traffic is redistributed amongst the remaining online computers, wherein traffic that is already processed by the remaining computers is not redistributed, traffic that would have been processed by the first computer is split evenly between the remaining computers, and each computer decides independently and identically how to redistribute the traffic without communicating with the other computers.