Abstract: A network function execution intermediary obtains a result of execution of a set of network functions on a particular packet directed to a service from a client program running at a first host. Using the result, the packet is delivered to a request handler of the service, running at a second host; the path used for delivering the particular packet includes the network function execution intermediary. A networking manager of the first host obtains a rule for determining results of the set of network functions with respect to additional packets directed from the client program to the service. The networking manager causes, using the rule, another packet originating at the client program to be delivered to the request handler via a different path which does not include the network function execution intermediary.

Abstract: Techniques for load balancing based on relative credit balances are described. For example, one embodiment of a method comprises: determining current credit balances for a plurality of compute instances; receiving a request; selecting one of the compute instances to be a destination for the request based on a comparison of the current credit balances; and transmitting the request to the selected compute instance.