Abstract: A customer may request a service endpoint for a service in their virtual network on a provider network. In response, a service endpoint is generated in the customer's virtual network, a local IP address in the IP address range of the customer's virtual network is assigned to the service endpoint, and a DNS name is assigned to the service endpoint. Resources on the customer's virtual network resolve the DNS name of the service endpoint to obtain the local IP address of the service endpoint and send service requests for the service to the local IP address of the service endpoint. The service endpoint adds routing information to the service requests and sends the service requests over the network substrate to be routed to the service.

Abstract: Computing resource service providers allow customers to execute computer systems on hardware provided by the computing resource service provider. The hardware may be distributed between various geographic locations connected by a network. A load balancer may be provided to distribute traffic between the computer systems. Furthermore, computing resource service provider may cause computing resources to be allocated or deallocated to the load balancer based at least in part on various attributes of the computer systems the load balancer is responsible for distributing traffic to. The various attributes may include a capacity of the computer systems.

Abstract: A customer may request a service endpoint for a service in their virtual network on a provider network. In response, a service endpoint is generated in the customer's virtual network, a local IP address in the IP address range of the customer's virtual network is assigned to the service endpoint, and a DNS name is assigned to the service endpoint. Resources on the customer's virtual network resolve the DNS name of the service endpoint to obtain the local IP address of the service endpoint and send service requests for the service to the local IP address of the service endpoint. The service endpoint adds routing information to the service requests and sends the service requests over the network substrate to be routed to the service.

Abstract: A load balancer obtains respective workload metrics of various worker nodes of a distributed system. In response to determining that a work request is to be assigned, the load balancer generates a workload variation estimate associated with the worker nodes. Using the workload variation estimate, the load balancer determines a size of a candidate pool of worker nodes for the work request. The load balancer assigns the work request to a selected worker node from the candidate pool.