Abstract: Some embodiments provide a method that identifies a first number of requests received at a first application. Based on the first number of requests received at the first application, the method determines that a second application that processes requests after processing by the first application requires additional resources to handle a second number of requests that will be received at the second application. The method increases the amount of resources available to the second application prior to the second application receiving the second number of requests.

Abstract: Dynamically scaling control plane for ingress services for large numbers of applications with minimal traffic disruption includes receiving an estimate of a number of applications to be executed by multiple clusters implemented by an orchestrator platform. Each cluster includes multiple containers. The multiple clusters implement a centralized controller that control execution of the applications by the multiple clusters. The centralized controller is sharded into a variable number of controllers that collectively control the estimated number of applications based on the estimate of the number of applications and a pre-determined number of applications that each controller can control. Each controller of the variable number of controllers controls an execution of a respective subset of the applications. In response to a change in the number of applications over time, the number of controllers is modified based on a number of applications to be executed by the multiple clusters at any given time.

Abstract: Some embodiments provide a method for scaling a service chain that includes multiple services, each of which is provided by one or more instances of the service. The method identifies that a first service in the service chain has received a number of requests. For each service in the service chain, the method (i) identifies a scaling factor that estimates a portion of requests received at the first service that will be subsequently received at the service and (ii) deploys a number of additional instances of the service based on the identified scaling factor for the service and the number of requests received at the first service.

Abstract: Some embodiments provide a method that identifies a first number of requests received at a first application. Based on the first number of requests received at the first application, the method determines that a second application that processes requests after processing by the first application requires additional resources to handle a second number of requests that will be received at the second application. The method increases the amount of resources available to the second application prior to the second application receiving the second number of requests.

Abstract: Dynamically scaling control plane for ingress services for large numbers of applications with minimal traffic disruption includes receiving an estimate of a number of applications to be executed by multiple clusters implemented by an orchestrator platform. Each cluster includes multiple containers. The multiple clusters implement a centralized controller that control execution of the applications by the multiple clusters. The centralized controller is sharded into a variable number of controllers that collectively control the estimated number of applications based on the estimate of the number of applications and a pre-determined number of applications that each controller can control. Each controller of the variable number of controllers controls an execution of a respective subset of the applications. In response to a change in the number of applications over time, the number of controllers is modified based on a number of applications to be executed by the multiple clusters at any given time.