Abstract: A system and method for automatically scaling consumer servers in a data processing system. To build an automatic scaling system, the present disclosure allows consumers to obtain additional information, e.g., the number of events that await to be read from an aggregator when receiving an event from the aggregator. This additionally obtained number provides a direct gauge for the data processing system to determine when the consumers are over-provisioned, i.e., when the number of events left to be read is close to zero, as well as when the consumers are under-provisioned, e.g., when the number of events left to be read continues to increase. As a result, the consumers can be automatically scaled to handle the dynamic data processing demand while providing optimal resource allocation.

Abstract: A system and method for automatically scaling consumer servers in a data processing system. To build an automatic scaling system, the present disclosure allows consumers to obtain additional information, e.g., the number of events that await to be read from an aggregator when receiving an event from the aggregator. This additionally obtained number provides a direct gauge for the data processing system to determine when the consumers are over-provisioned, i.e., when the number of events left to be read is close to zero, as well as when the consumers are under-provisioned, e.g., when the number of events left to be read continues to increase. As a result, the consumers can be automatically scaled to handle the dynamic data processing demand while providing optimal resource allocation.

Abstract: Environments for testing are deployed. A library of different topology groupings is provided. An interface is presented to a user for receiving environment definitions. Elements from the library of different topology groupings are automatically provided to the user for creating a test environment according to the received environment definitions. The platform delivers fully configured instantaneous topology deployments of all flavors for product development and testing efforts. The topology deployment service platform is used to create reliable topologies of varying layers of complexity, varying machine providers, different roles, different product builds, integration with partners and varying product configurations. The ability to launch and create multiple test and development environments trivially in an automated reliable fashion allows complicated customer scenarios and configurations to be deployed.

Abstract: Environments for testing are deployed. A library of different topology groupings is provided. An interface is presented to a user for receiving environment definitions. Elements from the library of different topology groupings are automatically provided to the user for creating a test environment according to the received environment definitions. The platform delivers fully configured instantaneous topology deployments of all flavors for product development and testing efforts. The topology deployment service platform is used to create reliable topologies of varying layers of complexity, varying machine providers, different roles, different product builds, integration with partners and varying product configurations. The ability to launch and create multiple test and development environments trivially in an automated reliable fashion allows complicated customer scenarios and configurations to be deployed.