Abstract: Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.

Abstract: A test system includes a controller that creates test jobs to simulate a load for testing a target system or service. The jobs specify test data from a data store. The controller adds the test jobs to a job queue at a rate. Workers access jobs from the job queue and request data from the data store as specified in each job and send the request data to the service. Approximations (e.g., metric values indicating performance of the worker host resources, or performance of the system under test or performance of resources that implement the system under test, other feedback, etc.) of actual system characteristics such as the actual number of workers are obtained. Based on the metric values, the controller modulates various characteristics of the load generation system, such as a rate at which jobs are added to the job queue or the number of workers processing jobs.

Abstract: Methods, systems, and computer-readable media for record-by-record live migration using segmentation are disclosed. Migration of a data set comprises, for a record in a segment being migrated, storing a first status indicating that the record is offline in a source data store. An instance of the record is stored in the destination data store, and a second status is stored to indicate that the record is online in the destination. The record is deleted from the source after the second status is stored. During the migration, a read request for the record is received and determined to be associated with the segment being migrated. A response to the read request is generated that comprises an authoritative instance of the record. The instance of the record in the destination is determined to represent the authoritative instance based (at least in part) on the first status and the second status.

Abstract: Methods, systems, and computer-readable media for segmentation of maintenance on distributed systems are disclosed. A data set is partitioned according to a hash function into a plurality of segments. A maintenance activity is initiated on a first segment. During the maintenance activity, a first request to perform a first action on the data set is received. Based at least in part on determining that the first request is associated with the first segment using the hash function, the first action is performed using additional processing associated with the maintenance activity. During the maintenance activity, a second request to perform a second action on the data set is received. Based at least in part on determining that the second request is associated with a second segment using the hash function, the second action is performed without the additional processing associated with the maintenance activity.

Abstract: Remote computing resource service providers, including online retailer, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and service inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. A coordinator may archive aggregated testing resources located on the isolated network and deploy the testing resources to the one or more external hosts. A database may be used to track the deployment state of the one or more external hosts in order to allow the coordinator to manage the testing process.

Abstract: Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.

Abstract: Remote computing resource service providers, including online retailer, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and service inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. A coordinator may archive aggregated testing resources located on the isolated network and deploy the testing resources to the one or more external hosts. A database may be used to track the deployment state of the one or more external hosts in order to allow the coordinator to manage the testing process.

Abstract: Remote computing resource service providers, including online retailer, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and service inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. A coordinator may archive aggregated testing resources located on the isolated network and deploy the testing resources to the one or more external hosts. A database may be used to track the deployment state of the one or more external hosts in order to allow the coordinator to manage the testing process.

Abstract: Remote computing resource service providers, including online retailers, provide externally facing computer systems that allow users to interact with the service provider. Furthermore, the service provider may maintain computer systems and services inside an isolated network not exposed to users. Occasionally, service providers may test these externally facing computer systems using one or more external hosts operating on a public network. As a result side effects may occur within the isolated network that is not accessible from the public network. The side effects may be recorded in a queue which may be accessed from inside the isolated network by one or more services. The one or more services may then reverse the side effects based at least in part on information contained in the queue.