Abstract: Data is obtained from a data stream managed by a data stream service prior to expiration of a data retention time. The data is archived to a data store distinct from the data stream service (e.g., in a full or compacted mode). Access to the archived data is provided via a proxy that intercepts requests directed to the streaming service. For example, the proxy or a redirect utility for the proxy may intercept a query, and for data specified in the query that is past the retention expiration time, the data is retrieved from the data store. For data specified in the query that has not yet expired, the data is retrieved from the data stream service. In either case, the system responds to the query with the retrieved data according to the access interface of the data stream service (e.g., injecting the retrieved data into a data stream).

Abstract: A distributed system hosts a plurality of programming interfaces managed according to a hierarchy of security policies. In response to receiving a request from a client to invoke one of the programming interfaces, the system determines whether the client is authorized to call the programming interface by mapping from an attribute of the client to a location in the hierarchy. The system calls the interface in response to determining that the client is authorized to call programming interfaces associated with the location. The programming interface implements the security policy that corresponds to the location.

Abstract: An automated repartitioning agent (ARA) of a storage service determines a repartitioning plan for a storage object. The plan identifies a source set of partitions whose keys are to be distributed among a target number of partitions. The ARA generates a data structure representing the source set, with entries indicating the key sets of corresponding partitions. The ARA implements repartitioning iterations until the keys of the source set have been redistributed. In each iteration, the ARA compares the key set of a selected entry of the data structure with a target key set and performs repartitioning actions based on the result. The repartitioning action may include splitting the selected entry's partition, merging the selected entry's partition with another partition, or designating the selected entry's partition as acceptable.