Abstract: Time-based partitioning of a data set is applied to capture updates to the data set in a copy of the data set. Items that have been updated in a data set with in a time period are identified. Partitions of the data set that include the updated items are created according to a partitioning scheme. The created partitions are grouped in a storage location for the time period in a file structure that stores a copy of the database. A latest version of the copy of the data set may be accessed according to latest partitions of the data set stored in the different locations of the file structure.

Abstract: Techniques are described for migrating data from source storage to destination storage using a chunking technique. The data to be migrated may be divided into a number of chunks according to a factor that is the number of migration modules to be employed in migrating the data. The chunks may be stored on intermediate storage and migrated from the intermediate storage to the destination storage by the migration modules executing in parallel. Because the number of chunks is based on a factor that is the number of migration modules, the utilization of the migration modules may be substantially equivalent during the migration process. The chunks are generated with a size to optimize input/output operations and prevent timeouts during read operations.