Abstract: The present disclosure relates to de-duplication. An example method includes acquiring mirror files, wherein each mirror file in the mirror files includes at least one layer. The method further includes generating a directory by de-duplicating layers of the mirror files. The method further includes redirecting the de-duplicated mirror files to the directory by using hard links. The method further includes packaging the redirected mirror files and the directory into a target package. Beneficially, the mirror files can be de-duplicated in a unit of layer, and the flexibility in downloading a part of the mirror files can further be ensured.

Abstract: The present disclosure relates to de-duplication. An example method includes acquiring mirror files, wherein each mirror file in the mirror files includes at least one layer. The method further includes generating a directory by de-duplicating layers of the mirror files. The method further includes redirecting the de-duplicated mirror files to the directory by using hard links. The method further includes packaging the redirected mirror files and the directory into a target package. Beneficially, the mirror files can be de-duplicated in a unit of layer, and the flexibility in downloading a part of the mirror files can further be ensured.

Abstract: The technologies described herein are generally directed toward writing multiple data objects to object storage. An example method can include receiving an aggregated data object comprising a set of data objects and metadata corresponding to respective data objects of the set of data objects. The method can further include updating the metadata to comprise the respective storage locations. Further, the method can include updating the metadata to include the respective storage locations. The method can further include allocating the metadata to be stored by metadata processing equipment, resulting in the metadata being stored in metadata storage equipment.

Abstract: The technologies described herein are generally directed toward writing multiple data objects to object storage. An example method can include receiving an aggregated data object comprising a set of data objects and metadata corresponding to respective data objects of the set of data objects. The method can further include updating the metadata to comprise the respective storage locations. Further, the method can include updating the metadata to include the respective storage locations. The method can further include allocating the metadata to be stored by metadata processing equipment, resulting in the metadata being stored in metadata storage equipment.

Abstract: Storage processes are described. For instance, dumping of cache data in a memory table at a source directory table partition in a source container group is stopped in response to receiving a close signal. A notification for creating a target directory table partition is sent to a target container group, the notification including a checkpoint at the source directory table partition. The cache data in the memory table is sent to the target container group, and the source container group is closed in response to a determination that an ownership of the target directory table partition is updated to the target container group. A rescheduling and/or upgrading solution is thus proposed for a source container group, so that the source container group is still in a service state during the rescheduling and/or upgrading solution, which improves the performance of storage services and reduces the data unavailable time.

Abstract: Storage processes are described. For instance, dumping of cache data in a memory table at a source directory table partition in a source container group is stopped in response to receiving a close signal. A notification for creating a target directory table partition is sent to a target container group, the notification including a checkpoint at the source directory table partition. The cache data in the memory table is sent to the target container group, and the source container group is closed in response to a determination that an ownership of the target directory table partition is updated to the target container group. A rescheduling and/or upgrading solution is thus proposed for a source container group, so that the source container group is still in a service state during the rescheduling and/or upgrading solution, which improves the performance of storage services and reduces the data unavailable time.

Abstract: Storage processes are described. For instance, dumping of cache data in a memory table at a source directory table partition in a source container group is stopped in response to receiving a close signal. A notification for creating a target directory table partition is sent to a target container group, the notification including a checkpoint at the source directory table partition. The cache data in the memory table is sent to the target container group, and the source container group is closed in response to a determination that an ownership of the target directory table partition is updated to the target container group. A rescheduling and/or upgrading solution is thus proposed for a source container group, so that the source container group is still in a service state during the rescheduling and/or upgrading solution, which improves the performance of storage services and reduces the data unavailable time.