Abstract: A system of managing data, comprising a streaming data storage system operating on a processor that causes the processor to receive streaming data and to process the streaming data in response to an append command, a long-term storage system operating on a processor that causes the processor to receive the processed streaming data from the streaming data storage system and to generate a chunk of data, an object storage system operating on a processor that causes the processor to receive the processed streaming data from the streaming data storage system and to generate an object of data and a tables system operating on a processor that causes the processor to receive the processed streaming data from the streaming data storage system and to generate a table of data.

Abstract: In an example, a method comprises determining, based on a set of metadata items to be stored, a first sequence and a second sequence, wherein the first sequence and the second sequence each include a plurality of key-value pairs, each key-value pair including a metadata item from the set of metadata items and a keyword corresponding to the metadata item in the set. The method also comprises causing a first co-routine to utilize available computing resources to process the first sequence. The method further comprises in response to an amount of computing resources available for the first co-routine to process the first sequence being below a first threshold, causing a second co-routine to process the second sequence, wherein the second co-routine is different from the first co-routine. This method can increase the utilization rate of the processor and more rapidly stores the metadata into the external storage device.

Abstract: Embodiments of the present disclosure provide a method, a device and a computer program product of storage management. According to example implementations of the present disclosure, in response to data to be replicated from a first storage zone to a second storage zone, a utilization rate of resources associated with the replication is determined; the utilization rate of the resources is compared with a predetermined threshold utilization rate; and in response to the utilization rate of the resources being less than the threshold utilization rate, the replication of the data is initiated from the first storage zone to the second storage zone. Therefore, the present disclosure can automatically adjust replication behaviors for various scenarios, thereby realizing a more flexible data replication policy, and enabling more efficient use of various resources.

Abstract: Embodiments of the present disclosure provide a method, a device and a computer program product for storing metadata. The method comprises determining, based on a set of metadata items to be stored, a first sequence and a second sequence, wherein the first sequence and the second sequence each include a plurality of key-value pairs, each key-value pair including a metadata item from the set of metadata items and a keyword corresponding to the metadata item in the set. The method also comprises causing a first co-routine to utilize available computing resources to process the first sequence. The method further comprises in response to an amount of computing resources available for the first co-routine to process the first sequence being below a first threshold, causing a second co-routine to process the second sequence, wherein the second co-routine is different from the first co-routine.

Abstract: Embodiments of the present disclosure provide a method, a device and a computer program product of storage management. According to example implementations of the present disclosure, in response to data to be replicated from a first storage zone to a second storage zone, a utilization rate of resources associated with the replication is determined; the utilization rate of the resources is compared with a predetermined threshold utilization rate; and in response to the utilization rate of the resources being less than the threshold utilization rate, the replication of the data is initiated from the first storage zone to the second storage zone. Therefore, the present disclosure can automatically adjust replication behaviors for various scenarios, thereby realizing a more flexible data replication policy, and enabling more efficient use of various resources.