Abstract: Techniques involve implementing a file system. According to such techniques, a storage system creates a plurality of files in advance, each of which maintains a continuous space to simplify the process of processing read/write requests in the file system. When there is data to be written, an appropriate pre-created file is selected. Further, according to such techniques, a file system address is mapped to a physical address using a memory management unit. In this way, the file system performance is improved greatly.

Abstract: Techniques provide for data deduplication. Such techniques involve: allocating a storage area in a storage device, the storage area including a first storage segment for storing an incompressible data block and a second storage segment for storing a compressed data block, a first size of the first storage segment being greater than a second size of the second storage segment; in response to receiving a write request, determining whether data block to which the write request is related is compressible; in response to determining that the data block is incompressible, adding header information to the data block to generate a first data segment of the first size; and storing the first data segment in the first storage segment through a deduplication operation. Accordingly, such techniques can increase the flexibility and efficiency of data deduplication.

Abstract: A method, computer program product, and computer system for determining, by a computing device, a number of dirty pages capable of being generated per process on a backing device. It may be determined whether the number of dirty pages capable of being generated per process on the backing device exceeds a threshold set point of actual dirty pages currently generated per process on the backing device. A variable amount of time to sleep may be determined. Sleep may be executed for the variable amount of time, wherein generation of additional dirty pages is paused.

Abstract: Embodiments of the present disclosure provide a storage management method and device. The method comprises: obtaining an attribute and access information of a file stored in storage at a first level in a hierarchical storage system, the attribute of the file indicating a size of the file, and the access information indicating an access frequency of the file; determining necessity of migrating the file based on the attribute of the file and the access information; and in response to the necessity exceeding a predetermined threshold, migrating the file to storage at a second level in the hierarchical storage system, the second level being different from the first level. Embodiments of the present disclosure further disclose a corresponding device.

Abstract: Performance in multi-core data storage systems is increased while allowing for portability and fast failover in the event of a failure of a driver stack by a data storage system employing several queues to reduce lock contention. Queueing is performed with two levels of several queues each within a userspace scheduling driver within a userspace container. The userspace scheduling driver may dequeue into a userspace management driver that communicates with a kernel-based hardware driver by way of a kernel helper driver. An apparatus, system, and computer program product for performing a similar method are also provided.

Abstract: A method, computer program product, and computing system for identifying, at the computing device, one or more cache pages in a cache system. One or more cache pages may be refactored into one or more cache units within the one or more cache pages. A plurality of parallel IO requests may be executed on the one or more cache units within the one or more cache pages.

Abstract: Techniques perform operation control in a storage system. The techniques involve obtaining a performance parameter of the storage system. The performance parameter is associated with at least one of access response time and resource utilization of the storage system. The techniques further involve obtaining a target performance parameter. The target performance parameter indicates a desired value of the performance parameter. The techniques further involve: in response to the performance parameter exceeding a first threshold, determining a scheduling parameter based on the performance parameter and the target performance parameter. The scheduling parameter is used to control execution of background operations in the storage system. In accordance with at least some of the techniques, background operations in the storage system can be effectively controlled, so that the resource usage and input/output performance can be improved.

Abstract: A method, computer program product, and computer system for identifying, by a computing device, a plurality of snapshots within a family. It may be determined that multiple snapshots of the plurality of snapshots within the family are marked for deletion. Truncation of the multiple snapshots may be aggregated based upon, at least in part, determining that the multiple snapshots of the plurality of snapshots within the family are marked for deletion.

Abstract: Implementations of the present disclosure relate to a method, system and computer program product for managing a storage system. Specifically, in one implementation of the present disclosure, there is provided a method for managing a storage system. The method comprises: obtaining topological information of a storage device in a first tier and a storage device in a second tier in the storage system; obtaining a storage rule specifying storage of a data object in the storage device in the first tier or the storage device in the second tier; and in response to determining the storage rule conforming to the topological information, managing the data object in the storage system according to the storage rule. In other implementations of the present disclosure, there is provided a corresponding system and computer program product.

Abstract: Techniques involve managing a storage system. A target storage device is selected from multiple storage devices associated with the storage system in response to respective wear degrees of the multiple storage devices being higher than a first predetermined threshold. Regarding multiple extents in the multiple storage devices, respective access loads of the multiple extents are determined. A source extent is selected from multiple extents residing on storage devices other than the target storage device, on the basis of the respective access loads of the multiple extents. Data in the source extent are moved to the target storage device. Various storage devices in a resource pool may be prevented from reaching the end of life at close times, and further data loss may be avoided.

Abstract: Techniques perform cache management. Such techniques involve: obtaining a first cache page of the cache to be flushed, the first cache page being associated with a target storage block in a storage device; determining from the cache a set of target cache pages to be flushed, each of the set of target cache pages being associated with the target storage block; and writing data in the first cache page and data in each of the set of target cache pages into the target storage block simultaneously.

Abstract: A method and device for executing test cases includes obtaining a set of test cases to be executed, and determining a test platform type and a test script associated with each test case in the set of test cases based on a knowledge base. The set of test cases may be divided into a plurality of test subsets or test suites based on the test platform type, and test cases in each test subset executed using the respective test environment and test script. The test suites may be generated automatically based on the knowledge base, and the respective test environment and test script are used for executing each test suite. Automatic generation and execution of the test suites can improve the operation efficiency for test cases.

Abstract: Embodiments of the present disclosure relate to method and device for data read/write. The method comprises: in response to receiving a first read/write request for a first target area, determining whether there is a second read/write request under execution in conflict with the first read/write request, a second target area for the second read/write request at least partially overlapping with the first target area, and at least one of the first read/write request and the second read/write request being a write request; and in response to determining there being the second read/write request in conflict, suspending the first read/write request while maintaining a sub-area of the first target area in an unlocked state, the sub-area not overlapping with the second target area.

Abstract: Embodiments are directed to techniques for allowing a data storage system to be able to flush data to underlying storage when the bandwidth is high without excessively impacting the maximum latency. This may be accomplished by utilizing asynchronous flushing and by throttling incoming writes by preventing too many asynchronous flushes from happening when the amount of available cache space is too small. In addition, an improved system employing Copy on First Write (CoFW) may initiate write throttling only once the amount of available write cache drops below a dynamically-calculated threshold that accounts for an amount of space actually needed to store CoFW buffers. In addition, only a portion of the write caching process is placed under the protection of a mutex or a spinlock, allowing a significant portion of the write caching for any given write operation to be performed without needing the mutex or spinlock, allowing some increased parallelization.

Abstract: A method, computer program product, and computer system for receiving, by a computing device, an I/O request. A bucket for the I/O request may be allocated. An offset and mapping information of the I/O request may be written into a log. The offset and mapping information of the I/O request may be written into a tree structure. Garbage collection for the tree structure may be executed to reuse the bucket.

Abstract: Embodiments of the present disclosure relate to a method and device for executing test cases. The method comprises obtaining a set of test cases to be executed, and determining a test platform type and a test script associated with each test case in the set of test cases based on a knowledge base. The method further comprises dividing the set of test cases into a plurality of test subsets or test suites based on the test platform type, and executing test cases in each test subset using the respective test environment and test script. In embodiments of the present disclosure, the plurality of test suites are generated automatically based on the knowledge base, and the respective test environment and test script are used for executing each test suite. Accordingly, embodiments of the present disclosure can implement automatic generation and execution of the test suites, and can improve the operation efficiency for test cases.

Abstract: In accordance with certain techniques, prefetching operation may be divided into two parts: a trigger part and an execution part, thereby simplifying the prefetching process. Such techniques may further support prefetching of concurrent flows and enhance anti-interference capability. Certain techniques involve receiving a read request for a memory page, and determining whether the read request satisfies a trigger condition of a prefetching operation for the memory page. These certain techniques further involve, in response to the read request satisfying the trigger condition, determining a window size of the prefetching operation based on historical information of historical prefetching operations for the memory page, and triggering, based on the window size, execution of the prefetching operation.

Abstract: Techniques delete snapshot data. In accordance with certain techniques, a first sub-process of a snapshot deletion process on a first data block of the snapshot data is performed with a first thread. The snapshot deletion process includes at least the first sub-process and a second sub-process, the first and second sub-processes being performed sequentially. In response to an end of the first sub-process performed with the first thread, the second sub-process on the first data block is performed with the first thread. In parallel with performing, with the first thread, the second sub-process on the first data block, the first sub-process on a second data block of the snapshot data is performed with a second thread different from the first thread, the second data block being different from the first data block. Such techniques improve IO lock contention, system resource utilization rate and parallelism, response time and system overhead.

Abstract: Embodiments of the present disclosure relate to method and device for data read/write. The method comprises: in response to receiving a first read/write request for a first target area, determining whether there is a second read/write request under execution in conflict with the first read/write request, a second target area for the second read/write request at least partially overlapping with the first target area, and at least one of the first read/write request and the second read/write request being a write request; and in response to determining there being the second read/write request in conflict, suspending the first read/write request while maintaining a sub-area of the first target area in an unlocked state, the sub-area not overlapping with the second target area.

Abstract: Techniques perform operation control in a storage system. The techniques involve obtaining a performance parameter of the storage system. The performance parameter is associated with at least one of access response time and resource utilization of the storage system. The techniques further involve obtaining a target performance parameter. The target performance parameter indicates a desired value of the performance parameter. The techniques further involve: in response to the performance parameter exceeding a first threshold, determining a scheduling parameter based on the performance parameter and the target performance parameter. The scheduling parameter is used to control execution of background operations in the storage system. In accordance with at least some of the techniques, background operations in the storage system can be effectively controlled, so that the resource usage and input/output performance can be improved.