Abstract: A method for log-structured merge (LSM) tree compaction, the method includes (i) performing partial compaction processes. Each partial compaction process is associated with a target layer. Different partial compaction processes that are associated with a same target layer are allocated to different non-overlapping key ranges of the target layer. Some of the partial compaction processes are associated with a target layer that is a last layer of the LSM tree.
Abstract: Methods, systems, and media for controlling append-only file rewrites are provided. In accordance with some embodiments, the methods comprising: determining a utilization of a shard of a database; determining whether the utilization exceeds a persistent storage utilization threshold; determining a recovery time to recover the shard from an append-only file; determining whether the recovery time exceeds a recovery time threshold; and when the utilization is determined to exceed the utilization threshold or when the recovery time is determined to exceed the recovery time threshold, causing an append-only-file rewrite to be performed.
Type:
Grant
Filed:
May 9, 2023
Date of Patent:
July 23, 2024
Assignee:
Redis Ltd.
Inventors:
Yiftach Shoolman, Yoav Steinberg, Yossi Gottlieb, Oran Agra
Abstract: Methods, systems, and media for controlling append-only file rewrites are provided. In accordance with some embodiments, the methods comprising: determining a utilization of a shard of a database; determining whether the utilization exceeds a persistent storage utilization threshold; determining a recovery time to recover the shard from an append-only file; determining whether the recovery time exceeds a recovery time threshold; and when the utilization is determined to exceed the utilization threshold or when the recovery time is determined to exceed the recovery time threshold, causing an append-only-file rewrite to be performed.
Type:
Grant
Filed:
October 4, 2021
Date of Patent:
June 27, 2023
Assignee:
Redis Ltd.
Inventors:
Yiftach Shoolman, Yoav Steinberg, Yossi Gottlieb, Oran Agra
Abstract: Methods, systems, and media for controlling append-only file rewrites are provided. In accordance with some embodiments, the methods comprising: determining a utilization of a shard of a database; determining whether the utilization exceeds a persistent storage utilization threshold; determining a recovery time to recover the shard from an append-only file; determining whether the recovery time exceeds a recovery time threshold; and when the utilization is determined to exceed the utilization threshold or when the recovery time is determined to exceed the recovery time threshold, causing an append-only-file rewrite to be performed.
Type:
Grant
Filed:
June 30, 2017
Date of Patent:
October 5, 2021
Assignee:
Redis Ltd.
Inventors:
Yiftach Shoolman, Yoav Steinberg, Yossi Gottlieb, Oran Arga