FPGA-based compaction engine for accelerating LSM-tree key-value stores

X Sun, J Yu, Z Zhou, CJ Xue - 2020 IEEE 36th International …, 2020 - ieeexplore.ieee.org
… In this section, we first introduce the basic pipeline design of the proposed compaction
engine. Then we present several important optimization modules to improve the …

Adaptive lower-level driven compaction to optimize LSM-tree key-value stores

Y Chai, Y Chai, X Wang, H Wei… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
compaction) in LSM-tree key-value stores improves the write efficiency, and some lazy
compaction … we propose a novel Lower-level Driven Compaction (LDC) method which breaks the …

DComp: Efficient Offload of LSM-tree Compaction with Data Processing Units

C Ding, J Zhou, J Wan, Y Xiong, S Li, S Chen… - Proceedings of the …, 2023 - dl.acm.org
… In this paper, we argue that LSM-tree compaction has serious CPU overhead on fast …
compaction can be bounded by the data-intensive compression, and multi-threaded compaction

An Asynchronous Compaction Acceleration Scheme for Near-Data Processing-enabled LSM-Tree-based KV Stores

H Sun, B Lou, C Zhao, D Kong, C Zhang… - ACM Transactions on …, 2023 - dl.acm.org
… The write ampliication can be improved when we apply the cross-leveled compaction but
the pipelined compaction in PStore. We design experiments to explore this phenomenon. We …

[PDF][PDF] A GPU-accelerated Compaction Strategy for LSM-based Key-Value Store System

H Zhou, Y Chen, L Cui, G Wang, X Liu - msstconference.org
… Additionally, We design two SSDGPU data transfer mechanisms, the Pipeline mechanism, …
any LSM-Tree storage system. Compared to CPUbased method and LUDA, our compaction

gLSM: Using GPGPU to Accelerate Compactions in LSM-tree-based Key-value Stores

H Sun, J Xu, X Jiang, G Chen, Y Yue… - ACM Transactions on …, 2024 - dl.acm.org
… [26], but this scheme increases the number of tasks when compaction is kicked in, leading
to a high resource cost. The pipelined compaction [45] is a pipelined merge mechanism, …

Leaper: A learned prefetcher for cache invalidation in LSM-tree based storage engines

L Yang, H Wu, T Zhang, X Cheng, F Li, L Zou… - Proceedings of the …, 2020 - dl.acm.org
… the flush and compaction operations in the LSM-tree. Because … when a flush or compaction
is executed in the LSM-tree, record … learning pipeline coupled with DBMS in our future work. …

D2Comp: Efficient Offload of LSM-tree Compaction with Data Processing Units on Disaggregated Storage

C Ding, J Zhou, K Lu, S Li, Y Xiong, J Wan… - ACM Transactions on …, 2024 - dl.acm.org
… 7 CONCLUSION In this paper, we argue that LSM-tree compaction has serious CPU and
network overhead on high-speed disaggregated storage. With ine-grained breakdown, we ind …

{FPGA-Accelerated} Compactions for {LSM-based}{Key-Value} Store

T Zhang, J Wang, X Cheng, H Xu, N Yu… - … USENIX Conference on …, 2020 - usenix.org
… KV stores built atop the LSM-tree usually exploit other … that the performance of LSM-tree KV
stores often fatigues after … On the FPGA, we design and implement compaction as a pipeline

Dissecting, designing, and optimizing LSM-based data stores

S Sarkar, M Athanassoulis - … of the 2022 International Conference on …, 2022 - dl.acm.org
Compaction. Every time a level has an incoming immutable file (note that flushing creates
incoming immutable files for Level 1) the LSM-tree … in data management pipelines. Before …