AisLSM: Revolutionizing the Compaction with Asynchronous I/Os for LSM-tree
2023-07-31
状态已发表
摘要

The log-structured merge tree (LSM-tree) is widely employed to build key-value (KV) stores. LSM-tree organizes multiple levels in memory and on disk. The compaction of LSMtree, which is used to redeploy KV pairs between on-disk levels in the form of SST files, severely stalls its foreground service. We overhaul and analyze the procedure of compaction. Writing and persisting files with fsyncs for compacted KV pairs are timeconsuming and, more important, occur synchronously on the critical path of compaction. The user-space compaction thread of LSM-tree stays waiting for completion signals from a kernel space thread that is processing file write and fsync I/Os. We accordingly design a new LSM-tree variant named AisLSM with an asynchronous I/O model. In short, AisLSM conducts asynchronous writes and fsyncs for SST files generated in a compaction and overlaps CPU computations with disk I/Os for consecutive compactions. AisLSM tracks the generation dependency between input and output files for each compaction and utilizes a deferred check-up strategy to ensure the durability of compacted KV pairs. We prototype AisLSM with RocksDB and io uring. Experiments show that AisLSM boosts the performance of RocksDB by up to 2.14×, without losing data accessibility and consistency. It also outperforms state-of-the-art LSM-tree variants with significantly higher throughput and lower tail latency.

关键词LSM-tree Asynchronous I/O Compaction
DOIarXiv:2307.16693
相关网址查看原文
出处Arxiv
WOS记录号PPRN:74186996
WOS类目Computer Science, Information Systems
文献类型预印本
条目标识符https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/348071
专题信息科学与技术学院_博士生
信息科学与技术学院_硕士生
信息科学与技术学院_PI研究组_王春东组
作者单位
ShanghaiTech Univ, Shanghai, Peoples R China
推荐引用方式
GB/T 7714
Hu, Yanpeng,Zhu, Li,Jia, Lei,et al. AisLSM: Revolutionizing the Compaction with Asynchronous I/Os for LSM-tree. 2023.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
个性服务
查看访问统计
谷歌学术
谷歌学术中相似的文章
[Hu, Yanpeng]的文章
[Zhu, Li]的文章
[Jia, Lei]的文章
百度学术
百度学术中相似的文章
[Hu, Yanpeng]的文章
[Zhu, Li]的文章
[Jia, Lei]的文章
必应学术
必应学术中相似的文章
[Hu, Yanpeng]的文章
[Zhu, Li]的文章
[Jia, Lei]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。