ShanghaiTech University Knowledge Management System
AisLSM: Revolutionizing the Compaction with Asynchronous I/Os for LSM-tree | |
2023-07-31 | |
状态 | 已发表 |
摘要 | The log-structured merge tree (LSM-tree) is widely employed to build key-value (KV) stores. LSM-tree organizes multiple levels in memory and on disk. The compaction of LSMtree, which is used to redeploy KV pairs between on-disk levels in the form of SST files, severely stalls its foreground service. We overhaul and analyze the procedure of compaction. Writing and persisting files with fsyncs for compacted KV pairs are timeconsuming and, more important, occur synchronously on the critical path of compaction. The user-space compaction thread of LSM-tree stays waiting for completion signals from a kernel space thread that is processing file write and fsync I/Os. We accordingly design a new LSM-tree variant named AisLSM with an asynchronous I/O model. In short, AisLSM conducts asynchronous writes and fsyncs for SST files generated in a compaction and overlaps CPU computations with disk I/Os for consecutive compactions. AisLSM tracks the generation dependency between input and output files for each compaction and utilizes a deferred check-up strategy to ensure the durability of compacted KV pairs. We prototype AisLSM with RocksDB and io uring. Experiments show that AisLSM boosts the performance of RocksDB by up to 2.14×, without losing data accessibility and consistency. It also outperforms state-of-the-art LSM-tree variants with significantly higher throughput and lower tail latency. |
关键词 | LSM-tree Asynchronous I/O Compaction |
DOI | arXiv:2307.16693 |
相关网址 | 查看原文 |
出处 | Arxiv |
WOS记录号 | PPRN:74186996 |
WOS类目 | Computer Science, Information Systems |
文献类型 | 预印本 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/348071 |
专题 | 信息科学与技术学院_博士生 信息科学与技术学院_硕士生 信息科学与技术学院_PI研究组_王春东组 |
作者单位 | ShanghaiTech Univ, Shanghai, Peoples R China |
推荐引用方式 GB/T 7714 | Hu, Yanpeng,Zhu, Li,Jia, Lei,et al. AisLSM: Revolutionizing the Compaction with Asynchronous I/Os for LSM-tree. 2023. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
个性服务 |
查看访问统计 |
谷歌学术 |
谷歌学术中相似的文章 |
[Hu, Yanpeng]的文章 |
[Zhu, Li]的文章 |
[Jia, Lei]的文章 |
百度学术 |
百度学术中相似的文章 |
[Hu, Yanpeng]的文章 |
[Zhu, Li]的文章 |
[Jia, Lei]的文章 |
必应学术 |
必应学术中相似的文章 |
[Hu, Yanpeng]的文章 |
[Zhu, Li]的文章 |
[Jia, Lei]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。