Asynchronous and Adaptive Checkpoint for WAL-Based Data Storage Systems

doi:10.1109/ICPADS60453.2023.00179

	Asynchronous and Adaptive Checkpoint for WAL-Based Data Storage Systems
	Zhu, Li; Hu, Yanpeng; Wang, Chundong
	2024
会议录名称	IEEE
ISSN	2690-5965
页码	1238-1245
发表状态	已发表
DOI	10.1109/ICPADS60453.2023.00179
摘要	Write-ahead logging (WAL) is widely utilized to ensure data's integrity for data storage systems. Modified data is firstly written to a WAL file. Then data is persistently flushed to original home location for in-place update. These two steps are referred to as commit and checkpoint. In this paper, we take SQLite in the WAL mode to study the impact of checkpoint. Once 1,000 pages accumulate in the WAL file, SQLite checkpoints them to the database file with fsync. Such a periodical checkpoint fashion causes substantial spikes to the user-facing latency of inserting or updating data over time. Also, the fixed checkpoint frequency of every 1,000 pages does not consider the runtime write/read access pattern. We propose an algorithm named Walack. Walack conducts fsync asynchronously for each checkpoint. By observing write and read requests, it online adjusts the checkpoint frequency. These two strategies jointly enable Walack to gain both high performance and space efficiency. Experiments show that Walack reduces the user-facing tail latency by up to 92.3% for write requests, with both average write and read performances retained. © 2023 IEEE.
会议举办国	China
会议录编者/会议主办者	IEEE ; IEEE Computer Society Technical Community on Parallel Processing (TCPP) ; IEEE Cyber-Physical-Social Systems (CPSS) ; IEEE Hyper Intelligence Technical Committee (HI-TC) ; IEEE TCSC
关键词	Tail Latency Write-ahead Logging Checkpoint
会议名称	The 29th IEEE International Conference on Parallel and Distributed Systems (ICPADS 2023)
会议地点	Ocean Flower Island, Hainan, China
会议日期	December 17-21, 2023
URL	查看原文
收录类别	EI
语种	英语
出版者	IEEE Press
EI入藏号	20241615923437
原始文献类型	Conference article (CA)
来源库	IEEE
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/352575
专题	信息科学与技术学院_博士生信息科学与技术学院_硕士生信息科学与技术学院_PI研究组_王春东组
通讯作者	Wang, Chundong
作者单位	ShanghaiTech University
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Zhu, Li,Hu, Yanpeng,Wang, Chundong. Asynchronous and Adaptive Checkpoint for WAL-Based Data Storage Systems[C]//IEEE, IEEE Computer Society Technical Community on Parallel Processing (TCPP), IEEE Cyber-Physical-Social Systems (CPSS), IEEE Hyper Intelligence Technical Committee (HI-TC), IEEE TCSC:IEEE Press,2024:1238-1245.