ShanghaiTech University Knowledge Management System
SHC: A method for stackable parallel file systems in userspace | |
2019 | |
会议录名称 | 21ST IEEE INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 17TH IEEE INTERNATIONAL CONFERENCE ON SMART CITY AND 5TH IEEE INTERNATIONAL CONFERENCE ON DATA SCIENCE AND SYSTEMS, HPCC/SMARTCITY/DSS 2019 |
页码 | 1374-1381 |
发表状态 | 已发表 |
DOI | 10.1109/HPCC/SmartCity/DSS.2019.00191 |
摘要 | We present SHC, a stackable layer that leverages the power and flexibility of middlewares to handle kernel crossings of parallel file systems in userspace. The core of SHC is a dynamic library interception mechanism that improves I/O performance and guarantees consistency. Additionally, our solution uses a server process to handle write synchronizations so as to maintain the data correctness and the data consistency with minimal overheads. We implement an SHC prototype with PLFS on a Lustre system and demonstrate that SHC maintains most interactions between applications and PLFS in userspace while requiring fewer kernel calls. We show that SHC improves write bandwidth up to 30x higher than FUSE, and reduces the latency of up to 90% for high-performance I/O systems. |
会议地点 | Zhangjiajie, China |
会议日期 | 10-12 Aug. 2019 |
URL | 查看原文 |
收录类别 | EI |
资助项目 | China Postdoctoral Science Foundation[2015M572708] ; ShanghaiTech University[61572511] ; National University of Defense Technology[ZL16-03-09] ; National Natural Science Foundation of China[61402158] |
出版者 | Institute of Electrical and Electronics Engineers Inc. |
EI入藏号 | 20194307563712 |
EI主题词 | Electric fuses ; File organization ; Smart city |
EI分类号 | Electric Components:704.1 ; Information Retrieval and Use:903.3 |
原始文献类型 | Conference article (CA) |
来源库 | IEEE |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/49934 |
专题 | 信息科学与技术学院_硕士生 物质科学与技术学院_特聘教授组_张健组 信息科学与技术学院_PI研究组_殷树组 信息科学与技术学院_博士生 |
通讯作者 | Yin, Shu |
作者单位 | 1.School of Information Science and Technology, ShanghaiTech University, China 2.West Chester University, PA, United States 3.National University of Defense Technology, China |
第一作者单位 | 信息科学与技术学院 |
第一作者的第一单位 | 信息科学与技术学院 |
推荐引用方式 GB/T 7714 | Zou, Yanliang,Chen, Chen,Deng, Tongliang,et al. SHC: A method for stackable parallel file systems in userspace[C]:Institute of Electrical and Electronics Engineers Inc.,2019:1374-1381. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。