ShanghaiTech University Knowledge Management System
End-to-End Delay Minimization based on Joint Optimization of DNN Partitioning and Resource Allocation for Cooperative Edge Inference | |
2023-10-19 | |
会议录名称 | ARXIV |
ISSN | 1090-3038 |
发表状态 | 已发表 |
DOI | arXiv:2310.12937 |
摘要 | Cooperative inference in Mobile Edge Computing (MEC), achieved by deploying partitioned Deep Neural Network (DNN) models between resource-constrained user equipments (UEs) and edge servers (ESs), has emerged as a promising paradigm. Firstly, we consider scenarios of continuous Artificial Intelligence (AI) task arrivals, like the object detection for video streams, and utilize a serial queuing model for the accurate evaluation of End-to-End (E2E) delay in cooperative edge inference. Secondly, to enhance the long-term performance of inference systems, we formulate a multi-slot stochastic E2E delay optimization problem that jointly considers model partitioning and multi-dimensional resource allocation. Finally, to solve this problem, we introduce a Lyapunov-guided Multi-Dimensional Optimization algorithm (LyMDO) that decouples the original problem into per-slot deterministic problems, where Deep Reinforcement Learning (DRL) and convex optimization are used for joint optimization of partitioning decisions and complementary resource allocation. Simulation results show that our approach effectively improves E2E delay while balancing long-term resource constraints. |
关键词 | mobile edge computing edge intelligence partitioning inference reinforcement learning resource allocation |
会议地点 | Hong Kong, Hong Kong |
会议日期 | 10-13 Oct. 2023 |
URL | 查看原文 |
资助项目 | Innovation Program of Shanghai Municipal Science and Technology Commission[22511100604] |
WOS类目 | Computer Science, Hardware& Architecture |
WOS记录号 | PPRN:85723062 |
来源库 | IEEE |
文献类型 | 会议论文 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/348001 |
专题 | 信息科学与技术学院 信息科学与技术学院_PI研究组_文鼎柱组 |
作者单位 | 1.Shanghai Univ, Key Lab Specialty Fiber Opt, Opt Access Networks, Shanghai 200444, Peoples R China 2.ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 200031, Peoples R China |
推荐引用方式 GB/T 7714 | Ye, Xinrui,Sun, Yanzan,Wen, Dingzhu,et al. End-to-End Delay Minimization based on Joint Optimization of DNN Partitioning and Resource Allocation for Cooperative Edge Inference[C],2023. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。