End-to-End Delay Minimization based on Joint Optimization of DNN Partitioning and Resource Allocation for Cooperative Edge Inference
2023-10-19
会议录名称ARXIV
ISSN1090-3038
发表状态已发表
DOIarXiv:2310.12937
摘要

Cooperative inference in Mobile Edge Computing (MEC), achieved by deploying partitioned Deep Neural Network (DNN) models between resource-constrained user equipments (UEs) and edge servers (ESs), has emerged as a promising paradigm. Firstly, we consider scenarios of continuous Artificial Intelligence (AI) task arrivals, like the object detection for video streams, and utilize a serial queuing model for the accurate evaluation of End-to-End (E2E) delay in cooperative edge inference. Secondly, to enhance the long-term performance of inference systems, we formulate a multi-slot stochastic E2E delay optimization problem that jointly considers model partitioning and multi-dimensional resource allocation. Finally, to solve this problem, we introduce a Lyapunov-guided Multi-Dimensional Optimization algorithm (LyMDO) that decouples the original problem into per-slot deterministic problems, where Deep Reinforcement Learning (DRL) and convex optimization are used for joint optimization of partitioning decisions and complementary resource allocation. Simulation results show that our approach effectively improves E2E delay while balancing long-term resource constraints.

关键词mobile edge computing edge intelligence partitioning inference reinforcement learning resource allocation
会议地点Hong Kong, Hong Kong
会议日期10-13 Oct. 2023
URL查看原文
资助项目Innovation Program of Shanghai Municipal Science and Technology Commission[22511100604]
WOS类目Computer Science, Hardware& Architecture
WOS记录号PPRN:85723062
来源库IEEE
文献类型会议论文
条目标识符https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/348001
专题信息科学与技术学院
信息科学与技术学院_PI研究组_文鼎柱组
作者单位
1.Shanghai Univ, Key Lab Specialty Fiber Opt, Opt Access Networks, Shanghai 200444, Peoples R China
2.ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 200031, Peoples R China
推荐引用方式
GB/T 7714
Ye, Xinrui,Sun, Yanzan,Wen, Dingzhu,et al. End-to-End Delay Minimization based on Joint Optimization of DNN Partitioning and Resource Allocation for Cooperative Edge Inference[C],2023.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
个性服务
查看访问统计
谷歌学术
谷歌学术中相似的文章
[Ye, Xinrui]的文章
[Sun, Yanzan]的文章
[Wen, Dingzhu]的文章
百度学术
百度学术中相似的文章
[Ye, Xinrui]的文章
[Sun, Yanzan]的文章
[Wen, Dingzhu]的文章
必应学术
必应学术中相似的文章
[Ye, Xinrui]的文章
[Sun, Yanzan]的文章
[Wen, Dingzhu]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。