Graph Attention-Based MADRL for Access Control and Resource Allocation in Wireless Networked Control Systems

doi:10.1109/TWC.2024.3436906

	Graph Attention-Based MADRL for Access Control and Resource Allocation in Wireless Networked Control Systems
	Wang, Zixin1 ; Bennis, Mehdi 2; Zhou, Yong1
	2024-11-01
发表期刊	IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (IF:8.9[JCR-2023],8.6[5-Year])
ISSN	1536-1276
EISSN	1558-2248
卷号	23 期号:11 页码:1-1
发表状态	已发表
DOI	10.1109/TWC.2024.3436906
摘要	Wireless networked control systems (WNCS) offer great potential for revolutionizing the industrial automation by enabling wireless coordination between sensors, decision centers, and actuators. However, inefficient access control and resource allocation in WNCS are two critical factors that limit closed-loop performance and control stability, especially when the spectral and energy resources are limited. In this paper, we first analyze the optimal scheduling condition for maintaining control stability of a WNCS and then formulate a long-term optimization problem that jointly optimizes the access policy of edge devices, and grant policy and resource allocation at the edge server. We employ Lyapunov optimization to decompose the long-term optimization problem into a sequence of independent sub-problems, and propose a heterogeneous attention graph based multi-agent deep reinforcement learning algorithm that jointly optimizes the access and resource allocation policy. By leveraging the attention mechanism to project the graph representations from heterogeneous agents into a unified space, our proposed algorithm facilitates coordination among heterogeneous agents, thereby enhancing the overall system performance. Simulation results demonstrate that our proposed framework outperforms several benchmarks, validating its effectiveness.
关键词	Servers Resource management Optimization Job shop scheduling Stability criteria Access control Wireless sensor networks power control bandwidth allocation wireless networked control system
URL	查看原文
收录类别	EI ; SCI
语种	英语
资助项目	National Natural Science Foundation of China[U20A20159] ; Natural Science Foundation of Shanghai[23ZR1442800]
WOS研究方向	Engineering ; Telecommunications
WOS类目	Engineering, Electrical & Electronic ; Telecommunications
WOS记录号	WOS:001355813300006
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
来源库	IEEE
文献类型	期刊论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/411242
专题	信息科学与技术学院信息科学与技术学院_PI研究组_周勇组信息科学与技术学院_博士生
通讯作者	Zhou, Yong
作者单位	1.School of Information Science and Technology, ShanghaiTech University, Shanghai, China 2.Centre for Wireless Communication, University of Oulu, Finland
第一作者单位	信息科学与技术学院
通讯作者单位	信息科学与技术学院
第一作者的第一单位	信息科学与技术学院
推荐引用方式 GB/T 7714	Wang, Zixin,Bennis, Mehdi,Zhou, Yong. Graph Attention-Based MADRL for Access Control and Resource Allocation in Wireless Networked Control Systems[J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,2024,23(11):1-1.
APA	Wang, Zixin,Bennis, Mehdi,&Zhou, Yong.(2024).Graph Attention-Based MADRL for Access Control and Resource Allocation in Wireless Networked Control Systems.IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,23(11),1-1.
MLA	Wang, Zixin,et al."Graph Attention-Based MADRL for Access Control and Resource Allocation in Wireless Networked Control Systems".IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS 23.11(2024):1-1.