Federated Learning via Over-the-Air Computation

doi:10.1109/TWC.2019.2961673

	Federated Learning via Over-the-Air Computation
	Kai Yang1,2,3 ; Tao Jiang1 ; Yuanming Shi1 ; Zhi Ding 4
	2020-03-01
发表期刊	IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS (IF:8.9[JCR-2023],8.6[5-Year])
ISSN	1558-2248
卷号	19 期号:3
发表状态	已发表
DOI	10.1109/TWC.2019.2961673
摘要	The stringent requirements for low-latency and privacy of the emerging high-stake applications with intelligent devices such as drones and smart vehicles make the cloud computing inapplicable in these scenarios. Instead, edge machine learning becomes increasingly attractive for performing training and inference directly at network edges without sending data to a centralized data center. This stimulates a nascent field termed as federated learning for training a machine learning model on computation, storage, energy and bandwidth limited mobile devices in a distributed manner. To preserve data privacy and address the issues of unbalanced and non-IID data points across different devices, the federated averaging algorithm has been proposed for global model aggregation by computing the weighted average of locally updated model at each selected device. However, the limited communication bandwidth becomes the main bottleneck for aggregating the locally computed updates. We thus propose a novel over-the-air computation based approach for fast global model aggregation via exploring the superposition property of a wireless multiple-access channel. This is achieved by joint device selection and beamforming design, which is modeled as a sparse and low-rank optimization problem to support efficient algorithms design. To achieve this goal, we provide a difference-of-convex-functions (DC) representation for the sparse and low-rank function to enhance sparsity and accurately detect the fixed-rank constraint in the procedure of device selection. A DC algorithm is further developed to solve the resulting DC program with global convergence guarantees. The algorithmic advantages and admirable performance of the proposed methodologies are demonstrated through extensive numerical results.
URL	查看原文
收录类别	SCI ; SCIE ; EI
来源库	IEEE
引用统计	正在获取...
文献类型	期刊论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/49989
专题	信息科学与技术学院_博士生信息科学与技术学院_PI研究组_石远明组信息科学与技术学院_硕士生
作者单位	1.School of Information Science and Technology, ShanghaiTech University, Shanghai, China 2.Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai, China 3.University of Chinese Academy of Sciences, Beijing, China 4.Department of Electrical and Computer Engineering, University of California at Davis, Davis, USA
第一作者单位	信息科学与技术学院
第一作者的第一单位	信息科学与技术学院
推荐引用方式 GB/T 7714	Kai Yang,Tao Jiang,Yuanming Shi,et al. Federated Learning via Over-the-Air Computation[J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,2020,19(3).
APA	Kai Yang,Tao Jiang,Yuanming Shi,&Zhi Ding.(2020).Federated Learning via Over-the-Air Computation.IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS,19(3).
MLA	Kai Yang,et al."Federated Learning via Over-the-Air Computation".IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS 19.3(2020).