ShanghaiTech University Knowledge Management System
SME: A Systolic Multiply-accumulate Engine for MLP-based Neural Network | |
2022 | |
会议录名称 | APCCAS 2022 - 2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS |
页码 | 270-274 |
发表状态 | 已发表 |
DOI | 10.1109/APCCAS55924.2022.10090307 |
摘要 | In this paper, we propose an output stationary systolic multiply-accumulate engine (SME) with an optimized dataflow for multilayer perceptron (MLP) computation in the state-of-the-art Neural Radiance Field (NeRF) algorithms. We also analyze activation patterns of the NeRF algorithm which uses ReLU as the activation function, and find that the activation can be sparse, especially in the last several layers. We therefore further take advantage of activation sparsity by gating corresponding multiplications in the SME for power saving. The proposed SME is implemented using SpinalHDL, which is translated to VerilogHDL for VLSI implementation based on 40nm CMOS technology. Evaluation results show that, working at 400MHz, the proposed SME occupies 31.371mm2 circuit area, and consumes 873.7mW power, translating 12,708.10 ksamples/J and 360.06 ksamples/s/mm2. © 2022 IEEE. |
会议录编者/会议主办者 | IEEE ; IEEE Circuits and Systems Society (CAS) ; IEEE Circuits and Systems Society (CAS) Shenzhen Chapter ; Peking University Shenzhen Graduate School ; Shenzhen University ; Tsinghua Shenzhen International Graduate School |
关键词 | Chemical activation Engines Multilayer neural networks Activation functions Activation patterns Dataflow Hardware acceleration Multi-layer perceptron Multilayers perceptrons Multiplyaccumulate (MAC) Neural radiance field Neural-networks State of the art |
会议名称 | 2022 IEEE Asia Pacific Conference on Circuits and Systems, APCCAS 2022 |
会议地点 | Virtual, Online, China |
会议日期 | November 11, 2022 - November 13, 2022 |
URL | 查看原文 |
收录类别 | EI |
语种 | 英语 |
出版者 | Institute of Electrical and Electronics Engineers Inc. |
EI入藏号 | 20231814047013 |
EI主题词 | Systolic arrays |
EI分类号 | 802.2 Chemical Reactions ; 804 Chemical Products Generally |
原始文献类型 | Conference article (CA) |
来源库 | IEEE |
文献类型 | 会议论文 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/299892 |
专题 | 信息科学与技术学院 信息科学与技术学院_PI研究组_娄鑫组 信息科学与技术学院_PI研究组_周平强组 信息科学与技术学院_硕士生 信息科学与技术学院_博士生 |
作者单位 | School of Information Science and Technology, ShanghaiTech University, Shanghai, China |
第一作者单位 | 信息科学与技术学院 |
第一作者的第一单位 | 信息科学与技术学院 |
推荐引用方式 GB/T 7714 | Haochuan Wan,Chaolin Rao,Yueyang Zheng,et al. SME: A Systolic Multiply-accumulate Engine for MLP-based Neural Network[C]//IEEE, IEEE Circuits and Systems Society (CAS), IEEE Circuits and Systems Society (CAS) Shenzhen Chapter, Peking University Shenzhen Graduate School, Shenzhen University, Tsinghua Shenzhen International Graduate School:Institute of Electrical and Electronics Engineers Inc.,2022:270-274. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。