SME: A Systolic Multiply-accumulate Engine for MLP-based Neural Network
2022
会议录名称APCCAS 2022 - 2022 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS
页码270-274
发表状态已发表
DOI10.1109/APCCAS55924.2022.10090307
摘要

In this paper, we propose an output stationary systolic multiply-accumulate engine (SME) with an optimized dataflow for multilayer perceptron (MLP) computation in the state-of-the-art Neural Radiance Field (NeRF) algorithms. We also analyze activation patterns of the NeRF algorithm which uses ReLU as the activation function, and find that the activation can be sparse, especially in the last several layers. We therefore further take advantage of activation sparsity by gating corresponding multiplications in the SME for power saving. The proposed SME is implemented using SpinalHDL, which is translated to VerilogHDL for VLSI implementation based on 40nm CMOS technology. Evaluation results show that, working at 400MHz, the proposed SME occupies 31.371mm2 circuit area, and consumes 873.7mW power, translating 12,708.10 ksamples/J and 360.06 ksamples/s/mm2. © 2022 IEEE.

会议录编者/会议主办者IEEE ; IEEE Circuits and Systems Society (CAS) ; IEEE Circuits and Systems Society (CAS) Shenzhen Chapter ; Peking University Shenzhen Graduate School ; Shenzhen University ; Tsinghua Shenzhen International Graduate School
关键词Chemical activation Engines Multilayer neural networks Activation functions Activation patterns Dataflow Hardware acceleration Multi-layer perceptron Multilayers perceptrons Multiplyaccumulate (MAC) Neural radiance field Neural-networks State of the art
会议名称2022 IEEE Asia Pacific Conference on Circuits and Systems, APCCAS 2022
会议地点Virtual, Online, China
会议日期November 11, 2022 - November 13, 2022
URL查看原文
收录类别EI
语种英语
出版者Institute of Electrical and Electronics Engineers Inc.
EI入藏号20231814047013
EI主题词Systolic arrays
EI分类号802.2 Chemical Reactions ; 804 Chemical Products Generally
原始文献类型Conference article (CA)
来源库IEEE
文献类型会议论文
条目标识符https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/299892
专题信息科学与技术学院
信息科学与技术学院_PI研究组_娄鑫组
信息科学与技术学院_PI研究组_周平强组
信息科学与技术学院_硕士生
信息科学与技术学院_博士生
作者单位
School of Information Science and Technology, ShanghaiTech University, Shanghai, China
第一作者单位信息科学与技术学院
第一作者的第一单位信息科学与技术学院
推荐引用方式
GB/T 7714
Haochuan Wan,Chaolin Rao,Yueyang Zheng,et al. SME: A Systolic Multiply-accumulate Engine for MLP-based Neural Network[C]//IEEE, IEEE Circuits and Systems Society (CAS), IEEE Circuits and Systems Society (CAS) Shenzhen Chapter, Peking University Shenzhen Graduate School, Shenzhen University, Tsinghua Shenzhen International Graduate School:Institute of Electrical and Electronics Engineers Inc.,2022:270-274.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
个性服务
查看访问统计
谷歌学术
谷歌学术中相似的文章
[Haochuan Wan]的文章
[Chaolin Rao]的文章
[Yueyang Zheng]的文章
百度学术
百度学术中相似的文章
[Haochuan Wan]的文章
[Chaolin Rao]的文章
[Yueyang Zheng]的文章
必应学术
必应学术中相似的文章
[Haochuan Wan]的文章
[Chaolin Rao]的文章
[Yueyang Zheng]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。