A Neural Rendering Framework for Free-Viewpoint Relighting

doi:10.1109/CVPR42600.2020.00564

	A Neural Rendering Framework for Free-Viewpoint Relighting
	Zhang Chen1 ; Anpei Chen2 ; Guli Zhang2 ; Chengyuan Wang 3; Yu Ji 4; Kiriakos N. Kutulakos 5; Jingyi Yu2
	2020-06
会议录名称	2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)
ISSN	1063-6919
页码	5598-5609
发表状态	已发表
DOI	10.1109/CVPR42600.2020.00564
摘要	We present a novel Relightable Neural Renderer (RNR) for simultaneous view synthesis and relighting using multi-view image inputs. Existing neural rendering (NR) does not explicitly model the physical rendering process and hence has limited capabilities on relighting. RNR instead models image formation in terms of environment lighting, object intrinsic attributes, and light transport function (LTF), each corresponding to a learnable component. In particular, the incorporation of a physically based rendering process not only enables relighting but also improves the quality of view synthesis. Comprehensive experiments on synthetic and real data show that RNR provides a practical and effective solution for conducting free-viewpoint relighting.
会议录编者/会议主办者	IEEE
关键词	Rendering (computer graphics) Lighting Three-dimensional displays Geometry Spatial resolution Pipelines Feature extraction
会议名称	IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
出版地	345 E 47TH ST, NEW YORK, NY 10017 USA
会议地点	Seattle, WA, USA
会议日期	13-19 June 2020
URL	查看原文
收录类别	CPCI ; CPCI-S ; EI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000620679505086
WOS关键词	REPRESENTATION
原始文献类型	Conferences
引用统计
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/122916
专题	物质科学与技术学院_PI研究组_钟超组信息科学与技术学院_PI研究组_虞晶怡组信息科学与技术学院_硕士生信息科学与技术学院_博士生
作者单位	1.ShanghaiTech University; Shanghai Institute of Microsystem and Information Technology; University of Chinese Academy of Sciences 2.ShanghaiTech University 3.Shanghai University 4.DGene, Inc. 5.University of Toronto
第一作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Zhang Chen,Anpei Chen,Guli Zhang,et al. A Neural Rendering Framework for Free-Viewpoint Relighting[C]//IEEE. 345 E 47TH ST, NEW YORK, NY 10017 USA,2020:5598-5609.