NeMF: Inverse Volume Rendering with Neural Microflake Field

doi:10.1109/ICCV51070.2023.02095

	NeMF: Inverse Volume Rendering with Neural Microflake Field
	Zhang, Youjia 1; Xu, Teng 1; Yu, Junqing 1; Ye, Yuteng 1; Jing, Yanqing 2; Wang, Junle 2; Yu, Jingyi3 ; Yang, Wei 1
	2023
会议录名称	PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION
ISSN	1550-5499
页码	22862-22872
发表状态	已发表
DOI	10.1109/ICCV51070.2023.02095
摘要	Recovering the physical attributes of an object's appearance from its images captured under an unknown illumination is challenging yet essential for photo-realistic rendering. Recent approaches adopt the emerging implicit scene representations and have shown impressive results. However, they unanimously adopt a surface-based representation, and hence can not well handle scenes with very complex geometry, translucent object and etc. In this paper, we propose to conduct inverse volume rendering, in contrast to surface-based, by representing a scene using microflake volume, which assumes the space is filled with infinite small flakes and light reflects or scatters at each spatial location according to microflake distributions. We further adopt the coordinate networks to implicitly encode the microflake volume, and develop a differentiable microflake volume renderer to train the network in an end-to-end way in principle. Our NeMF enables effective recovery of appearance attributes for highly complex geometry and scattering object, enables high-quality relighting, material editing, and especially simulates volume rendering effects, such as scattering, which is infeasible for surface-based approaches. Our data and code are available at: https://github.com/YoujiaZhang/NeMF. © 2023 IEEE.
关键词	Geometry Training Computer vision Codes Scattering Lighting Rendering (computer graphics)
会议名称	2023 IEEE/CVF International Conference on Computer Vision, ICCV 2023
会议地点	Paris, France
会议日期	October 2, 2023 - October 6, 2023
URL	查看原文
收录类别	EI
语种	英语
出版者	Institute of Electrical and Electronics Engineers Inc.
EI入藏号	20240915635617
原始文献类型	Conference article (CA)
来源库	IEEE
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/364696
专题	信息科学与技术学院_PI研究组_虞晶怡组
通讯作者	Yang, Wei
作者单位	1.Huazhong University of Science and Technology, China 2.Tencent, China 3.ShanghaiTech University, China
推荐引用方式 GB/T 7714	Zhang, Youjia,Xu, Teng,Yu, Junqing,et al. NeMF: Inverse Volume Rendering with Neural Microflake Field[C]:Institute of Electrical and Electronics Engineers Inc.,2023:22862-22872.