Sparse Photometric 3D Face Reconstruction Guided by Morphable Models

doi:10.1109/CVPR.2018.00487

	Sparse Photometric 3D Face Reconstruction Guided by Morphable Models
	Cao, Xuan; Chen, Zhang; Chen, Anpei; Chen, Xin; Li, Shiying; Yu, Jingyi
	2018
会议录名称	2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)
ISSN	1063-6919
页码	4635-4644
发表状态	已发表
DOI	10.1109/CVPR.2018.00487
摘要	We present a novel 3D face reconstruction technique that leverages sparse photometric stereo (PS) and latest advances on face registration / modeling from a single image. We observe that 3D morphable faces approach [21] provides a reasonable geometry proxy for light position calibration. Specifically, we develop a robust optimization technique that can calibrate per-pixel lighting direction and illumination at a very high precision without assuming uniform surface albedos. Next, we apply semantic segmentation on input images and the geometry proxy to refine hairy vs. bare skin regions using tailored filter Experiments on synthetic and real data show that by using a very small set of images, our technique is able to reconstruct fine geometric details such as wrinkles, eyebrows, whelks, pores, etc, comparable to and sometimes surpassing movie quality productions.
出版地	345 E 47TH ST, NEW YORK, NY 10017 USA
会议地点	Salt Lake City, UT, United states
会议日期	18-23 June 2018
URL	查看原文
收录类别	CPCI ; CPCI-S ; EI
语种	英语
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence
WOS记录号	WOS:000457843604082
出版者	IEEE
EI入藏号	20191106642222
EI主题词	Computer vision ; Geometry ; Image segmentation ; Optimization ; Photometry ; Semantics ; Stereo image processing ; Three dimensional computer graphics
EI分类号	Data Processing and Image Processing:723.2 ; Computer Applications:723.5 ; Mathematics:921 ; Optimization Techniques:921.5 ; Optical Variables Measurements:941.4
WOS关键词	STEREO
原始文献类型	Proceedings Paper
来源库	IEEE
引用统计	正在获取...
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/29851
专题	信息科学与技术学院信息科学与技术学院_PI研究组_虞晶怡组信息科学与技术学院_硕士生信息科学与技术学院_博士生
通讯作者	Cao, Xuan
作者单位	ShanghaiTech Univ, 393 Middle Huaxia Rd, Shanghai, Peoples R China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Cao, Xuan,Chen, Zhang,Chen, Anpei,et al. Sparse Photometric 3D Face Reconstruction Guided by Morphable Models[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2018:4635-4644.