| |||||||
ShanghaiTech University Knowledge Management System
Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field | |
2020-07-01 | |
发表期刊 | IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (IF:20.8[JCR-2023],22.2[5-Year]) |
ISSN | 0162-8828 |
EISSN | 1939-3539 |
卷号 | 42期号:7页码:1594-1605 |
发表状态 | 已发表 |
DOI | 10.1109/TPAMI.2020.2986764 |
摘要 | Recovering the shape and reflectance of non-Lambertian surfaces remains a challenging problem in computer vision since the view-dependent appearance invalidates traditional photo-consistency constraint. In this paper, we introduce a novel concentric multi-spectral light field (CMSLF) design that is able to recover the shape and reflectance of surfaces of various materials in one shot. Our CMSLF system consists of an array of cameras arranged on concentric circles where each ring captures a specific spectrum. Coupled with a multi-spectral ring light, we are able to sample viewpoint and lighting variations in a single shot via spectral multiplexing. We further show that our concentric camera and light source setting results in a unique single-peak pattern in specularity variations across viewpoints. This property enables robust depth estimation for specular points. To estimate depth and multi-spectral reflectance map, we formulate a physics-based reflectance model for the CMSLF under the surface camera (S-Cam) representation. Extensive synthetic and real experiments show that our method outperforms the state-of-the-art shape reconstruction methods, especially for non-Lambertian surfaces. |
关键词 | Cameras Shape Surface reconstruction Lighting Light sources Image reconstruction Computational modeling Shape reconstruction surface reflectance multi-spectral light field |
收录类别 | SCI ; EI ; SCIE |
资助项目 | Louisiana Board of Regents[LEQSF(2018-21)-RD-A-10] |
WOS研究方向 | Computer Science ; Engineering |
WOS类目 | Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic |
WOS记录号 | WOS:000542967200006 |
出版者 | IEEE COMPUTER SOC |
WOS关键词 | PHOTOMETRIC STEREO ; MULTIVIEW STEREO ; COLOR |
原始文献类型 | Article |
引用统计 | 正在获取...
|
文献类型 | 期刊论文 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/121913 |
专题 | 信息科学与技术学院_PI研究组_虞晶怡组 |
通讯作者 | Ye, Jinwei |
作者单位 | 1.DGene Digital Technol, Baton Rouge, LA 70820 USA 2.Louisiana State Univ, Baton Rouge, LA 70803 USA 3.US Army Res Lab, Adelphi, MD 20783 USA 4.Shanghai Tech Univ, Shanghai 201210, Peoples R China 5.Louisiana State Univ, Div Comp Sci & Engn, Baton Rouge, LA 70803 USA |
推荐引用方式 GB/T 7714 | Zhou, Mingyuan,Ding, Yuqi,Ji, Yu,et al. Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field[J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,2020,42(7):1594-1605. |
APA | Zhou, Mingyuan,Ding, Yuqi,Ji, Yu,Young, S. Susan,Yu, Jingyi,&Ye, Jinwei.(2020).Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field.IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,42(7),1594-1605. |
MLA | Zhou, Mingyuan,et al."Shape and Reflectance Reconstruction Using Concentric Multi-Spectral Light Field".IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 42.7(2020):1594-1605. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。