MULTI-VIEW NEURAL HUMAN RENDERING
Alternative Title多视图神经人类渲染
Application NumberWOCN20082120
2020-03-30
Open (Notice) NumberWO2021195854A1
Date Available2021-10-07
AbstractAn end-to-end Neural Human Renderer (NHR) for dynamic human captures under the multi-view setting is provided. A feature extraction (FE) module adopts PointNet++ to analyze and extract features based on structure and semantics. A projection and rasterization (PR) module maps 3D features onto the target camera to form a 2D feature map. A rendering (RE) module renders the final image from the feature map at a new viewpoint, where an anti-aliased CNN is employed to handle holes and noises. Foreground human masks generated at each newly synthesized view from NHR are used to construct visual hulls to handle textureless and dark regions such as black clothing.
Other Abstract提供了一种用于在多视图设置下动态捕捉人的端对端神经人类渲染器(NHR)。 特征提取(FE)模块采用PointNet++基于结构和语义分析提取特征。 投影和光栅化(PR)模块将3D特征映射到目标相机上以形成2D特征映射。 渲染(RE)模块在新的视点处渲染来自特征图的最终图像,其中使用抗混叠CNN来处理孔和噪声。 在来自NHR的每个新合成的视图中生成的前景人掩模被用于构建视觉外壳以处理无纹理和暗区,例如黑色服装。
Rights HolderSHANGHAITECH UNIVERSITY
Patent AgentSHANGHAI SAVVY INTELLECTUAL PROPERTY AGENCY
AgencySHANGHAI SAVVY INTELLECTUAL PROPERTY AGENCY
Patent ApplicantSHANGHAITECH UNIVERSITY
WU Minye; YU Jingyi
Country世界知识产权组织
Public national abbreviationWO
IPC Classification NumberG06K9//00
Patent StatusPCT-有效期内
Subtype发明申请
Patent type dictionary1
Status暂缺
Simple kinWO2021195854A1
Extended kinWO2021195854A1
INPADOC kinWO2021195854A1
Document Type专利
Identifierhttps://kms.shanghaitech.edu.cn/handle/2MSLDSTB/128276
Collection信息科学与技术学院_博士生
信息科学与技术学院_PI研究组_虞晶怡组
AffiliationSHANGHAITECH UNIVERSITY
Recommended Citation
GB/T 7714
WU Minye, YU Jingyi. MULTI-VIEW NEURAL HUMAN RENDERING. WOCN20082120[P]. 2020-03-30.
Files in This Item:
File Name/Size DocType Version Access License
MULTI-VIEW NEURAL HU(1611KB)专利 限制开放CC BY-NC-SAView Application Full Text
Related Services
Usage statistics
Scholar Google
Similar articles in Scholar Google
[WU Minye]'s Articles
[ YU Jingyi]'s Articles
Baidu academic
Similar articles in Baidu academic
[WU Minye]'s Articles
[ YU Jingyi]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[WU Minye]'s Articles
[ YU Jingyi]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: MULTI-VIEW NEURAL HUMAN RENDERING.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.