HumanGen: Generating Human Radiance Fields with Explicit Priors

doi:10.1109/CVPR52729.2023.01207

	HumanGen: Generating Human Radiance Fields with Explicit Priors
	Suyi Jiang1 ; Haoran Jiang1 ; Ziyu Wang1 ; Haimin Luo1 ; Wenzheng Chen 2; Lan Xu1
	2023-06-17
会议录名称	2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR)
ISSN	1063-6919
发表状态	已发表
DOI	10.1109/CVPR52729.2023.01207
摘要	Recent years have witnessed the tremendous progress of 3D GANs for generating view-consistent radiance fields with photo-realism. Yet, high-quality generation of human radiance fields remains challenging, partially due to the limited human-related priors adopted in existing methods. We present HumanGen, a novel 3D human generation scheme with detailed geometry and 360° realistic free-view rendering. It explicitly marries the 3D human generation with various priors from the 2D generator and 3D reconstructor of humans through the design of “anchor image”. We introduce a hybrid feature representation using the anchor image to bridge the latent space of HumanGen with the existing 2D generator. We then adopt a pronged design to disentangle the generation of geometry and appearance. With the aid of the anchor image, we adapt a 3D reconstructor for fine-grained details synthesis and propose a two-stage blending scheme to boost appearance generation. Extensive experiments demonstrate our effectiveness for state-of-the-art 3D human generation regarding geometry details, texture quality, and free-view performance. Notably, HumanGen can also incorporate various off-the-shelf 2D latent editing methods, seamlessly lifting them into 3D.
关键词	Humans: Face body pose gesture movement
会议地点	Vancouver, BC, Canada
会议日期	17-24 June 2023
URL	查看原文
来源库	IEEE
引用统计	正在获取...
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/333413
专题	信息科学与技术学院_硕士生信息科学与技术学院_博士生信息科学与技术学院_PI研究组_许岚组
作者单位	1.ShanghaiTech University 2.University of Toronto
第一作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Suyi Jiang,Haoran Jiang,Ziyu Wang,et al. HumanGen: Generating Human Radiance Fields with Explicit Priors[C],2023.