LiDARCap: Long-range Markerless 3D Human Motion Capture with LiDAR Point Clouds

doi:10.1109/CVPR52688.2022.01985

	LiDARCap: Long-range Markerless 3D Human Motion Capture with LiDAR Point Clouds
	Li, Jialian 1; Zhang, Jingyi 1; Wang, Zhiyong 1; Shen, Siqi 1; Wen, Chenglu 1; Ma, Yuexin2 ; Xu, Lan2 ; Yu, Jingyi2 ; Wang, Cheng 1
	2022
会议录名称	PROCEEDINGS OF THE IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION
ISSN	1063-6919
卷号	2022-June
页码	20470-20480
发表状态	已发表
DOI	10.1109/CVPR52688.2022.01985
摘要	Existing motion capture datasets are largely short-range and cannot yet fit the need of long-range applications. We propose LiDARHuman26M, a new human motion capture dataset captured by LiDAR at a much longer range to overcome this limitation. Our dataset also includes the ground truth human motions acquired by the IMU system and the synchronous RGB images. We further present a strong base-line method, LiDARCap, for LiDAR point cloud human motion capture. Specifically, we first utilize $PointNet++$ to encode features of points and then employ the inverse kinematics solver and SMPL optimizer to regress the pose through aggregating the temporally encoded features hierarchically. Quantitative and qualitative experiments show that our method outperforms the techniques based only on RGB images. Ablation experiments demonstrate that our dataset is challenging and worthy of further research. Finally, the experiments on the KITTI Dataset and the Waymo Open Dataset show that our method can be generalized to different LiDAR sensor settings. © 2022 IEEE.
会议名称	2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022
出版地	10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA
会议地点	New Orleans, LA, United states
会议日期	June 19, 2022 - June 24, 2022
URL	查看原文
收录类别	EI ; CPCI-S
语种	英语
WOS研究方向	Computer Science ; Imaging Science & Photographic Technology
WOS类目	Computer Science, Artificial Intelligence ; Imaging Science & Photographic Technology
WOS记录号	WOS:000870783006030
出版者	IEEE Computer Society
EI入藏号	20224913201474
原始文献类型	Conference article (CA)
来源库	IEEE
引用统计	正在获取...
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/256366
专题	信息科学与技术学院_PI研究组_许岚组信息科学与技术学院_PI研究组_虞晶怡组信息科学与技术学院_PI研究组_马月昕
通讯作者	Wang, Cheng
作者单位	1.Xiamen Univ, Fujian Key Lab Sensing & Comp Smart Cities, Xiamen, Peoples R China 2.ShanghaiTech Univ, Shanghai Engn Res Ctr Intelligent Vis & Imaging, Shanghai, Peoples R China
推荐引用方式 GB/T 7714	Li, Jialian,Zhang, Jingyi,Wang, Zhiyong,et al. LiDARCap: Long-range Markerless 3D Human Motion Capture with LiDAR Point Clouds[C]. 10662 LOS VAQUEROS CIRCLE, PO BOX 3014, LOS ALAMITOS, CA 90720-1264 USA:IEEE Computer Society,2022:20470-20480.