HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

	HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations
	Dong, Yilan 1; Yu, Chunlin1 ; Ha, Ruiyang1 ; Shi, Ye1 ; Ma, Yuexin1 ; Xu, Lan1 ; Fu, Yanwei 2; Wang, Jingya1
	2024
会议录名称	THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2
ISSN	2159-5399
发表状态	已发表
摘要	Existing gait recognition benchmarks mostly include minor clothing variations in the laboratory environments, but lack persistent changes in appearance over time and space. In this paper, we propose the first in-the-wild benchmark CCGait for cloth-changing gait recognition, which incorporates diverse clothing changes, indoor and outdoor scenes, and multimodal statistics over 92 days. To further address the coupling effect of clothing and viewpoint variations, we propose a hybrid approach HybridGait that exploits both temporal dynamics and the projected 2D information of 3D human meshes. Specifically, we introduce a Canonical Alignment Spatial-Temporal Transformer (CA-STT) module to encode human joint position-aware features, and fully exploit 3D dense priors via a Silhouette-guided Deformation with 3D-2D Appearance Projection (SilD) strategy. Our contributions are twofold: we provide a challenging benchmark CCGait that captures realistic appearance changes across an expanded and space, and we propose a hybrid framework HybridGait that outperforms prior works on CCGait and Gait3D benchmarks. Our project page is available at https://github.com/HCVLab/HybridGait.
会议名称	38th AAAI Conference on Artificial Intelligence (AAAI) / 36th Conference on Innovative Applications of Artificial Intelligence / 14th Symposium on Educational Advances in Artificial Intelligence
出版地	2275 E BAYSHORE RD, STE 160, PALO ALTO, CA 94303 USA
会议地点	null,Vancouver,CANADA
会议日期	FEB 20-27, 2024
URL	查看原文
收录类别	CPCI-S
语种	英语
资助项目	Shanghai Sailing Program["21YF1429400","22YF1428800"] ; Shanghai Local College Capacity Building Program[23010503100] ; NSFC[62303319]
WOS研究方向	Computer Science
WOS类目	Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods
WOS记录号	WOS:001239880400103
出版者	ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE
EISSN	2374-3468
引用统计	正在获取...
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/381308
专题	信息科学与技术学院_硕士生信息科学与技术学院_PI研究组_许岚组信息科学与技术学院_PI研究组_马月昕信息科学与技术学院_PI研究组_汪婧雅组信息科学与技术学院_PI研究组_石野组
通讯作者	Wang, Jingya
作者单位	1.ShanghaiTech Univ, Shanghai, Peoples R China 2.Fudan Univ, Shanghai, Peoples R China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Dong, Yilan,Yu, Chunlin,Ha, Ruiyang,et al. HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations[C]. 2275 E BAYSHORE RD, STE 160, PALO ALTO, CA 94303 USA:ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE,2024.