HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations

doi:10.1609/aaai.v38i2.27926

	HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations
	Dong, Yilan 1; Yu, Chunlin1 ; Ha, Ruiyang1 ; Shi, Ye1 ; Ma, Yuexin1 ; Xu, Lan1 ; Fu, Yanwei 2; Wang, Jingya1
	2024-03-25
会议录名称	PROCEEDINGS OF THE AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE
ISSN	2159-5399
卷号	38
期号	2
页码	1600-1608
发表状态	已发表
DOI	10.1609/aaai.v38i2.27926
摘要	Existing gait recognition benchmarks mostly include minor clothing variations in the laboratory environments, but lack persistent changes in appearance over time and space. In this paper, we propose the first in-the-wild benchmark CCGait for cloth-changing gait recognition, which incorporates diverse clothing changes, indoor and outdoor scenes, and multi-modal statistics over 92 days. To further address the coupling effect of clothing and viewpoint variations, we propose a hybrid approach HybridGait that exploits both temporal dynamics and the projected 2D information of 3D human meshes. Specifically, we introduce a Canonical Alignment Spatial-Temporal Transformer (CA-STT) module to encode human joint position-aware features, and fully exploit 3D dense priors via a Silhouette-guided Deformation with 3D-2D Appearance Projection (SilD) strategy. Our contributions are twofold: we provide a challenging benchmark CCGait that captures realistic appearance changes across an expanded and space, and we propose a hybrid framework HybridGait that outperforms prior works on CCGait and Gait3D benchmarks. Our project page is available at https://github.com/HCVLab/HybridGait. © 2024, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.
会议录编者/会议主办者	Association for the Advancement of Artificial Intelligence
关键词	Pattern recognition Coupling effect Gait recognition Human joints Hybrid approach Hybrid framework Laboratory environment Multi-modal Outdoor scenes Spatial temporals Temporal dynamics
会议名称	38th AAAI Conference on Artificial Intelligence, AAAI 2024
会议地点	Vancouver, BC, Canada
会议日期	February 20, 2024 - February 27, 2024
URL	查看原文
收录类别	EI
语种	英语
出版者	Association for the Advancement of Artificial Intelligence
EI入藏号	20241515863950
EI主题词	Gait analysis
EISSN	2374-3468
EI分类号	461.3 Biomechanics, Bionics and Biomimetics
原始文献类型	Conference article (CA)
文献类型	会议论文
条目标识符	https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/364700
专题	信息科学与技术学院_PI研究组_石野组信息科学与技术学院_硕士生信息科学与技术学院_PI研究组_许岚组信息科学与技术学院_PI研究组_马月昕信息科学与技术学院_PI研究组_汪婧雅组
通讯作者	Wang, Jingya
作者单位	1.ShanghaiTech University, China 2.Fudan University, China
第一作者单位	上海科技大学
通讯作者单位	上海科技大学
第一作者的第一单位	上海科技大学
推荐引用方式 GB/T 7714	Dong, Yilan,Yu, Chunlin,Ha, Ruiyang,et al. HybridGait: A Benchmark for Spatial-Temporal Cloth-Changing Gait Recognition with Hybrid Explorations[C]//Association for the Advancement of Artificial Intelligence:Association for the Advancement of Artificial Intelligence,2024:1600-1608.