| |||||||
ShanghaiTech University Knowledge Management System
Dual-level Adaptive Self-Labeling for Novel Class Discovery in Point Cloud Segmentation | |
2024-07-17 | |
会议录名称 | ECCV (IF:0.402[JCR-2005],0.000[5-Year]) |
ISSN | 0302-9743 |
卷号 | 15071 |
发表状态 | 已发表 |
DOI | arXiv:2407.12489 |
摘要 | We tackle the novel class discovery in point cloud segmentation, which discovers novel classes based on the semantic knowledge of seen classes. Existing work proposes an online point-wise clustering method with a simplified equal class-size constraint on the novel classes to avoid degenerate solutions. However, the inherent imbalanced distribution of novel classes in point clouds typically violates the equal class-size constraint. Moreover, point-wise clustering ignores the rich spatial context information of objects, which results in less expressive representation for semantic segmentation. To address the above challenges, we propose a novel self-labeling strategy that adaptively generates high-quality pseudo-labels for imbalanced classes during model training. In addition, we develop a dual-level representation that incorporates regional consistency into the point-level classifier learning, reducing noise in generated segmentation. Finally, we conduct extensive experiments on two widely used datasets, SemanticKITTI and SemanticPOSS, and the results show our method outperforms the state of the art by a large margin. |
关键词 | Novel class discovery Point clouds semantic segmentation Long-tailed learning |
会议名称 | 18th European Conference on Computer Vision (ECCV) |
出版地 | GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND |
会议地点 | null,Milan,ITALY |
会议日期 | SEP 29-OCT 04, 2024 |
URL | 查看原文 |
收录类别 | CPCI-S |
语种 | 英语 |
资助项目 | National Science Foundation of China[62350610269] |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Software Engineering |
WOS记录号 | PPRN:90871962 |
出版者 | SPRINGER INTERNATIONAL PUBLISHING AG |
EISSN | 1611-3349 |
文献类型 | 会议论文 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/408332 |
专题 | 信息科学与技术学院_硕士生 信息科学与技术学院_PI研究组_何旭明组 信息科学与技术学院_本科生 信息科学与技术学院_博士生 |
共同第一作者 | Zhang, Chuyu |
通讯作者 | He, Xuming |
作者单位 | 1.ShanghaiTech Univ, Shanghai, Peoples R China 2.Shanghai Engn Res Ctr Intelligent Vis & Imaging, Shanghai, Peoples R China |
第一作者单位 | 上海科技大学 |
通讯作者单位 | 上海科技大学 |
第一作者的第一单位 | 上海科技大学 |
推荐引用方式 GB/T 7714 | Xu, Ruijie,Zhang, Chuyu,Ren, Hui,et al. Dual-level Adaptive Self-Labeling for Novel Class Discovery in Point Cloud Segmentation[C]. GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND:SPRINGER INTERNATIONAL PUBLISHING AG,2024. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。