ShanghaiTech University Knowledge Management System
| NFT1000: A Cross-Modal Dataset for Non-Fungible Token Retrieval | |
| 2024-10-17 | |
| 状态 | 已发表 |
| 摘要 | With the rise of "Metaverse" and "Web 3.0", Non-Fungible Token (NFT) has emerged as a kind of pivotal digital asset, garnering significant attention. By the end of March 2024, more than 1.7 billion NFTs have been minted across various blockchain platforms. To effectively locate a desired NFT, conducting searches within a vast array of NFTs is essential. The challenge in NFT retrieval is heightened due to the high degree of similarity among different NFTs, regarding regional and semantic aspects. In this paper, we will introduce a benchmark dataset named “NFT Top1000 Visual-Text Dataset” (NFT1000, as shown in Fig.1), containing 7.56 million image-text pairs, and being collected from 1000 most famous PFP 1 NFT collections 2 by sales volume on the Ethereum blockchain. Based on this dataset and leveraging the CLIP series of pre-trained models as our foundation, we propose the dynamic masking fine-tuning scheme. This innovative approach results in a 7.4% improvement in the top1 accuracy rate, while utilizing merely 13% of the total training data (0.79 million vs. 6.1 million). We also propose a robust metric Comprehensive Variance Index (CVI) to assess the similarity and retrieval difficulty of visual-text pairs data. The dataset will be released as an open-source resource. For more details, please refer to: https://github.com/ShuxunoO/NFT-Net.git |
| 关键词 | Cross-Modal Retrieval Blockchain NFT CLIP AIGC |
| 语种 | 英语 |
| DOI | arXiv:2402.16872 |
| 相关网址 | 查看原文 |
| 出处 | Arxiv |
| 收录类别 | PPRN.PPRN |
| WOS记录号 | PPRN:87919398 |
| WOS类目 | Computer Science, Information Systems |
| 资助项目 | National Natural Science Foundation of China["62302501","62036011","62122086","62192782","61721004","62202469","62066011","U2033210"] ; Key Research and Development Program of Xinjiang Urumqi Autonomous Region[2023B01005] |
| 文献类型 | 预印本 |
| 条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/445524 |
| 专题 | 信息科学与技术学院 |
| 通讯作者 | Li, Bing |
| 作者单位 | 1.Univ Chinese Acad Sci, Inst Automat, CAS Sch AI, MAIS, Beijing, Peoples R China 2.Beijing Univ Aeronaut & Astronaut, Beijing, Peoples R China 3.CAS, Inst Automat, MAIS, Beijing, Peoples R China 4.ShanghaiTech Univ, Sch Informat Sci & Technol, Beijing, Peoples R China |
| 推荐引用方式 GB/T 7714 | Wang, Shuxun,Lei, Yunfei,Zhang, Ziqi,et al. NFT1000: A Cross-Modal Dataset for Non-Fungible Token Retrieval. 2024. |
| 条目包含的文件 | ||||||
| 条目无相关文件。 | ||||||
修改评论
除非特别说明，本系统中所有内容都受版权保护，并保留所有权利。