| |||||||
ShanghaiTech University Knowledge Management System
Self-attention Dual Embedding for Graphs with Heterophily | |
2023-05-28 | |
状态 | 已发表 |
摘要 | Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs are heterophilic, and this leads to much lower classification accuracy using standard GNNs. In this work, we design a novel GNN which is effective for both heterophilic and homophilic graphs. Our work is based on three main observations. First, we show that node features and graph topology provide different amounts of informativeness in different graphs, and therefore they should be encoded independently and prioritized in an adaptive manner. Second, we show that allowing negative attention weights when propagating graph topology information improves accuracy. Finally, we show that asymmetric attention weights between nodes are helpful. We design a GNN which makes use of these observations through a novel self-attention mechanism. We evaluate our algorithm on real-world graphs containing thousands to millions of nodes and show that we achieve state-of-the-art results compared to existing GNNs. We also analyze the effectiveness of the main components of our design on different graphs. |
DOI | arXiv:2305.18385 |
相关网址 | 查看原文 |
出处 | Arxiv |
WOS记录号 | PPRN:72763947 |
WOS类目 | Computer Science, Artificial Intelligence ; Computer Science, Information Systems |
文献类型 | 预印本 |
条目标识符 | https://kms.shanghaitech.edu.cn/handle/2MSLDSTB/348075 |
专题 | 信息科学与技术学院 信息科学与技术学院_PI研究组_范睿组 信息科学与技术学院_硕士生 |
作者单位 | Shanghai Tech Univ, Sch Informat Sci & Technol, Shanghai, Peoples R China |
推荐引用方式 GB/T 7714 | Lai, Yurui,Zhang, Taiyan,Fan, Rui. Self-attention Dual Embedding for Graphs with Heterophily. 2023. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 |
修改评论
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。