Non-Local Graph Neural Networks

29 May 2020  ·  Meng Liu, Zhengyang Wang, Shuiwang Ji ·

Modern graph neural networks (GNNs) learn node embeddings through multilayer local aggregation and achieve great success in applications on assortative graphs. However, tasks on disassortative graphs usually require non-local aggregation. In addition, we find that local aggregation is even harmful for some disassortative graphs. In this work, we propose a simple yet effective non-local aggregation framework with an efficient attention-guided sorting for GNNs. Based on it, we develop various non-local GNNs. We perform thorough experiments to analyze disassortative graph datasets and evaluate our non-local GNNs. Experimental results demonstrate that our non-local GNNs significantly outperform previous state-of-the-art methods on seven benchmark datasets of disassortative graphs, in terms of both model performance and efficiency.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Node Classification Actor NLMLP  Accuracy 37.9 ± 1.3 # 8
Node Classification Actor NLGCN  Accuracy 31.6 ± 1.0 # 45
Node Classification Actor NLGAT  Accuracy 29.5 ± 1.3 # 47
Node Classification Chameleon NLGAT  Accuracy 65.7 ± 1.4 # 38
Node Classification Chameleon NLMLP  Accuracy 50.7 ± 2.2 # 52
Node Classification Chameleon NLGCN  Accuracy 70.1 ± 2.9 # 24
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 50.7 ± 2.2 # 27
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 70.1 ± 2.9 # 10
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 65.7 ± 1.4 # 18
Node Classification Citeseer (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 76.2 ± 1.6 # 21
Node Classification Citeseer (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 73.4 ± 1.9 # 24
Node Classification Citeseer (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 75.2 ± 1.4 # 22
Node Classification Cora (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 88.5 ± 1.8 # 1
Node Classification Cora (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 88.1 ± 1.0 # 9
Node Classification Cora (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 76.9 ± 1.8 # 25
Node Classification Cornell NLGCN  Accuracy 57.6 ± 5.5 # 48
Node Classification Cornell NLMLP  Accuracy 84.9 ± 5.7 # 21
Node Classification Cornell NLGAT  Accuracy 54.7 ± 7.6 # 51
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 84.9 ± 5.7 # 12
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 54.7 ± 7.6 # 27
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 57.6 ± 5.5 # 26
Node Classification on Non-Homophilic (Heterophilic) Graphs Film(48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 31.6 ± 1.0 # 24
Node Classification on Non-Homophilic (Heterophilic) Graphs Film(48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 29.5 ± 1.3 # 26
Node Classification on Non-Homophilic (Heterophilic) Graphs Film(48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 37.9 ± 1.3 # 1
Node Classification PubMed (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 88.2 ± 0.5 # 20
Node Classification PubMed (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 88.2 ± 0.3 # 20
Node Classification PubMed (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 89.0 ± 0.5 # 17
Node Classification Squirrel NLMLP  Accuracy 33.7 ± 1.5 # 48
Node Classification Squirrel NLGCN  Accuracy 59.0 ± 1.2 # 23
Node Classification Squirrel NLGAT  Accuracy 56.8 ± 2.5 # 27
Node Classification on Non-Homophilic (Heterophilic) Graphs Squirrel (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 33.7 ± 1.5 # 27
Node Classification on Non-Homophilic (Heterophilic) Graphs Squirrel (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 56.8 ± 2.5 # 12
Node Classification on Non-Homophilic (Heterophilic) Graphs Squirrel (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 59.0 ± 1.2 # 9
Node Classification Texas NLGAT  Accuracy 62.6 ± 7.1 # 51
Node Classification Texas NLGCN  Accuracy 65.5 ± 6.6 # 49
Node Classification Texas NLMLP  Accuracy 85.4 ± 3.8 # 24
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 62.6 ± 7.1 # 26
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 85.4 ± 3.8 # 9
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 65.5 ± 6.6 # 25
Node Classification Wisconsin NLMLP  Accuracy 87.3 ± 4.3 # 23
Node Classification Wisconsin NLGCN  Accuracy 60.2 ± 5.3 # 50
Node Classification Wisconsin NLGAT  Accuracy 56.9 ± 7.3 # 52
Node Classification on Non-Homophilic (Heterophilic) Graphs Wisconsin (48%/32%/20% fixed splits) NLGAT  1:1 Accuracy 56.9 ± 7.3 # 26
Node Classification on Non-Homophilic (Heterophilic) Graphs Wisconsin (48%/32%/20% fixed splits) NLGCN  1:1 Accuracy 60.2 ± 5.3  # 25
Node Classification on Non-Homophilic (Heterophilic) Graphs Wisconsin (48%/32%/20% fixed splits) NLMLP  1:1 Accuracy 87.3 ± 4.3  # 12

Methods


No methods listed for this paper. Add relevant methods here