Geom-GCN: Geometric Graph Convolutional Networks

Message-passing neural networks (MPNNs) have been successfully applied to representation learning on graphs in a variety of real-world applications. However, two fundamental weaknesses of MPNNs' aggregators limit their ability to represent graph-structured data: losing the structural information of nodes in neighborhoods and lacking the ability to capture long-range dependencies in disassortative graphs. Few studies have noticed the weaknesses from different perspectives. From the observations on classical neural network and network geometry, we propose a novel geometric aggregation scheme for graph neural networks to overcome the two weaknesses. The behind basic idea is the aggregation on a graph can benefit from a continuous space underlying the graph. The proposed aggregation scheme is permutation-invariant and consists of three modules, node embedding, structural neighborhood, and bi-level aggregation. We also present an implementation of the scheme in graph convolutional networks, termed Geom-GCN (Geometric Graph Convolutional Networks), to perform transductive learning on graphs. Experimental results show the proposed Geom-GCN achieved state-of-the-art performance on a wide range of open datasets of graphs. Code is available at https://github.com/graphdml-uiuc-jlu/geom-gcn.

PDF Abstract ICLR 2020 PDF ICLR 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Node Classification Actor Geom-GCN-P Accuracy 31.63 # 44
Node Classification Actor Geom-GCN-I Accuracy 29.09 # 49
Node Classification Actor Geom-GCN-S Accuracy 30.3 # 46
Node Classification Chameleon Geom-GCN-I Accuracy 60.31 # 47
Node Classification Chameleon Geom-GCN-S Accuracy 59.96 # 48
Node Classification Chameleon Geom-GCN-P Accuracy 60.9 # 45
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 60.00 ± 2.81 # 25
Node Classification Chameleon (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 60.9 # 27
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon(60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 60.9 # 24
Node Classification Citeseer (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 78.02 ± 1.15 # 1
Node Classification CiteSeer (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 77.99 # 25
Node Classification Cora (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 85.35 ± 1.57 # 23
Node Classification Cora (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 85.27 # 26
Node Classification Cornell Geom-GCN-I Accuracy 56.76 # 49
Node Classification Cornell Geom-GCN-P Accuracy 60.81 # 46
Node Classification Cornell Geom-GCN-S Accuracy 55.68 # 50
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 60.54 ± 3.67 # 25
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 60.81 # 32
Node Classification Cornell (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 60.81 # 35
Node Classification on Non-Homophilic (Heterophilic) Graphs Film(48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 31.59 ± 1.15 # 25
Node Classification Film (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 31.63 # 32
Node Classification PubMed (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 89.95 ± 0.47 # 2
Node Classification PubMed (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 90.05 # 15
Node Classification Squirrel Geom-GCN-S Accuracy 36.24 # 47
Node Classification Squirrel Geom-GCN-P Accuracy 38.14 # 45
Node Classification Squirrel Geom-GCN-I Accuracy 33.32 # 49
Node Classification on Non-Homophilic (Heterophilic) Graphs Squirrel (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 38.15 ± 0.92 # 25
Node Classification Squirrel (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 38.14 # 32
Node Classification Texas Geom-GCN-I Accuracy 57.58 # 53
Node Classification Texas Geom-GCN-P Accuracy 67.57 # 48
Node Classification Texas Geom-GCN-S Accuracy 59.73 # 52
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 66.76 ± 2.72 # 24
Node Classification Texas (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 67.57 # 36
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas(60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 67.57 # 32
Node Classification Wisconsin Geom-GCN-P Accuracy 64.12 # 49
Node Classification Wisconsin Geom-GCN-I Accuracy 58.24 # 51
Node Classification Wisconsin Geom-GCN-S Accuracy 56.67 # 53
Node Classification on Non-Homophilic (Heterophilic) Graphs Wisconsin (48%/32%/20% fixed splits) Geom-GCN 1:1 Accuracy 64.51 ± 3.66 # 24
Node Classification Wisconsin (60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 64.12 # 34
Node Classification on Non-Homophilic (Heterophilic) Graphs Wisconsin(60%/20%/20% random splits) Geom-GCN* 1:1 Accuracy 64.12 # 31

Methods


No methods listed for this paper. Add relevant methods here