Residual Network and Embedding Usage: New Tricks of Node Classification with Graph Convolutional Networks

18 May 2021  ·  Huixuan Chi, Yuying Wang, Qinfen Hao, Hong Xia ·

Graph Convolutional Networks (GCNs) and subsequent variants have been proposed to solve tasks on graphs, especially node classification tasks. In the literature, however, most tricks or techniques are either briefly mentioned as implementation details or only visible in source code. In this paper, we first summarize some existing effective tricks used in GCNs mini-batch training. Based on this, two novel tricks named GCN_res Framework and Embedding Usage are proposed by leveraging residual network and pre-trained embedding to improve baseline's test accuracy in different datasets. Experiments on Open Graph Benchmark (OGB) show that, by combining these techniques, the test accuracy of various GCNs increases by 1.21%~2.84%. We open source our implementation at https://github.com/ytchx1999/PyG-OGB-Tricks.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Node Property Prediction ogbn-arxiv GAT-node2vec + BoT + self-KD Test Accuracy 0.7420 ± 0.0004 # 22
Validation Accuracy 0.7482 ± 0.0015 # 40
Number of params 1700432 # 20
Ext. data No # 1
Node Property Prediction ogbn-arxiv GAT-node2vec + BoT Test Accuracy 0.7405 ± 0.0004 # 27
Validation Accuracy 0.7482 ± 0.0015 # 40
Number of params 1700432 # 20
Ext. data No # 1
Node Property Prediction ogbn-mag R-GSN + metapath2vec Test Accuracy 0.5109 ± 0.0038 # 22
Validation Accuracy 0.5295 ± 0.0042 # 23
Number of params 309777252 # 1
Ext. data No # 1

Methods


No methods listed for this paper. Add relevant methods here