Ensemble Learning for Graph Neural Networks

22 Oct 2023  ·  Zhen Hao Wong, Ling Yue, Quanming Yao ·

Graph Neural Networks (GNNs) have shown success in various fields for learning from graph-structured data. This paper investigates the application of ensemble learning techniques to improve the performance and robustness of Graph Neural Networks (GNNs). By training multiple GNN models with diverse initializations or architectures, we create an ensemble model named ELGNN that captures various aspects of the data and uses the Tree-Structured Parzen Estimator algorithm to determine the ensemble weights. Combining the predictions of these models enhances overall accuracy, reduces bias and variance, and mitigates the impact of noisy data. Our findings demonstrate the efficacy of ensemble learning in enhancing GNN capabilities for analyzing complex graph-structured data. The code is public at https://github.com/wongzhenhao/ELGNN.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Link Property Prediction ogbl-ddi ELGNN Test Hits@20 0.9777 ± 0.0037 # 2
Validation Hits@20 0.8965 ± 0.0021 # 2
Number of params 10512391 # 2
Ext. data No # 1

Methods