BernNet: Learning Arbitrary Graph Spectral Filters via Bernstein Approximation

Many representative graph neural networks, e.g., GPR-GNN and ChebNet, approximate graph convolutions with graph spectral filters. However, existing work either applies predefined filter weights or learns them without necessary constraints, which may lead to oversimplified or ill-posed filters. To overcome these issues, we propose BernNet, a novel graph neural network with theoretical support that provides a simple but effective scheme for designing and learning arbitrary graph spectral filters. In particular, for any filter over the normalized Laplacian spectrum of a graph, our BernNet estimates it by an order-$K$ Bernstein polynomial approximation and designs its spectral property by setting the coefficients of the Bernstein basis. Moreover, we can learn the coefficients (and the corresponding filter weights) based on observed graphs and their associated signals and thus achieve the BernNet specialized for the data. Our experiments demonstrate that BernNet can learn arbitrary spectral filters, including complicated band-rejection and comb filters, and it achieves superior performance in real-world graph modeling tasks. Code is available at https://github.com/ivam-he/BernNet.

PDF Abstract NeurIPS 2021 PDF NeurIPS 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Node Classification Chameleon (60%/20%/20% random splits) BernNet 1:1 Accuracy 68.29 ± 1.58 # 9
Node Classification on Non-Homophilic (Heterophilic) Graphs Chameleon(60%/20%/20% random splits) BernNet 1:1 Accuracy 68.29 ± 1.58 # 8
Node Classification CiteSeer (60%/20%/20% random splits) BernNet 1:1 Accuracy 80.09 ± 0.79 # 21
Node Classification Cora (60%/20%/20% random splits) BernNet 1:1 Accuracy 88.52 ± 0.95 # 18
Node Classification on Non-Homophilic (Heterophilic) Graphs Cornell (60%/20%/20% random splits) BernNet 1:1 Accuracy 92.13 ± 1.64 # 15
Node Classification Cornell (60%/20%/20% random splits) BernNet 1:1 Accuracy 92.13 ± 1.64 # 15
Node Classification Film (60%/20%/20% random splits) BernNet 1:1 Accuracy 41.79 ± 1.01 # 5
Node Classification PubMed (60%/20%/20% random splits) BernNet 1:1 Accuracy 88.48 ± 0.41 # 25
Node Classification Squirrel (60%/20%/20% random splits) BernNet 1:1 Accuracy 51.35 ± 0.73 # 13
Node Classification Texas (60%/20%/20% random splits) BernNet 1:1 Accuracy 93.12 ± 0.65 # 14
Node Classification on Non-Homophilic (Heterophilic) Graphs Texas(60%/20%/20% random splits) BernNet 1:1 Accuracy 93.12 ± 0.65 # 13

Methods