Search Results for author: Zhiqi Shao

Found 7 papers, 3 papers with code

Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyond

no code implementations6 Sep 2023 Zhiqi Shao, Dai Shi, Andi Han, Yi Guo, Qibin Zhao, Junbin Gao

To explore more flexible filtering conditions, we further generalize MHKG into a model termed G-MHKG and thoroughly show the roles of each element in controlling over-smoothing, over-squashing and expressive power.

How Curvature Enhance the Adaptation Power of Framelet GCNs

1 code implementation19 Jul 2023 Dai Shi, Yi Guo, Zhiqi Shao, Junbin Gao

Motivated by the geometric analogy of Ricci curvature in the graph setting, we prove that by inserting the curvature information with different carefully designed transformation function $\zeta$, several known computational issues in GNN such as over-smoothing can be alleviated in our proposed model.

Graph Classification

Frameless Graph Knowledge Distillation

1 code implementation13 Jul 2023 Dai Shi, Zhiqi Shao, Yi Guo, Junbin Gao

Knowledge distillation (KD) has shown great potential for transferring knowledge from a complex teacher model to a simple student model in which the heavy learning task can be accomplished efficiently and without losing too much prediction accuracy.

Graph Representation Learning Knowledge Distillation

Revisiting Generalized p-Laplacian Regularized Framelet GCNs: Convergence, Energy Dynamic and Training with Non-Linear Diffusion

no code implementations25 May 2023 Dai Shi, Zhiqi Shao, Yi Guo, Qibin Zhao, Junbin Gao

We conduct a convergence analysis on pL-UFG, addressing the gap in the understanding of its asymptotic behaviors.

Generalized energy and gradient flow via graph framelets

no code implementations8 Oct 2022 Andi Han, Dai Shi, Zhiqi Shao, Junbin Gao

In this work, we provide a theoretical understanding of the framelet-based graph neural networks through the perspective of energy gradient flow.

Cannot find the paper you are looking for? You can Submit a new open access paper.