Search Results for author: Zedong Tang

Found 3 papers, 1 papers with code

SKFAC: Training Neural Networks With Faster Kronecker-Factored Approximate Curvature

no code implementations CVPR 2021 Zedong Tang, Fenlong Jiang, Maoguo Gong, Hao Li, Yue Wu, Fan Yu, Zidong Wang, Min Wang

For the fully connected layers, by utilizing the low-rank property of Kronecker factors of Fisher information matrix, our method only requires inverting a small matrix to approximate the curvature with desirable accuracy.

Dimensionality Reduction

AsymptoticNG: A regularized natural gradient optimization algorithm with look-ahead strategy

no code implementations24 Dec 2020 Zedong Tang, Fenlong Jiang, Junke Song, Maoguo Gong, Hao Li, Fan Yu, Zidong Wang, Min Wang

Optimizers that further adjust the scale of gradient, such as Adam, Natural Gradient (NG), etc., despite widely concerned and used by the community, are often found poor generalization performance, compared with Stochastic Gradient Descent (SGD).

Locality Preserving Dense Graph Convolutional Networks with Graph Context-Aware Node Representations

1 code implementation12 Oct 2020 Wenfeng Liu, Maoguo Gong, Zedong Tang, A. K. Qin

To enhance node representativeness, the output of each convolutional layer is concatenated with the output of the previous layer's readout to form a global context-aware node representation.

General Classification Graph Classification +1

Cannot find the paper you are looking for? You can Submit a new open access paper.