Search Results for author: Ganlin Song

Found 2 papers, 1 papers with code

Convergence and Alignment of Gradient Descent with Random Backpropagation Weights

no code implementations NeurIPS 2021 Ganlin Song, Ruitu Xu, John Lafferty

In this paper we study the mathematical properties of the feedback alignment procedure by analyzing convergence and alignment for two-layer networks under squared error loss.

Surfing: Iterative optimization over incrementally trained deep networks

1 code implementation NeurIPS 2019 Ganlin Song, Zhou Fan, John Lafferty

When initialized with random parameters $\theta_0$, we show that the objective $f_{\theta_0}(x)$ is "nice'' and easy to optimize with gradient descent.

Cannot find the paper you are looking for? You can Submit a new open access paper.