Behind the Scenes of Gradient Descent: A Trajectory Analysis via Basis Function Decomposition

1 code implementation • 1 Oct 2022 • Jianhao Ma, Lingjun Guo, Salar Fattahi

This work analyzes the solution trajectory of gradient-based algorithms via a novel basis function decomposition.

Tensor Decomposition