Search Results for author: Zhouzi Li

Found 1 papers, 0 papers with code

Analyzing Sharpness along GD Trajectory: Progressive Sharpening and Edge of Stability

no code implementations26 Jul 2022 Zhouzi Li, Zixuan Wang, Jian Li

Based on this empirical observation, we attempt to theoretically and empirically explain the dynamics of various key quantities that lead to the change of sharpness in each phase of EOS.

Cannot find the paper you are looking for? You can Submit a new open access paper.