1 code implementation • 23 Dec 2023 • Shuoran Jiang, Qingcai Chen, Youchen Pan, Yang Xiang, Yukang Lin, XiangPing Wu, Chuanyi Liu, Xiaobao Song
Our convergence analysis and experiments prove this is a better way to improve convergence stability and rate in ZO-SGD.
