One-Step Forward and Backtrack: Overcoming Zig-Zagging in Loss-Aware Quantization Training

1 code implementation • 30 Jan 2024 • Lianbo Ma, Yuee Zhou, Jianlun Ma, Guo Yu, Qing Li

During the gradient descent learning, a one-step forward search is designed to find the trial gradient of the next-step, which is adopted to adjust the gradient of current step towards the direction of fast convergence.

Quantization