no code implementations • 15 Jan 2021 • Jing Jin, Cai Liang, Tiancheng Wu, Liqin Zou, Zhiliang Gan
The main idea of our method is that the KD technique is leveraged to transfer the knowledge from a "teacher" model to a "student" model when exploiting LSQ to quantize that "student" model during the quantization training process.