Q-ViT: Fully Differentiable Quantization for Vision Transformer

no code implementations • 19 Jan 2022 • Zhexin Li, Tong Yang, Peisong Wang, Jian Cheng

In this paper, we propose a fully differentiable quantization method for vision transformer (ViT) named as Q-ViT, in which both of the quantization scales and bit-widths are learnable parameters.

Quantization