Shifted and Squeezed 8-bit Floating Point format for Low-Precision Training of Deep Neural Networks

no code implementations • ICLR 2020 • Léopold Cambier, Anahita Bhiwandiwalla, Ting Gong, Mehran Nekuii, Oguz H. Elibol, Hanlin Tang

This necessitates increased memory footprint and computational requirements for training.

Quantization