no code implementations • ICLR 2018 • Jan Achterhold, Jan Mathias Koehler, Anke Schmeink, Tim Genewein
In this paper, the preparation of a neural network for pruning and few-bit quantization is formulated as a variational inference problem.
no code implementations • 6 May 2024 • Leonhard Hennicke, Christian Medeiros Adriano, Holger Giese, Jan Mathias Koehler, Lukas Schott
Building upon our insights that mainly later layers are responsible for the drop, we investigate the data-efficiency of fine-tuning a synthetically trained model with real data applied to only those last layers.