Search Results for author:
Found 1 papers, 0 papers with code
MagR: Weight Magnitude Reduction for Enhancing Post-Training Quantization
For example, we achieve a Wikitext2 perplexity of 5. 95 on the LLaMA2-70B model for per-channel INT2 weight quantization without incurring any inference overhead.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
