Search Results for author: Zhiqian Li

Found 1 papers, 1 papers with code

OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models

2 code implementations25 Aug 2023 Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, Peng Xu, Lirui Zhao, Zhiqian Li, Kaipeng Zhang, Peng Gao, Yu Qiao, Ping Luo

To tackle this issue, we introduce an Omnidirectionally calibrated Quantization (OmniQuant) technique for LLMs, which achieves good performance in diverse quantization settings while maintaining the computational efficiency of PTQ by efficiently optimizing various quantization parameters.

Common Sense Reasoning Computational Efficiency +3

Cannot find the paper you are looking for? You can Submit a new open access paper.