Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward

1 code implementation • 2 Feb 2024 • Arnav Chavan, Raghav Magazine, Shubham Kushwaha, Mérouane Debbah, Deepak Gupta

Despite the impressive performance of LLMs, their widespread adoption faces challenges due to substantial computational and memory requirements during inference.

Model Compression