A Survey on Inference Engines for Large Language Models: Perspectives on Optimization and Efficiency

1 code implementation • 3 May 2025 • Sihyeong Park, Sungryeol Jeon, Chaelyn Lee, Seokhun Jeon, Byung-soo Kim, Jemin Lee

This paper provides a comprehensive evaluation of 25 open-source and commercial inference engines.