Search Results for author:
Found 1 papers, 0 papers with code
COMET: Towards Partical W4A4KV4 LLMs Serving
We integrate the optimized W4Ax kernel into our inference framework, COMET, and provide efficient management to support popular LLMs such as LLaMA-3-70B.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
