Search Results for author:
Found 2 papers, 2 papers with code
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
To maximize LLMs' serving throughput, we introduce Atom, a low-bit quantization method that achieves high throughput improvements with negligible accuracy loss.
HASCO: Towards Agile HArdware and Software CO-design for Tensor Computation
Second, the overall design space composed of HW/SW partitioning, hardware optimization, and software optimization is huge.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
