Search Results for author:
Found 1 papers, 0 papers with code
LLM in a flash: Efficient Large Language Model Inference with Limited Memory
These methods collectively enable running models up to twice the size of the available DRAM, with a 4-5x and 20-25x increase in inference speed compared to naive loading approaches in CPU and GPU, respectively.
Ranked #67 on
Sentence Completion
on HellaSwag
Cannot find the paper you are looking for? You can
Submit a new open access paper.
