Search Results for author:
Found 1 papers, 0 papers with code
Seesaw: High-throughput LLM Inference via Model Re-sharding
To improve the efficiency of distributed large language model (LLM) inference, various parallelization strategies, such as tensor and pipeline parallelism, have been proposed.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
