Search Results for author:
Found 1 papers, 0 papers with code
SwapMoE: Efficient Memory-Constrained Serving of Large Sparse MoE Models via Dynamic Expert Pruning and Swapping
The main idea of SwapMoE is to keep a small dynamic set of important experts, namely Virtual Experts, in the main memory for inference, while seamlessly maintaining how the Virtual Experts map to the actual experts.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
