Search Results for author:
Found 1 papers, 0 papers with code
MoNDE: Mixture of Near-Data Experts for Large-Scale Sparse Models
Mixture-of-Experts (MoE) large language models (LLM) have memory requirements that often exceed the GPU memory capacity, requiring costly parameter movement from secondary memories to the GPU for expert computation.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
