Search Results for author:
Found 1 papers, 0 papers with code
LocMoE: A Low-overhead MoE for Large Language Model Training
However, the performance of MoE is limited by load imbalance and high latency of All-To-All communication, along with relatively redundant computation owing to large expert capacity.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
