Search Results for author:
Found 2 papers, 1 papers with code
Towards MoE Deployment: Mitigating Inefficiencies in Mixture-of-Expert (MoE) Inference
We propose three optimization techniques to mitigate sources of inefficiencies, namely (1) Dynamic gating, (2) Expert Buffering, and (3) Expert load balancing.
OPT: Open Pre-trained Transformer Language Models
Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning.
Ranked #2 on
Stereotypical Bias Analysis
on CrowS-Pairs
Cannot find the paper you are looking for? You can
Submit a new open access paper.
