Search Results for author:
Found 3 papers, 0 papers with code
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts
However, the gate's routing mechanism also gives rise to narrow vision: the individual MoE's expert fails to use more samples in learning the allocated sub-task, which in turn limits the MoE to further improve its generalization ability.
ALT: An Automatic System for Long Tail Scenario Modeling
In this paper, we consider the problem of long tail scenario modeling with budget limitation, i. e., insufficient human resources for model training stage and limited time and computing resources for model inference stage.
SAFE: Scalable Automatic Feature Engineering Framework for Industrial Tasks
Machine learning techniques have been widely applied in Internet companies for various tasks, acting as an essential driving force, and feature engineering has been generally recognized as a crucial tache when constructing machine learning systems.
