Search Results for author:
Found 4 papers, 3 papers with code
A Closer Look into Mixture-of-Experts in Large Language Models
Mixture-of-experts (MoE) is gaining increasing attention due to its unique properties and remarkable performance, especially for language tasks.
MuPT: A Generative Symbolic Music Pretrained Transformer
In this paper, we explore the application of Large Language Models (LLMs) to the pre-training of music.
m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
Additionally, the V-MoE-Base model trained with m2mKD achieves 3. 5% higher accuracy than end-to-end training on ImageNet-1k.
Optical Flow Based Motion Detection for Autonomous Driving
Motion detection is a fundamental but challenging task for autonomous driving.
Ranked #1 on
Motion Detection
on nuScenes
Cannot find the paper you are looking for? You can
Submit a new open access paper.
