Holistic Capability Preservation: Towards Compact Yet Comprehensive Reasoning Models

no code implementations • 9 Apr 2025 • Ling Team, Caizhi Tang, Chilin Fu, Chunwei Wu, Jia Guo, Jianwen Wang, Jingyu Hu, Liang Jiang, Meng Li, Peng Jiao, Pingping Liu, Shaomian Zheng, Shiwei Liang, Shuaicheng Li, YaLin Zhang, Yingting Wu, Yongkang Liu, Zhenyu Huang

This technical report presents Ring-Lite-Distill, a lightweight reasoning model derived from our open-source Mixture-of-Experts (MoE) Large Language Models (LLMs) Ling-Lite.

Instruction Following Mathematical Problem-Solving +1