Search Results for author: Mingjie Tang

Found 7 papers, 5 papers with code

Couler: Unified Machine Learning Workflow Optimization in Cloud

1 code implementation12 Mar 2024 Xiaoda Wang, Yuan Tang, Tengda Guo, Bo Sang, Jingji Wu, Jian Sha, Ke Zhang, Jiang Qian, Mingjie Tang

This variety poses a challenge for end-users in terms of mastering different engine APIs.

ASPEN: High-Throughput LoRA Fine-Tuning of Large Language Models with a Single GPU

1 code implementation5 Dec 2023 Zhengmao Ye, Dengchun Li, Jingqi Tian, Tingfeng Lan, Jie Zuo, Lei Duan, Hui Lu, Yexi Jiang, Jian Sha, Ke Zhang, Mingjie Tang

Transformer-based large language models (LLMs) have demonstrated outstanding performance across diverse domains, particularly when fine-turned for specific domains.

Large Language Model Scheduling

DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud

no code implementations4 Apr 2023 Qinlong Wang, Tingfeng Lan, Yinghao Tang, Ziling Huang, Yiheng Du, HaiTao Zhang, Jian Sha, Hui Lu, Yuanchun Zhou, Ke Zhang, Mingjie Tang

To overcome them, we introduce DLRover-RM, an elastic training framework for DLRMs designed to increase resource utilization and handle the instability of a cloud environment.

Scheduling

Cannot find the paper you are looking for? You can Submit a new open access paper.