Search Results for author: Rongjie Yi

Found 7 papers, 5 papers with code

DroidCall: A Dataset for LLM-powered Android Intent Invocation

1 code implementation30 Nov 2024 Weikai Xie, Li Zhang, Shihe Wang, Rongjie Yi, Mengwei Xu

Given a task instruction in natural language, small language models such as Qwen2. 5-3B and Gemma2-2B fine-tuned with DroidCall can approach or even surpass the capabilities of GPT-4o for accurate Android intent invocation.

Natural Language Understanding

Small Language Models: Survey, Measurements, and Insights

1 code implementation24 Sep 2024 Zhenyan Lu, Xiang Li, Dongqi Cai, Rongjie Yi, Fangming Liu, Xiwen Zhang, Nicholas D. Lane, Mengwei Xu

Small language models (SLMs), despite their widespread adoption in modern smart devices, have received significantly less academic attention compared to their large language model (LLM) counterparts, which are predominantly deployed in data centers and cloud environments.

Benchmarking Decoder +5

ELMS: Elasticized Large Language Models On Mobile Devices

no code implementations8 Sep 2024 Wangsong Yin, Rongjie Yi, Daliang Xu, Gang Huang, Mengwei Xu, Xuanzhe Liu

To address this issue, we introduce ELMS, an on-device LLM service designed to provide elasticity in both the model and prompt dimensions of an LLMaaS.

Language Modelling

A Survey of Resource-efficient LLM and Multimodal Foundation Models

1 code implementation16 Jan 2024 Mengwei Xu, Wangsong Yin, Dongqi Cai, Rongjie Yi, Daliang Xu, QiPeng Wang, Bingyang Wu, Yihao Zhao, Chen Yang, Shihe Wang, Qiyang Zhang, Zhenyan Lu, Li Zhang, Shangguang Wang, Yuanchun Li, Yunxin Liu, Xin Jin, Xuanzhe Liu

Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment.

Survey

EdgeMoE: Fast On-Device Inference of MoE-based Large Language Models

no code implementations28 Aug 2023 Rongjie Yi, Liwei Guo, Shiyun Wei, Ao Zhou, Shangguang Wang, Mengwei Xu

Large Language Models (LLMs) such as GPTs and LLaMa have ushered in a revolution in machine intelligence, owing to their exceptional capabilities in a wide range of machine learning tasks.

Computational Efficiency

Cannot find the paper you are looking for? You can Submit a new open access paper.