no code implementations • 3 Mar 2024 • Yu Mao, Weilan Wang, Hongchao Du, Nan Guan, Chun Jason Xue
Deploying Large Language Models (LLMs) on edge or mobile devices offers significant benefits, such as enhanced data privacy and real-time processing capabilities.