FedRDMA: Communication-Efficient Cross-Silo Federated LLM via Chunked RDMA Transmission

no code implementations • 1 Mar 2024 • Zeling Zhang, Dongqi Cai, Yiran Zhang, Mengwei Xu, Shangguang Wang, Ao Zhou

Communication overhead is a significant bottleneck in federated learning (FL), which has been exaggerated with the increasing size of AI models.

Federated Learning

Mobile Foundation Model as Firmware

1 code implementation • 28 Aug 2023 • Jinliang Yuan, Chen Yang, Dongqi Cai, Shihe Wang, Xin Yuan, Zeling Zhang, Xiang Li, Dingge Zhang, Hanzi Mei, Xianqing Jia, Shangguang Wang, Mengwei Xu

Concurrently, each app contributes a concise, offline fine-tuned "adapter" tailored to distinct downstream tasks.