Search Results for author: Yaozong Wu

Found 4 papers, 3 papers with code

FwdLLM: Efficient FedLLM using Forward Gradient

1 code implementation26 Aug 2023 Mengwei Xu, Dongqi Cai, Yaozong Wu, Xiang Li, Shangguang Wang

Federated Learning (FL), a method to preserve user data privacy, is often employed in fine-tuning LLMs to downstream mobile tasks, an approach known as FedLLM.

Federated Learning

Federated Few-Shot Learning for Mobile NLP

1 code implementation12 Dec 2022 Dongqi Cai, Shangguang Wang, Yaozong Wu, Felix Xiaozhu Lin, Mengwei Xu

Such an inadequacy of data labels is known as a few-shot scenario; it becomes the key blocker for mobile NLP applications.

Few-Shot Learning Privacy Preserving

Towards Practical Few-shot Federated NLP

no code implementations1 Dec 2022 Dongqi Cai, Yaozong Wu, Haitao Yuan, Shangguang Wang, Felix Xiaozhu Lin, Mengwei Xu

To address these challenges, we first introduce a data generator for federated few-shot learning tasks, which encompasses the quantity and skewness of scarce labeled data in a realistic setting.

Data Augmentation Federated Learning +1

FedAdapter: Efficient Federated Learning for Modern NLP

1 code implementation20 May 2022 Dongqi Cai, Yaozong Wu, Shangguang Wang, Felix Xiaozhu Lin, Mengwei Xu

A key challenge is to properly configure the depth and width of adapters, to which the training speed and efficiency is highly sensitive.

Federated Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.