1 code implementation • 19 Nov 2023 • Shangchao Su, Bin Li, xiangyang xue
The implementation of FedRA is straightforward and can be seamlessly integrated into any transformer-based model without the need for further modification to the original model.
no code implementations • 15 Nov 2023 • Mingzhao Yang, Shangchao Su, Bin Li, xiangyang xue
Leveraging the extensive knowledge stored in the pre-trained diffusion model, the synthetic datasets can assist us in surpassing the knowledge limitations of the client samples, resulting in aggregation models that even outperform the performance ceiling of centralized training in some cases, which is convincingly demonstrated in the sufficient quantification and visualization experiments conducted on three large-scale multi-domain image datasets.
no code implementations • 9 May 2023 • Shangchao Su, Haiyang Yu, Bin Li, xiangyang xue
In Chinese text recognition, to compensate for the insufficient local data and improve the performance of local few-shot character recognition, it is often necessary for one organization to collect a large amount of data from similar organizations.
no code implementations • 6 May 2023 • Mingzhao Yang, Shangchao Su, Bin Li, xiangyang xue
Specifically, we first extract prototypes from the labeled data on the server and send them to the clients.
1 code implementation • 15 Nov 2022 • Shangchao Su, Mingzhao Yang, Bin Li, xiangyang xue
In this paper, we propose a federated adaptive prompt tuning algorithm, FedAPT, for multi-domain collaborative image classification with powerful foundation models, like CLIP.
no code implementations • 4 Oct 2022 • Shangchao Su, Bin Li, xiangyang xue
In this paper, we first analyze the generalization bound of the aggregation model produced from knowledge distillation for the client domains, and then describe two challenges, server-to-client discrepancy and client-to-client discrepancy, brought to the aggregation model by the domain discrepancies.
no code implementations • 30 Jun 2022 • Shangchao Su, Bin Li, Chengzhi Zhang, Mingzhao Yang, xiangyang xue
Federated learning can enable multi-party collaborative learning without leaking client data.
1 code implementation • 26 Apr 2022 • Shangchao Su, Bin Li, xiangyang xue
Federated Learning (FL) has recently made significant progress as a new machine learning paradigm for privacy protection.