Search Results for author: Mahdi Beitollahi

Found 5 papers, 1 papers with code

Does Combining Parameter-efficient Modules Improve Few-shot Transfer Accuracy?

no code implementations23 Feb 2024 Nader Asadi, Mahdi Beitollahi, Yasser Khalil, Yinchuan Li, Guojun Zhang, Xi Chen

Parameter-efficient fine-tuning stands as the standard for efficiently fine-tuning large language and vision models on downstream tasks.

DFML: Decentralized Federated Mutual Learning

no code implementations2 Feb 2024 Yasser H. Khalil, Amir H. Estiri, Mahdi Beitollahi, Nader Asadi, Sobhan Hemati, Xu Li, Guojun Zhang, Xi Chen

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure.

Federated Learning

Parametric Feature Transfer: One-shot Federated Learning with Foundation Models

no code implementations2 Feb 2024 Mahdi Beitollahi, Alex Bie, Sobhan Hemati, Leo Maxime Brunswic, Xu Li, Xi Chen, Guojun Zhang

This paper introduces FedPFT (Federated Learning with Parametric Feature Transfer), a methodology that harnesses the transferability of foundation models to enhance both accuracy and communication efficiency in one-shot FL.

Federated Learning

Cross Domain Generative Augmentation: Domain Generalization with Latent Diffusion Models

no code implementations8 Dec 2023 Sobhan Hemati, Mahdi Beitollahi, Amir Hossein Estiri, Bassel Al Omari, Xi Chen, Guojun Zhang

The VRM reduces the estimation error in ERM by replacing the point-wise kernel estimates with a more precise estimation of true data distribution that reduces the gap between data points \textbf{within each domain}.

Adversarial Robustness Data Augmentation +1

Understanding the Role of Layer Normalization in Label-Skewed Federated Learning

1 code implementation18 Aug 2023 Guojun Zhang, Mahdi Beitollahi, Alex Bie, Xi Chen

In this work, we reveal the profound connection between layer normalization and the label shift problem in federated learning.

Federated Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.