no code implementations • 26 Sep 2024 • Saber Malekmohammadi, Golnoosh Farnadi
We show theoretically that the low-rank adaptation used in LoRA and FLoRA is equivalent to injecting some random noise into the batch gradients w. r. t the adapter parameters, and we quantify the variance of the injected noise.
no code implementations • 23 Jun 2024 • Saber Malekmohammadi
VRed encourages equality between clients' loss functions by penalizing their variance.
1 code implementation • 5 Jun 2024 • Saber Malekmohammadi, YaoLiang Yu, Yang Cao
Furthermore, there is often heterogeneity in batch and/or dataset size of clients, which as shown, results in extra variation in the DP noise level across clients model updates.
no code implementations • 29 May 2024 • Saber Malekmohammadi, Afaf Taik, Golnoosh Farnadi
To address this gap, we propose an algorithm for differentially private clustered FL, which is robust to the DP noise in the system and identifies the underlying clients' clusters correctly.
1 code implementation • 3 Feb 2022 • Guojun Zhang, Saber Malekmohammadi, Xi Chen, YaoLiang Yu
With the increasingly broad deployment of federated learning (FL) systems in the real world, it is critical but challenging to ensure fairness in FL, i. e. reasonably satisfactory performances for each of the numerous diverse clients.
no code implementations • 12 Aug 2021 • Saber Malekmohammadi, Kiarash Shaloudegi, Zeou Hu, YaoLiang Yu
Over the past few years, the federated learning ($\texttt{FL}$) community has witnessed a proliferation of new $\texttt{FL}$ algorithms.
no code implementations • 14 Dec 2020 • Amir Rasouli, Tiffany Yau, Peter Lakner, Saber Malekmohammadi, Mohsen Rohani, Jun Luo
To this end, we propose a new pedestrian action prediction dataset created by adding per-frame 2D/3D bounding box and behavioral annotations to the popular autonomous driving dataset, nuScenes.
no code implementations • 3 Dec 2020 • Tiffany Yau, Saber Malekmohammadi, Amir Rasouli, Peter Lakner, Mohsen Rohani, Jun Luo
2) We introduce a new dataset that provides 3D bounding box and pedestrian behavioural annotations for the existing nuScenes dataset.
no code implementations • 23 Jun 2020 • Soumyasundar Pal, Saber Malekmohammadi, Florence Regol, Yingxue Zhang, Yishi Xu, Mark Coates
A Bayesian framework which targets posterior inference of the graph by considering it as a random quantity can be beneficial.