Search Results for author: S. Jamaloddin Golestani

Found 7 papers, 2 papers with code

Order Optimal Bounds for One-Shot Federated Learning over non-Convex Loss Functions

no code implementations19 Aug 2021 Arsalan SharifNassab, Saber Salehkaleybar, S. Jamaloddin Golestani

We then prove that this lower bound is order optimal in $m$ and $n$ by presenting a distributed learning algorithm, called Multi-Resolution Estimator for Non-Convex loss function (MRE-NC), whose expected loss matches the lower bound for large $mn$ up to polylogarithmic factors.

Federated Learning

Distributed Fair Scheduling for Information Exchange in Multi-Agent Systems

no code implementations17 Feb 2021 Majid Raeis, S. Jamaloddin Golestani

Moreover, our scheduling algorithm adjusts itself dynamically to achieve a high throughput at the same time.

Fairness Multiagent Systems Networking and Internet Architecture Performance

Bounds on Over-Parameterization for Guaranteed Existence of Descent Paths in Shallow ReLU Networks

no code implementations ICLR 2020 Arsalan Sharifnassab, Saber Salehkaleybar, S. Jamaloddin Golestani

We show that there exist poor local minima with positive curvature for some training sets of size $n\geq m+2d-2$.

Order Optimal One-Shot Distributed Learning

1 code implementation NeurIPS 2019 Arsalan Sharifnassab, Saber Salehkaleybar, S. Jamaloddin Golestani

We propose an algorithm called Multi-Resolution Estimator (MRE) whose expected error is no larger than $\tilde{O}\big(m^{-{1}/{\max(d, 2)}} n^{-1/2}\big)$, where $d$ is the dimension of the parameter space.

One-Shot Federated Learning: Theoretical Limits and Algorithms to Achieve Them

1 code implementation12 May 2019 Saber Salehkaleybar, Arsalan Sharif-Nassab, S. Jamaloddin Golestani

We investigate the impact of communication constraint, $B$, on the expected error and derive a tight lower bound on the error achievable by any algorithm.

Federated Learning

Distributed Voting/Ranking with Optimal Number of States per Node

no code implementations26 Mar 2017 Saber Salehkaleybar, Arsalan Sharif-Nassab, S. Jamaloddin Golestani

Considering a network with $n$ nodes, where each node initially votes for one (or more) choices out of $K$ possible choices, we present a Distributed Multi-choice Voting/Ranking (DMVR) algorithm to determine either the choice with maximum vote (the voting problem) or to rank all the choices in terms of their acquired votes (the ranking problem).

Distributed Voting

Token-based Function Computation with Memory

no code implementations26 Mar 2017 Saber Salehkaleybar, S. Jamaloddin Golestani

In this paper, we propose a novel token-based approach to compute a wide class of target functions to which we refer as "Token-based function Computation with Memory" (TCM) algorithm.

Cannot find the paper you are looking for? You can Submit a new open access paper.