Search Results for author: Peter Davies

Found 3 papers, 1 papers with code

New Bounds For Distributed Mean Estimation and Variance Reduction

no code implementations ICLR 2021 Peter Davies, Vijaykrishna Gurunathan, Niusha Moshrefi, Saleh Ashkboos, Dan Alistarh

We provide a method of quantization which allows distributed mean estimation to be performed with solution quality dependent only on the distance between inputs, not on input norm, and show an analogous result for distributed variance reduction.

Distributed Optimization Quantization

Asynchronous Decentralized SGD with Quantized and Local Updates

no code implementations NeurIPS 2021 Giorgi Nadiradze, Amirmojtaba Sabour, Peter Davies, Shigang Li, Dan Alistarh

Perhaps surprisingly, we show that a variant of SGD called \emph{SwarmSGD} still converges in this setting, even if \emph{non-blocking communication}, \emph{quantization}, and \emph{local steps} are all applied \emph{in conjunction}, and even if the node data distributions and underlying graph topology are both \emph{heterogenous}.

Blocking Distributed Optimization +2

SPONGE: A generalized eigenproblem for clustering signed networks

1 code implementation18 Apr 2019 Mihai Cucuringu, Peter Davies, Aldo Glielmo, Hemant Tyagi

We introduce a principled and theoretically sound spectral method for $k$-way clustering in signed graphs, where the affinity measure between nodes takes either positive or negative values.

Constrained Clustering Stochastic Block Model

Cannot find the paper you are looking for? You can Submit a new open access paper.