Alternating Direction Method of Multipliers

The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are then easier to handle. It takes the form of a decomposition-coordination procedure, in which the solutions to small local subproblems are coordinated to find a solution to a large global problem. ADMM can be viewed as an attempt to blend the benefits of dual decomposition and augmented Lagrangian methods for constrained optimization. It turns out to be equivalent or closely related to many other algorithms as well, such as Douglas-Rachford splitting from numerical analysis, Spingarn’s method of partial inverses, Dykstra’s alternating projections method, Bregman iterative algorithms for l1 problems in signal processing, proximal methods, and many others.

Text Source: https://stanford.edu/~boyd/papers/pdf/admm_distr_stats.pdf

Image Source: here


Paper Code Results Date Stars


Task Papers Share
Denoising 27 7.71%
Clustering 16 4.57%
BIG-bench Machine Learning 15 4.29%
Image Reconstruction 14 4.00%
Quantization 14 4.00%
Image Denoising 13 3.71%
Federated Learning 12 3.43%
Image Restoration 11 3.14%
Test 11 3.14%


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign