Alternating Direction Method of Multipliers

The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are then easier to handle. It takes the form of a decomposition-coordination procedure, in which the solutions to small local subproblems are coordinated to find a solution to a large global problem. ADMM can be viewed as an attempt to blend the benefits of dual decomposition and augmented Lagrangian methods for constrained optimization. It turns out to be equivalent or closely related to many other algorithms as well, such as Douglas-Rachford splitting from numerical analysis, Spingarn’s method of partial inverses, Dykstra’s alternating projections method, Bregman iterative algorithms for l1 problems in signal processing, proximal methods, and many others.

Text Source: https://stanford.edu/~boyd/papers/pdf/admm_distr_stats.pdf

Image Source: here


Paper Code Results Date Stars


Task Papers Share
Denoising 24 10.39%
BIG-bench Machine Learning 15 6.49%
Quantization 13 5.63%
Image Reconstruction 12 5.19%
Image Denoising 11 4.76%
Image Restoration 10 4.33%
Model Compression 10 4.33%
Semantic Segmentation 7 3.03%
Super-Resolution 7 3.03%


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign