Optimization
Sharpness-Aware Minimization
Introduced by Foret et al. in Sharpness-Aware Minimization for Efficiently Improving GeneralizationSharpness-Aware Minimization, or SAM, is a procedure that improves model generalization by simultaneously minimizing loss value and loss sharpness. SAM functions by seeking parameters that lie in neighborhoods having uniformly low loss value (rather than parameters that only themselves have low loss value).
Source: Sharpness-Aware Minimization for Efficiently Improving Generalization
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Image Classification | 18 | 12.77% |
| Domain Generalization | 9 | 6.38% |
| Federated Learning | 7 | 4.96% |
| Semantic Segmentation | 5 | 3.55% |
| Deep Learning | 4 | 2.84% |
| parameter-efficient fine-tuning | 3 | 2.13% |
| Image Segmentation | 3 | 2.13% |
| Quantization | 3 | 2.13% |
| Long-tail Learning | 3 | 2.13% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
