Learning Rate Schedules
Cosine Power Annealing
Introduced by Hundt et al. in sharpDARTS: Faster and More Accurate Differentiable Architecture SearchInterpolation between exponential decay and cosine annealing.
Source: sharpDARTS: Faster and More Accurate Differentiable Architecture Search
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Image Classification | 4 | 57.14% |
| Face Recognition | 2 | 28.57% |
| Reinforcement Learning (RL) | 1 | 14.29% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
Cosine Annealing
|
Learning Rate Schedules | |
Exponential Decay
|
Learning Rate Schedules |
