Regularization
DropPath
Introduced by Larsson et al. in FractalNet: Ultra-Deep Neural Networks without ResidualsJust as dropout prevents co-adaptation of activations, DropPath prevents co-adaptation of parallel paths in networks such as FractalNets by randomly dropping operands of the join layers. This discourages the network from using one input path as an anchor and another as a corrective term (a configuration that, if not prevented, is prone to overfitting). Two sampling strategies are:
- Local: a join drops each input with fixed probability, but we make sure at least one survives.
- Global: a single path is selected for the entire network. We restrict this path to be a single column, thereby promoting individual columns as independently strong predictors.
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Image Classification | 6 | 20.00% |
| Classification | 2 | 6.67% |
| Object Detection | 2 | 6.67% |
| Self-Supervised Learning | 2 | 6.67% |
| Federated Learning | 2 | 6.67% |
| Reinforcement Learning | 2 | 6.67% |
| Reinforcement Learning (RL) | 2 | 6.67% |
| ECG Classification | 1 | 3.33% |
| Time Series Analysis | 1 | 3.33% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
