Normalization
Instance Normalization
Introduced by Ulyanov et al. in Instance Normalization: The Missing Ingredient for Fast StylizationInstance Normalization (also known as contrast normalization) is a normalization layer where:
$$ y_{tijk} = \frac{x_{tijk} - \mu_{ti}}{\sqrt{\sigma_{ti}^2 + \epsilon}}, \quad \mu_{ti} = \frac{1}{HW}\sum_{l=1}^W \sum_{m=1}^H x_{tilm}, \quad \sigma_{ti}^2 = \frac{1}{HW}\sum_{l=1}^W \sum_{m=1}^H (x_{tilm} - \mu_{ti})^2. $$
This prevents instance-specific mean and covariance shift simplifying the learning process. Intuitively, the normalization process allows to remove instance-specific contrast information from the content image in a task like image stylization, which simplifies generation.
Source: Instance Normalization: The Missing Ingredient for Fast Stylization
Papers
| Paper | Code | Results | Date | Stars |
|---|
Tasks
| Task | Papers | Share |
|---|---|---|
| Translation | 101 | 9.70% |
| Image-to-Image Translation | 88 | 8.45% |
| Style Transfer | 52 | 5.00% |
| Image Generation | 51 | 4.90% |
| Semantic Segmentation | 49 | 4.71% |
| Domain Adaptation | 45 | 4.32% |
| Object Detection | 24 | 2.31% |
| Unsupervised Domain Adaptation | 21 | 2.02% |
| Domain Generalization | 21 | 2.02% |
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
