Attention Mechanisms
Gather-Excite Networks
Introduced by Hu et al. in Gather-Excite: Exploiting Feature Context in Convolutional Neural NetworksGENet combines part gathering and excitation operations. In the first step, it aggregates input features over large neighborhoods and models the relationship between different spatial locations. In the second step, it first generates an attention map of the same size as the input feature map, using interpolation. Then each position in the input feature map is scaled by multiplying by the corresponding element in the attention map.
Source: Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks
Papers
| Paper | Code | Results | Date | Stars |
|---|
Usage Over Time
Components
| Component | Type |
|
|---|---|---|
| 🤖 No Components Found | You can add them if they exist; e.g. Mask R-CNN uses RoIAlign |
