Non-Local Block

Introduced by Wang et al. in Non-local Neural Networks

A Non-Local Block is an image block module used in neural networks that wraps a non-local operation. We can define a non-local block as:

$$ \mathbb{z}_{i} = W_{z}\mathbb{y_{i}} + \mathbb{x}_{i} $$

where $y_{i}$ is the output from the non-local operation and $+ \mathbb{x}_{i}$ is a residual connection.

Source: Non-local Neural Networks

Read Paper See Code

Paper	Code	Results	Date	Stars

Task	Papers	Share
Image Generation	26	17.57%
Conditional Image Generation	13	8.78%
Object Detection	9	6.08%
Instance Segmentation	8	5.41%
Semantic Segmentation	8	5.41%
Super-Resolution	5	3.38%
Image Classification	4	2.70%
Action Recognition	4	2.70%
Denoising	3	2.03%

This feature is experimental; we are continuously improving our matching algorithm.

Component	Type	Add Remove
1x1 Convolution	Convolutions
Concatenation Affinity	Affinity Functions	(optional)
Embedded Dot Product Affinity	Affinity Functions	(optional)
Embedded Gaussian Affinity	Affinity Functions	(optional)
Gaussian Affinity	Affinity Functions	(optional)
Non-Local Operation	Image Feature Extractors
Residual Connection	Skip Connections