Non-local Neural Networks

Both convolutional and recurrent operations are building blocks that process one local neighborhood at a time. In this paper, we present non-local operations as a generic family of building blocks for capturing long-range dependencies... (read more)

PDF Abstract CVPR 2018 PDF CVPR 2018 Abstract

Datasets


Results from the Paper


Ranked #8 on Keypoint Detection on COCO (Validation AP metric)

     Get a GitHub badge
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK RESULT BENCHMARK
Keypoint Detection COCO Mask R-CNN + NL blocks (4 in head, 1 in backbone) Validation AP 66.5 # 8
Object Detection COCO minival Mask R-CNN (ResNeXt-152 + 1 NL) box AP 45.0 # 23
AP50 67.8 # 7
AP75 48.9 # 15
Object Detection COCO minival Mask R-CNN (ResNet-101 + 1 NL) box AP 40.8 # 47
AP50 63.1 # 20
AP75 44.5 # 32
Object Detection COCO minival Mask R-CNN (ResNet-50 + 1 NL) box AP 39.0 # 59
AP50 61.1 # 30
AP75 41.9 # 43
Instance Segmentation COCO minival Mask R-CNN (ResNext-152, +1 NL) mask AP 40.3 # 15
Instance Segmentation COCO minival Mask R-CNN (ResNet-101, +1 NL) mask AP 37.1 # 22
Instance Segmentation COCO minival Mask R-CNN (ResNet-50, +1 NL) mask AP 35.5 # 26

Results from Other Papers


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK SOURCE PAPER COMPARE
Action Classification Kinetics-400 I3D + NL Top 1 Accuracy 77.7 # 15
Top 5 Accuracy 93.3 # 7

Methods used in the Paper


METHOD TYPE
Average Pooling
Pooling Operations
ResNeXt Block
Skip Connection Blocks
Concatenation Affinity
Affinity Functions
Embedded Dot Product Affinity
Affinity Functions
Embedded Gaussian Affinity
Affinity Functions
Non-Local Block
Image Model Blocks
Non-Local Operation
Image Feature Extractors
Weight Decay
Regularization
SGD with Momentum
Stochastic Optimization
Grouped Convolution
Convolutions
Bottleneck Residual Block
Skip Connection Blocks
Global Average Pooling
Pooling Operations
Residual Block
Skip Connection Blocks
Residual Connection
Skip Connections
ReLU
Activation Functions
Kaiming Initialization
Initialization
Max Pooling
Pooling Operations
1x1 Convolution
Convolutions
Convolution
Convolutions
Batch Normalization
Normalization
ResNet
Convolutional Neural Networks
ResNeXt
Convolutional Neural Networks