Methods > Computer Vision > Image Model Blocks

Non-Local Block

Introduced by Wang et al. in Non-local Neural Networks
 
Edit

A Non-Local Block is an image block module used in neural networks that wraps a non-local operation. We can define a non-local block as:

$$ \mathbb{z}_{i} = W_{z}\mathbb{y_{i}} + \mathbb{x}_{i} $$

where $y_{i}$ is the output from the non-local operation and $+ \mathbb{x}_{i}$ is a residual connection.

Source: Non-local Neural Networks
Paper Code Snippet

Latest Papers

PAPER DATE
Conditioning Trick for Training Stable GANs
Mohammad Esmaeilpour • Raymel Alfonso Sallo • Olivier St-Georges • Patrick Cardinal • Alessandro Lameiras Koerich
2020-10-12
SMYRF: Efficient Attention using Asymmetric Clustering
| Giannis Daras • Nikita Kitaev • Augustus Odena • Alexandros G. Dimakis
2020-10-11
LOGAN: Local Group Bias Detection by Clustering
Jieyu Zhao • Kai-Wei Chang
2020-10-06
TinyGAN: Distilling BigGAN for Conditional Image Generation
Ting-Yun Chang • Chi-Jen Lu
2020-09-29
MARA-Net: Single Image Deraining Network with Multi-level connection and Adaptive Regional Attention
Yeachan Park • Myeongho Jeon • Junho Lee • Myungjoo Kan
2020-09-29
not-so-BigGAN: Generating High-Fidelity Images on a Small Compute Budget
Seungwook Han • Akash Srivastava • Cole Hurwitz • Prasanna Sattigeri • David D. Cox
2020-09-09
Neural Crossbreed: Neural Based Image Metamorphosis
Sanghun Park • Kwanggyoon Seo • Junyong Noh
2020-09-02
PNEN: Pyramid Non-Local Enhanced Networks
Feida Zhu • Chaowei Fang • Kai-Kuang Ma
2020-08-22
DeepGIN: Deep Generative Inpainting Network for Extreme Image Inpainting
| Chu-Tak Li • Wan-Chi Siu • Zhi-Song Liu • Li-Wen Wang • Daniel Pak-Kong Lun
2020-08-17
Instance Selection for GANs
Terrance DeVries • Michal Drozdzal • Graham W. Taylor
2020-07-30
Interpolating GANs to Scaffold Autotelic Creativity
Ziv Epstein • Océane Boulais • Skylar Gordon • Matt Groh
2020-07-21
Differentiable Augmentation for Data-Efficient GAN Training
| Shengyu Zhao • Zhijian Liu • Ji Lin • Jun-Yan Zhu • Song Han
# 3 IMAGE GENERATION ON CIFAR-10
2020-06-18
Disentangled Non-Local Neural Networks
Minghao Yin • Zhuliang Yao • Yue Cao • Xiu Li • Zheng Zhang • Stephen Lin • Han Hu
2020-06-11
Training Generative Adversarial Networks with Limited Data
| Tero Karras • Miika Aittala • Janne Hellsten • Samuli Laine • Jaakko Lehtinen • Timo Aila
2020-06-11
PNL: Efficient Long-Range Dependencies Extraction with Pyramid Non-Local Module for Action Recognition
Yuecong Xu • Haozhi Cao • Jianfei Yang • Kezhi Mao • Jianxiong Yin • Simon See
2020-06-09
Learning disconnected manifolds: a no GANs land
Ugo Tanielian • Thibaut Issenhuth • Elvis Dohmatob • Jeremie Mary
2020-06-08
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
| Andrey Voynov • Stanislav Morozov • Artem Babenko
2020-06-08
TESA: Tensor Element Self-Attention via Matricization
Francesca Babiloni • Ioannis Marras • Gregory Slabaugh • Stefanos Zafeiriou
2020-06-01
A U-Net Based Discriminator for Generative Adversarial Networks
Edgar Schonfeld • Bernt Schiele • Anna Khoreva
2020-06-01
Network Fusion for Content Creation with Conditional INNs
Robin Rombach • Patrick Esser • Björn Ommer
2020-05-27
Correlating Edge, Pose with Parsing
| Ziwei Zhang • Chi Su • Liang Zheng • Xiaodong Xie
2020-05-04
LRTD: Long-Range Temporal Dependency based Active Learning for Surgical Workflow Recognition
| Xueying Shi • Yueming Jin • Qi Dou • Pheng-Ann Heng
2020-04-21
GANSpace: Discovering Interpretable GAN Controls
| Erik Härkönen • Aaron Hertzmann • Jaakko Lehtinen • Sylvain Paris
2020-04-06
Evolving Normalization-Activation Layers
| Hanxiao Liu • Andrew Brock • Karen Simonyan • Quoc V. Le
2020-04-06
Feature Quantization Improves GAN Training
| Yang Zhao • Chunyuan Li • Ping Yu • Jianfeng Gao • Changyou Chen
# 1 CONDITIONAL IMAGE GENERATION ON CIFAR-100
2020-04-05
BigGAN-based Bayesian reconstruction of natural images from human brain activity
Kai Qiao • Jian Chen • Linyuan Wang • Chi Zhang • Li Tong • Bin Yan
2020-03-13
PBRnet: Pyramidal Bounding Box Refinement to Improve Object Localization Accuracy
Li Xiao • Yufan Luo • Chunlong Luo • Lianhe Zhao • Quanshui Fu • Guoqing Yang • Anpeng Huang • Yi Zhao
2020-03-10
A U-Net Based Discriminator for Generative Adversarial Networks
| Edgar Schönfeld • Bernt Schiele • Anna Khoreva
2020-02-28
Improved Consistency Regularization for GANs
Zhengli Zhao • Sameer Singh • Honglak Lee • Zizhao Zhang • Augustus Odena • Han Zhang
2020-02-11
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN
Milad Mozafari • Leila Reddy • Rufin VanRullen
2020-01-31
Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixtures
Mohamed El Amine Seddik • Cosme Louart • Mohamed Tamaazousti • Romain Couillet
2020-01-21
CNN-generated images are surprisingly easy to spot... for now
| Sheng-Yu Wang • Oliver Wang • Richard Zhang • Andrew Owens • Alexei A. Efros
2019-12-23
LOGAN: Latent Optimisation for Generative Adversarial Networks
| Yan Wu • Jeff Donahue • David Balduzzi • Karen Simonyan • Timothy Lillicrap
# 1 CONDITIONAL IMAGE GENERATION ON IMAGENET 128X128
2019-12-02
Detecting GAN generated errors
Xiru Zhu • Fengdi Che • Tianzi Yang • Tzuyang Yu • David Meger • Gregory Dudek
2019-12-02
Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
| Ceyuan Yang • Yujun Shen • Bolei Zhou
2019-11-21
Improving sample diversity of a pre-trained, class-conditional GAN by changing its class embeddings
| Qi Li • Long Mai • Michael A. Alcorn • Anh Nguyen
2019-10-10
Asymmetric Non-local Neural Networks for Semantic Segmentation
| Zhen Zhu • Mengde Xu • Song Bai • Tengteng Huang • Xiang Bai
# 5 SEMANTIC SEGMENTATION ON COCO-STUFF TEST
2019-08-21
Adversarial Video Generation on Complex Datasets
Aidan Clark • Jeff Donahue • Karen Simonyan
# 1 VIDEO GENERATION ON KINETICS-600 12 FRAMES, 128X128
2019-07-15
Large Scale Adversarial Representation Learning
| Jeff Donahue • Karen Simonyan
# 19 SEMI-SUPERVISED IMAGE CLASSIFICATION ON IMAGENET - 1% LABELED DATA
2019-07-04
6D-VNet: End-to-end 6DoF Vehicle Pose Estimation from Monocular RGB Images
| Di Wu • Zhaoyong Zhuang • Canqun Xiang • Wenbin Zou and Xia Li
2019-06-15
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond
| Yue Cao • Jiarui Xu • Stephen Lin • Fangyun Wei • Han Hu
# 7 INSTANCE SEGMENTATION ON COCO TEST-DEV
2019-04-25
Lung Nodule Classification using Deep Local-Global Networks
| Mundher Al-Shabi • Boon Leong Lan • Wai Yee Chan • Kwan-Hoong Ng • Maxine Tan
# 1 LUNG NODULE CLASSIFICATION ON LIDC-IDRI
2019-04-23
Improved Precision and Recall Metric for Assessing Generative Models
| Tuomas Kynkäänniemi • Tero Karras • Samuli Laine • Jaakko Lehtinen • Timo Aila
# 3 IMAGE GENERATION ON FFHQ
2019-04-15
Libra R-CNN: Towards Balanced Learning for Object Detection
| Jiangmiao Pang • Kai Chen • Jianping Shi • Huajun Feng • Wanli Ouyang • Dahua Lin
# 39 OBJECT DETECTION ON COCO TEST-DEV
2019-04-04
Spatial-Aware Non-Local Attention for Fashion Landmark Detection
Yixin Li • Shengqin Tang • Yun Ye • Jinwen Ma
2019-03-11
High-Fidelity Image Generation With Fewer Labels
| Mario Lucic • Michael Tschannen • Marvin Ritter • Xiaohua Zhai • Olivier Bachem • Sylvain Gelly
# 4 CONDITIONAL IMAGE GENERATION ON IMAGENET 128X128
2019-03-06
CCNet: Criss-Cross Attention for Semantic Segmentation
| Zilong Huang • Xinggang Wang • Yunchao Wei • Lichao Huang • Humphrey Shi • Wenyu Liu • Thomas S. Huang
# 21 SEMANTIC SEGMENTATION ON CITYSCAPES TEST
2018-11-28
Metropolis-Hastings view on variational inference and adversarial training
Kirill Neklyudov • Evgenii Egorov • Pavel Shvechikov • Dmitry Vetrov
2018-10-16
Large Scale GAN Training for High Fidelity Natural Image Synthesis
| Andrew Brock • Jeff Donahue • Karen Simonyan
# 1 IMAGE GENERATION ON IMAGENET 128X128
2018-09-28
Video-based Person Re-identification via 3D Convolutional Networks and Non-local Attention
Xingyu Liao • Lingxiao He • Zhouwang Yang • Chi Zhang
2018-07-12
Non-local Neural Networks
| Xiaolong Wang • Ross Girshick • Abhinav Gupta • Kaiming He
# 7 KEYPOINT DETECTION ON COCO
2017-11-21

Categories
Add Remove

Contact us on: [email protected]. Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Privacy Cookies policy