Methods > Computer Vision > Image Model Blocks

Non-Local Block

Introduced by Wang et al. in Non-local Neural Networks

A Non-Local Block is an image block module used in neural networks that wraps a non-local operation. We can define a non-local block as:

$$ \mathbb{z}_{i} = W_{z}\mathbb{y_{i}} + \mathbb{x}_{i} $$

where $y_{i}$ is the output from the non-local operation and $+ \mathbb{x}_{i}$ is a residual connection.

Source: Non-local Neural Networks

Latest Papers

PAPER DATE
Efficient Subsampling for Generating High-Quality Images from Conditional Generative Adversarial Networks
| Xin DingYongwei WangZ. Jane WangWilliam J. Welch
2021-03-20
Understanding invariance via feedforward inversion of discriminatively trained classifiers
Piotr TeterwakChiyuan ZhangDilip KrishnanMichael C. Mozer
2021-03-15
Ultra-Data-Efficient GAN Training: Drawing A Lottery Ticket First, Then Training It Toughly
| Tianlong ChenYu ChengZhe GanJingjing LiuZhangyang Wang
2021-02-28
Complex Momentum for Learning in Games
Jonathan LorraineDavid AcunaPaul VicolDavid Duvenaud
2021-02-16
Generating images from caption and vice versa via CLIP-Guided Generative Latent Space Search
| Federico A. GalatoloMario G. C. A. CiminoGigliola Vaglini
2021-02-02
GAN Inversion: A Survey
| Weihao XiaYulun ZhangYujiu YangJing-Hao XueBolei ZhouMing-Hsuan Yang
2021-01-14
not-so-big-GAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution
Anonymous
2021-01-01
Global Context Networks
| Yue CaoJiarui XuStephen LinFangyun WeiHan Hu
2020-12-24
SMYRF - Efficient Attention using Asymmetric Clustering
| Giannis DarasNikita KitaevAugustus OdenaAlexandros G. Dimakis
2020-12-01
Omni-GAN: On the Secrets of cGANs and Beyond
| Peng ZhouLingxi XieBingbing NiCong GengQi Tian
2020-11-26
CVEGAN: A Perceptually-inspired GAN for Compressed Video Enhancement
Di MaFan ZhangDavid R. Bull
2020-11-18
DeepI2I: Enabling Deep Hierarchical Image-to-Image Translation by Transferring from GANs
| Yaxing WangLu YuJoost Van de Weijer
2020-11-11
Towards Efficient Scene Understanding via Squeeze Reasoning
| Xiangtai LiXia LiAnsheng YouLi ZhangGuangliang ChengKuiyuan YangYunhai TongZhouchen Lin
2020-11-06
Conditioning Trick for Training Stable GANs
Mohammad EsmaeilpourRaymel Alfonso SalloOlivier St-GeorgesPatrick CardinalAlessandro Lameiras Koerich
2020-10-12
SMYRF: Efficient Attention using Asymmetric Clustering
| Giannis DarasNikita KitaevAugustus OdenaAlexandros G. Dimakis
2020-10-11
LOGAN: Local Group Bias Detection by Clustering
| Jieyu ZhaoKai-Wei Chang
2020-10-06
MARA-Net: Single Image Deraining Network with Multi-level connections and Adaptive Regional Attentions
Yeachan ParkMyeongho JeonJunho LeeMyungjoo Kang
2020-09-29
TinyGAN: Distilling BigGAN for Conditional Image Generation
| Ting-Yun ChangChi-Jen Lu
2020-09-29
not-so-BigGAN: Generating High-Fidelity Images on Small Compute with Wavelet-based Super-Resolution
Seungwook HanAkash SrivastavaCole HurwitzPrasanna SattigeriDavid D. Cox
2020-09-09
PNEN: Pyramid Non-Local Enhanced Networks
Feida ZhuChaowei FangKai-Kuang Ma
2020-08-22
DeepGIN: Deep Generative Inpainting Network for Extreme Image Inpainting
| Chu-Tak LiWan-Chi SiuZhi-Song LiuLi-Wen WangDaniel Pak-Kong Lun
2020-08-17
Instance Selection for GANs
| Terrance DeVriesMichal DrozdzalGraham W. Taylor
2020-07-30
Interpolating GANs to Scaffold Autotelic Creativity
Ziv EpsteinOcéane BoulaisSkylar GordonMatt Groh
2020-07-21
Allpass Feedback Delay Networks
Sebastian J. Schlecht
2020-07-14
Differentiable Augmentation for Data-Efficient GAN Training
| Shengyu ZhaoZhijian LiuJi LinJun-Yan ZhuSong Han
2020-06-18
Disentangled Non-Local Neural Networks
| Minghao YinZhuliang YaoYue CaoXiu LiZheng ZhangStephen LinHan Hu
2020-06-11
Training Generative Adversarial Networks with Limited Data
| Tero KarrasMiika AittalaJanne HellstenSamuli LaineJaakko LehtinenTimo Aila
2020-06-11
PNL: Efficient Long-Range Dependencies Extraction with Pyramid Non-Local Module for Action Recognition
Yuecong XuHaozhi CaoJianfei YangKezhi MaoJianxiong YinSimon See
2020-06-09
Learning disconnected manifolds: a no GANs land
Ugo TanielianThibaut IssenhuthElvis DohmatobJeremie Mary
2020-06-08
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
| Andrey VoynovStanislav MorozovArtem Babenko
2020-06-08
TESA: Tensor Element Self-Attention via Matricization
Francesca Babiloni Ioannis Marras Gregory Slabaugh Stefanos Zafeiriou
2020-06-01
A U-Net Based Discriminator for Generative Adversarial Networks
Edgar Schonfeld Bernt Schiele Anna Khoreva
2020-06-01
Network-to-Network Translation with Conditional Invertible Neural Networks
| Robin RombachPatrick EsserBjörn Ommer
2020-05-27
Correlating Edge, Pose with Parsing
| Ziwei ZhangChi SuLiang ZhengXiaodong Xie
2020-05-04
A novel Region of Interest Extraction Layer for Instance Segmentation
| Leonardo RossiAkbar KarimiAndrea Prati
2020-04-28
LRTD: Long-Range Temporal Dependency based Active Learning for Surgical Workflow Recognition
| Xueying ShiYueming JinQi DouPheng-Ann Heng
2020-04-21
GANSpace: Discovering Interpretable GAN Controls
| Erik HärkönenAaron HertzmannJaakko LehtinenSylvain Paris
2020-04-06
Evolving Normalization-Activation Layers
| Hanxiao LiuAndrew BrockKaren SimonyanQuoc V. Le
2020-04-06
Feature Quantization Improves GAN Training
| Yang ZhaoChunyuan LiPing YuJianfeng GaoChangyou Chen
2020-04-05
BigGAN-based Bayesian reconstruction of natural images from human brain activity
Kai QiaoJian ChenLinyuan WangChi ZhangLi TongBin Yan
2020-03-13
PBRnet: Pyramidal Bounding Box Refinement to Improve Object Localization Accuracy
Li XiaoYufan LuoChunlong LuoLianhe ZhaoQuanshui FuGuoqing YangAnpeng HuangYi Zhao
2020-03-10
A U-Net Based Discriminator for Generative Adversarial Networks
| Edgar SchönfeldBernt SchieleAnna Khoreva
2020-02-28
Improved Consistency Regularization for GANs
Zhengli ZhaoSameer SinghHonglak LeeZizhao ZhangAugustus OdenaHan Zhang
2020-02-11
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN
Milad MozafariLeila ReddyRufin VanRullen
2020-01-31
Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixtures
Mohamed El Amine SeddikCosme LouartMohamed TamaazoustiRomain Couillet
2020-01-21
HRFA: High-Resolution Feature-based Attack
| Zhixing YeSizhe ChenPeidong ZhangChengjin SunXiaolin Huang
2020-01-21
CNN-generated images are surprisingly easy to spot... for now
| Sheng-Yu WangOliver WangRichard ZhangAndrew OwensAlexei A. Efros
2019-12-23
LOGAN: Latent Optimisation for Generative Adversarial Networks
| Yan WuJeff DonahueDavid BalduzziKaren SimonyanTimothy Lillicrap
2019-12-02
Detecting GAN generated errors
Xiru ZhuFengdi CheTianzi YangTzuyang YuDavid MegerGregory Dudek
2019-12-02
Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
| Ceyuan YangYujun ShenBolei Zhou
2019-11-21
A cost-effective method for improving and re-purposing large, pre-trained GANs by fine-tuning their class-embeddings
| Qi LiLong MaiMichael A. AlcornAnh Nguyen
2019-10-10
Asymmetric Non-local Neural Networks for Semantic Segmentation
| Zhen ZhuMengde XuSong BaiTengteng HuangXiang Bai
2019-08-21
Adversarial Video Generation on Complex Datasets
Aidan ClarkJeff DonahueKaren Simonyan
2019-07-15
Large Scale Adversarial Representation Learning
| Jeff DonahueKaren Simonyan
2019-07-04
6D-VNet: End-to-end 6DoF Vehicle Pose Estimation from Monocular RGB Images
| Di WuZhaoyong ZhuangCanqun XiangWenbin Zou and Xia Li
2019-06-15
GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond
| Yue CaoJiarui XuStephen LinFangyun WeiHan Hu
2019-04-25
Lung Nodule Classification using Deep Local-Global Networks
| Mundher Al-ShabiBoon Leong LanWai Yee ChanKwan-Hoong NgMaxine Tan
2019-04-23
Improved Precision and Recall Metric for Assessing Generative Models
| Tuomas KynkäänniemiTero KarrasSamuli LaineJaakko LehtinenTimo Aila
2019-04-15
Libra R-CNN: Towards Balanced Learning for Object Detection
| Jiangmiao PangKai ChenJianping ShiHuajun FengWanli OuyangDahua Lin
2019-04-04
Spatial-Aware Non-Local Attention for Fashion Landmark Detection
Yixin LiShengqin TangYun YeJinwen Ma
2019-03-11
High-Fidelity Image Generation With Fewer Labels
| Mario LucicMichael TschannenMarvin RitterXiaohua ZhaiOlivier BachemSylvain Gelly
2019-03-06
CCNet: Criss-Cross Attention for Semantic Segmentation
| Zilong HuangXinggang WangYunchao WeiLichao HuangHumphrey ShiWenyu LiuThomas S. Huang
2018-11-28
Metropolis-Hastings view on variational inference and adversarial training
Kirill NeklyudovEvgenii EgorovPavel ShvechikovDmitry Vetrov
2018-10-16
Large Scale GAN Training for High Fidelity Natural Image Synthesis
| Andrew BrockJeff DonahueKaren Simonyan
2018-09-28
Video-based Person Re-identification via 3D Convolutional Networks and Non-local Attention
Xingyu LiaoLingxiao HeZhouwang YangChi Zhang
2018-07-12
Non-local Neural Networks
| Xiaolong WangRoss GirshickAbhinav GuptaKaiming He
2017-11-21

Categories