Adaptively Connected Neural Networks

CVPR 2019  ·  Guangrun Wang, Keze Wang, Liang Lin ·

This paper presents a novel adaptively connected neural network (ACNet) to improve the traditional convolutional neural networks (CNNs) {in} two aspects. First, ACNet employs a flexible way to switch global and local inference in processing the internal feature representations by adaptively determining the connection status among the feature nodes (e.g., pixels of the feature maps) \footnote{In a computer vision domain, a node refers to a pixel of a feature map{, while} in {the} graph domain, a node denotes a graph node.}. We can show that existing CNNs, the classical multilayer perceptron (MLP), and the recently proposed non-local network (NLN) \cite{nonlocalnn17} are all special cases of ACNet. Second, ACNet is also capable of handling non-Euclidean data. Extensive experimental analyses on {a variety of benchmarks (i.e.,} ImageNet-1k classification, COCO 2017 detection and segmentation, CUHK03 person re-identification, CIFAR analysis, and Cora document categorization) demonstrate that {ACNet} cannot only achieve state-of-the-art performance but also overcome the limitation of the conventional MLP and CNN \footnote{Corresponding author: Liang Lin (}. The code is available at \url{}.

PDF Abstract CVPR 2019 PDF CVPR 2019 Abstract

Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Classification CIFAR-10 Standard ACNet Percentage correct 94 # 151
Instance Segmentation COCO minival Mask R-CNN (ResNet-50, ACNet) mask AP 35.2 # 88
Object Detection COCO minival Mask R-CNN (ResNet-50, ACNet) box AP 39.5 # 175
Document Classification Cora ACNet Accuracy 83.5% # 1
Person Re-Identification CUHK03 TriNet + Era + Reranking (ACNet, bs=32) Rank-1 64.8 # 12
Image Classification ImageNet ACNet (ResNet-50) Top 1 Accuracy 77.5% # 760
Number of params 29.38M # 606