Skip Connection Blocks

Edit

General • 49 methods

Skip Connection Blocks are building blocks for neural networks that feature skip connections. These skip connections 'skip' some layers allowing gradients to better flow through the network. Below you will find a continuously updating list of skip connection blocks:

Methods

Add a Method

Method	Year	Papers
Residual Block Deep Residual Learning for Image Recognition	2015	2759
Bottleneck Residual Block Deep Residual Learning for Image Recognition	2015	2048
Inverted Residual Block MobileNetV2: Inverted Residuals and Linear Bottlenecks	2018	753
Dense Block Densely Connected Convolutional Networks	2016	466
Non-Local Block Non-local Neural Networks	2017	167
ResNeXt Block Aggregated Residual Transformations for Deep Neural Networks	2016	128
CBHG Tacotron: Towards End-to-End Speech Synthesis	2017	65
Wide Residual Block Wide Residual Networks	2016	55
ShuffleNet Block ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices	2017	49
SRGAN Residual Block Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network	2016	32
Reversible Residual Block The Reversible Residual Network: Backpropagation Without Storing Activations	2017	26
Selective Kernel Selective Kernel Networks	2019	25
Res2Net Block Res2Net: A New Multi-scale Backbone Architecture	2019	24
Ghost Bottleneck GhostNet: More Features from Cheap Operations	2019	24
Efficient Channel Attention ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks	2019	22
Inception-ResNet-v2-B Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning	2016	17
Inception-ResNet-v2-C Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning	2016	17
DPN Block Dual Path Networks	2017	16
MelGAN Residual Block MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis	2019	14
FBNet Block FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search	2018	12
One-Shot Aggregation An Energy and GPU-Computation Efficient Backbone Network for Real-Time Object Detection	2019	11
Global Context Block GCNet: Non-local Networks Meet Squeeze-Excitation Networks and Beyond	2019	11
DV3 Convolution Block Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning	2017	9
Pyramidal Residual Unit Deep Pyramidal Residual Networks	2016	8
Pyramidal Bottleneck Residual Unit	2000	8
Dilated Bottleneck Block DetNet: A Backbone network for Object Detection	2018	5
Dilated Bottleneck with Projection Block DetNet: A Backbone network for Object Detection	2018	5
NVAE Generative Residual Cell NVAE: A Deep Hierarchical Variational Autoencoder	2020	5
NVAE Encoder Residual Cell NVAE: A Deep Hierarchical Variational Autoencoder	2020	5
Big-Little Module Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition	2018	4
ParaNet Convolution Block Non-Autoregressive Neural Text-to-Speech	2019	4
EESP ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network	2018	3
CSPResNeXt Block CSPNet: A New Backbone that can Enhance Learning Capability of CNN	2019	3
Two-Way Dense Layer Pelee: A Real-Time Object Detection System on Mobile Devices	2018	3
SqueezeNeXt Block SqueezeNext: Hardware-Aware Neural Network Design	2018	3
Elastic Dense Block ELASTIC: Improving CNNs with Dynamic Scaling Policies	2018	2
GBlock High Fidelity Speech Synthesis with Adversarial Networks	2019	2
DBlock High Fidelity Speech Synthesis with Adversarial Networks	2019	2
Conditional DBlock High Fidelity Speech Synthesis with Adversarial Networks	2019	2
DVD-GAN GBlock Adversarial Video Generation on Complex Datasets	2019	2
DVD-GAN DBlock Adversarial Video Generation on Complex Datasets	2019	2
Residual SRM SRM : A Style-based Recalibration Module for Convolutional Neural Networks	2019	1
Strided EESP ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network	2018	1
OSA (identity mapping + eSE) CenterMask : Real-Time Anchor-Free Instance Segmentation	2019	1
Elastic ResNeXt Block ELASTIC: Improving CNNs with Dynamic Scaling Policies	2018	1
Hierarchical-Split Block HS-ResNet: Hierarchical-Split Block on Convolutional Neural Network	2020	1

Skip Connection Blocks Edit

Methods Add a Method

Skip Connection Blocks

Edit

Methods

Add a Method