Skip Connection Blocks

DPN Block

Introduced by Chen et al. in Dual Path Networks

A Dual Path Network block is an image model block used in convolutional neural network. The idea of this module is to enable sharing of common features while maintaining the flexibility to explore new features through dual path architectures. In this sense it combines the benefits of ResNets and DenseNets. It was proposed as part of the DPN CNN architecture.

We formulate such a dual path architecture as follows:

$$x^{k} = \sum\limits_{t=1}^{k-1} f_t^{k}(h^t) \text{,} $$

$$ y^{k} = \sum\limits_{t=1}^{k-1} v_t(h^t) = y^{k-1} + \phi^{k-1}(y^{k-1}) \text{,} \\ $$

$$ r^{k} = x^{k} + y^{k} \text{,} \\ $$

$$ h^k = g^k \left( r^{k} \right) \text{,} $$

where $x^{k}$ and $y^{k}$ denote the extracted information at $k$-th step from individual path, $v_t(\cdot)$ is a feature learning function as $f_t^k(\cdot)$. The first equation refers to the densely connected path that enables exploring new features. The second equation refers to the residual path that enables common features re-usage. The third equation defines the dual path that integrates them and feeds them to the last transformation function in the last equation.

Source: Dual Path Networks

Papers


Paper Code Results Date Stars

Categories