Style Transfer Modules

Drafting Network is a style transfer module designed to transfer global style patterns in low-resolution, since global patterns can be transferred easier in low resolution due to larger receptive field and less local details. To achieve single style transfer, earlier work trained an encoder-decoder module, where only the content image is used as input. To better combine the style feature and the content feature, the Drafting Network adopts the AdaIN module.

The architecture of Drafting Network is shown in the Figure, which includes an encoder, several AdaIN modules and a decoder. (1) The encoder is a pre-trained VGG-19 network, which is fixed during training. Given $\bar{x}_{c}$ and $\bar{x}_{s}$, the VGG encoder extracts features in multiple granularity at 2_1, 3_1 and 4_1 layers. (2) Then, we apply feature modulation between the content and style feature using AdaIN modules after 2_1, 3_1 and 4_1 layers, respectively. (3) Finally, in each granularity of decoder, the corresponding feature from the AdaIN module is merged via a skip-connection. Here, skip-connections after AdaIN modules in both low and high levels are leveraged to help to reserve content structure, especially for low-resolution image.

Source: Drafting and Revision: Laplacian Pyramid Network for Fast High-Quality Artistic Style Transfer

Papers


Paper Code Results Date Stars

Tasks


Task Papers Share
Style Transfer 2 66.67%
Classification 1 33.33%

Categories