Image Super-Resolution Using Deep Convolutional Networks

31 Dec 2014  ·  Chao Dong, Chen Change Loy, Kaiming He, Xiaoou Tang ·

We propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The mapping is represented as a deep convolutional neural network (CNN) that takes the low-resolution image as the input and outputs the high-resolution one. We further show that traditional sparse-coding-based SR methods can also be viewed as a deep convolutional network. But unlike traditional methods that handle each component separately, our method jointly optimizes all layers. Our deep CNN has a lightweight structure, yet demonstrates state-of-the-art restoration quality, and achieves fast speed for practical on-line usage. We explore different network structures and parameter settings to achieve trade-offs between performance and speed. Moreover, we extend our network to cope with three color channels simultaneously, and show better overall reconstruction quality.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Super-Resolution BSD100 - 4x upscaling SRCNN PSNR 26.9 # 49
SSIM 0.7101 # 45
Image Super-Resolution FFHQ 1024 x 1024 - 4x upscaling SRCNN FID 31.84 # 7
MS-SSIM 0.924 # 7
PSNR 27.40 # 6
SSIM 0.801 # 7
Image Super-Resolution FFHQ 256 x 256 - 4x upscaling SRCNN FID 147.21 # 7
MS-SSIM 0.900 # 5
PSNR 23.12 # 5
SSIM 0.688 # 8
Image Super-Resolution IXI SRCNN SSIM for 2x T2w 0.9796 # 8
PSNR 2x T2w 37.32 # 8
SSIM 4x T2w 0.9052 # 8
PSNR 4x T2w 29.69 # 8
Image Super-Resolution Manga109 - 4x upscaling SRCNN PSNR 27.58 # 37
SSIM 0.8555 # 35
Video Super-Resolution MSU Video Upscalers: Quality Enhancement SRCNN PSNR 26.68 # 42
SSIM 0.929 # 37
VMAF 51.21 # 13
Image Super-Resolution Set14 - 4x upscaling SRCNN PSNR 27.5 # 73
SSIM 0.7513 # 65
Image Super-Resolution Set5 - 4x upscaling SRCNN PSNR 30.49 # 4
SSIM 0.8628 # 4
Video Super-Resolution Ultra Video Group HD - 4x upscaling SRCNN Average PSNR 37.52 # 4
Image Super-Resolution Urban100 - 4x upscaling SRCNN PSNR 24.52 # 47
SSIM 0.7221 # 44
Video Super-Resolution Vid4 - 4x upscaling SRCNN PSNR 24.68 # 19
SSIM 0.7158 # 17
MOVIE 6.9 # 4
Video Super-Resolution Xiph HD - 4x upscaling SRCNN Average PSNR 31.47 # 2

Methods