Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network

CVPR 2017 Christian LedigLucas TheisFerenc HuszarJose CaballeroAndrew CunninghamAlejandro AcostaAndrew AitkenAlykhan TejaniJohannes TotzZehan WangWenzhe Shi

Despite the breakthroughs in accuracy and speed of single image super-resolution using faster and deeper convolutional neural networks, one central problem remains largely unsolved: how do we recover the finer texture details when we super-resolve at large upscaling factors? The behavior of optimization-based super-resolution methods is principally driven by the choice of the objective function... (read more)

PDF Abstract

Code


Evaluation results from the paper


Task Dataset Model Metric name Metric value Global rank Compare
Image Super-Resolution BSD100 - 4x upscaling SRResNet PSNR 27.58 # 10
Image Super-Resolution BSD100 - 4x upscaling SRResNet SSIM 0.7620 # 2
Image Super-Resolution BSD100 - 4x upscaling SRResNet MOS 2.29 # 2
Image Super-Resolution BSD100 - 4x upscaling nearest neighbors PSNR 25.02 # 34
Image Super-Resolution BSD100 - 4x upscaling nearest neighbors SSIM 0.6606 # 33
Image Super-Resolution BSD100 - 4x upscaling nearest neighbors MOS 1.11 # 6
Image Super-Resolution BSD100 - 4x upscaling SRGAN PSNR 25.16 # 33
Image Super-Resolution BSD100 - 4x upscaling SRGAN SSIM 0.6688 # 32
Image Super-Resolution BSD100 - 4x upscaling SRGAN MOS 3.56 # 1
Image Super-Resolution BSD100 - 4x upscaling bicubic PSNR 25.94 # 31
Image Super-Resolution BSD100 - 4x upscaling bicubic SSIM 0.6935 # 30
Image Super-Resolution BSD100 - 4x upscaling bicubic MOS 1.47 # 5
Image Super-Resolution Set14 - 4x upscaling SRResNet PSNR 28.49 # 13
Image Super-Resolution Set14 - 4x upscaling SRResNet SSIM 0.8184 # 2
Image Super-Resolution Set14 - 4x upscaling SRResNet MOS 2.98 # 2
Image Super-Resolution Set14 - 4x upscaling SRGAN PSNR 26.02 # 38
Image Super-Resolution Set14 - 4x upscaling SRGAN SSIM 0.7397 # 34
Image Super-Resolution Set14 - 4x upscaling SRGAN MOS 3.72 # 1
Image Super-Resolution Set14 - 4x upscaling nearest neighbors PSNR 24.64 # 41
Image Super-Resolution Set14 - 4x upscaling nearest neighbors SSIM 0.7100 # 35
Image Super-Resolution Set14 - 4x upscaling nearest neighbors MOS 1.20 # 6
Image Super-Resolution Set14 - 4x upscaling bicubic PSNR 25.99 # 39
Image Super-Resolution Set14 - 4x upscaling bicubic SSIM 0.7486 # 32
Image Super-Resolution Set14 - 4x upscaling bicubic MOS 1.80 # 5
Image Super-Resolution Set5 - 4x upscaling nearest neighbors PSNR 26.26 # 37
Image Super-Resolution Set5 - 4x upscaling nearest neighbors SSIM 0.7552 # 36
Image Super-Resolution Set5 - 4x upscaling nearest neighbors MOS 1.28 # 6
Image Super-Resolution Set5 - 4x upscaling bicubic PSNR 28.43 # 35
Image Super-Resolution Set5 - 4x upscaling bicubic SSIM 0.8211 # 34
Image Super-Resolution Set5 - 4x upscaling bicubic MOS 1.97 # 5
Image Super-Resolution Set5 - 4x upscaling SRGAN PSNR 29.40 # 32
Image Super-Resolution Set5 - 4x upscaling SRGAN SSIM 0.8472 # 32
Image Super-Resolution Set5 - 4x upscaling SRGAN MOS 3.58 # 1
Image Super-Resolution Set5 - 4x upscaling SRResNet PSNR 32.05 # 12
Image Super-Resolution Set5 - 4x upscaling SRResNet SSIM 0.9019 # 3
Image Super-Resolution Set5 - 4x upscaling SRResNet MOS 3.37 # 2