Towards Flexible Blind JPEG Artifacts Removal

ICCV 2021  ยท  Jiaxi Jiang, Kai Zhang, Radu Timofte ยท

Training a single deep blind model to handle different quality factors for JPEG image artifacts removal has been attracting considerable attention due to its convenience for practical usage. However, existing deep blind methods usually directly reconstruct the image without predicting the quality factor, thus lacking the flexibility to control the output as the non-blind methods. To remedy this problem, in this paper, we propose a flexible blind convolutional neural network, namely FBCNN, that can predict the adjustable quality factor to control the trade-off between artifacts removal and details preservation. Specifically, FBCNN decouples the quality factor from the JPEG image via a decoupler module and then embeds the predicted quality factor into the subsequent reconstructor module through a quality factor attention block for flexible control. Besides, we find existing methods are prone to fail on non-aligned double JPEG images even with only a one-pixel shift, and we thus propose a double JPEG degradation model to augment the training data. Extensive experiments on single JPEG images, more general double JPEG images, and real-world JPEG images demonstrate that our proposed FBCNN achieves favorable performance against state-of-the-art methods in terms of both quantitative metrics and visual quality.

PDF Abstract ICCV 2021 PDF ICCV 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
JPEG Artifact Correction BSDS500 (Quality 10 Color) FBCNN PSNR 27.85 # 1
PSNR-B 27.52 # 1
SSIM 0.799 # 2
JPEG Artifact Correction BSDS500 (Quality 10 Grayscale) FBCNN PSNR 29.67 # 1
PSNR-B 29.22 # 1
SSIM 0.821 # 2
JPEG Artifact Correction BSDS500 (Quality 20 Color) FBCNN PSNR 30.14 # 1
PSNR-B 29.56 # 1
SSIM 0.867 # 2
JPEG Artifact Correction BSDS500 (Quality 20 Grayscale) FBCNN PSNR 32.00 # 1
PSNR-B 31.19 # 1
SSIM 0.885 # 2
JPEG Artifact Correction BSDS500 (Quality 30 Color) FBCNN PSNR 31.45 # 1
PSNR-B 30.72 # 1
SSIM 0.897 # 2
JPEG Artifact Correction BSDS500 (Quality 30 Grayscale) FBCNN PSNR 33.37 # 1
PSNR-B 32.32 # 2
SSIM 0.913 # 1
JPEG Artifact Correction Classic5 (Quality 10 Grayscale) FBCNN PSNR 30.12 # 1
PSNR-B 29.80 # 1
SSIM 0.822 # 2
JPEG Artifact Correction Classic5 (Quality 20 Grayscale) FBCNN PSNR 32.31 # 1
PSNR-B 31.74 # 1
SSIM 0.872 # 2
JPEG Artifact Correction Classic5 (Quality 30 Grayscale) FBCNN PSNR 33.54 # 1
PSNR-B 32.78 # 1
SSIM 0.894 # 2
JPEG Artifact Correction Classic5 (Quality 40 Grayscale) FBCNN PSNR 34.35 # 1
SSIM 0.907 # 1
JPEG Artifact Correction ICB (Quality 10 Color) FBCNN PSNR 32.18 # 1
PSNR-B 32.15 # 2
SSIM 0.815 # 1
JPEG Artifact Correction ICB (Quality 20 Color) FBCNN PSNR 34.38 # 1
PSNR-B 34.34 # 3
SSIM 0.844 # 2
JPEG Artifact Correction ICB (Quality 30 Color) FBCNN PSNR 35.41 # 1
PSNR-B 35.35 # 2
SSIM 0.857 # 2
JPEG Artifact Correction LIVE1 (Quality 10 Color) FBCNN PSNR 27.77 # 1
PSNR-B 27.51 # 2
SSIM 0.803 # 6
JPEG Artifact Correction Live1 (Quality 10 Grayscale) FBCNN PSNR 29.75 # 1
PSNR-B 29.40 # 2
SSIM 0.827 # 6
JPEG Artifact Correction LIVE1 (Quality 20 Color) FBCNN PSNR 30.11 # 1
PSNR-B 29.70 # 5
SSIM 0.868 # 7
JPEG Artifact Correction LIVE1 (Quality 20 Grayscale) FBCNN PSNR 32.13 # 1
PSNR-B 31.57 # 6
SSIM 0.889 # 8
JPEG Artifact Correction LIVE1 (Quality 30 Color) FBCNN PSNR 31.43 # 1
PSNR-B 30.92 # 1
SSIM 0.897 # 2
JPEG Artifact Correction LIVE1 (Quality 30 Grayscale) FBCNN PSNR 33.54 # 1
PSNR-B 32.83 # 1
SSIM 0.916 # 2
JPEG Artifact Correction LIVE1 (Quality 40 Grayscale) FBCNN PSNR 34.53 # 2
SSIM 0.931 # 1

Methods


No methods listed for this paper. Add relevant methods here