Hypernetwork-Based Adaptive Image Restoration

13 Jun 2022  ·  Shai Aharon, Gil Ben-Artzi ·

Adaptive image restoration models can restore images with different degradation levels at inference time without the need to retrain the model. We present an approach that is highly accurate and allows a significant reduction in the number of parameters. In contrast to existing methods, our approach can restore images using a single fixed-size model, regardless of the number of degradation levels. On popular datasets, our approach yields state-of-the-art results in terms of size and accuracy for a variety of image restoration tasks, including denoising, deJPEG, and super-resolution.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Color Image Denoising CBSD68 sigma15 HyperRes PSNR 34.02 # 4
SSIM 0.95 # 1
Color Image Denoising CBSD68 sigma25 HyperRes PSNR 31.41 # 3
SSIM 0.89 # 1
Color Image Denoising CBSD68 sigma35 HyperRes PSNR 29.8 # 2
SSIM 0.85 # 1
Color Image Denoising CBSD68 sigma45 HyperRes PSNR 28.64 # 1
SSIM 0.81 # 1
Color Image Denoising CBSD68 sigma5 HyperRes PSNR 39.96 # 2
SSIM 0.98 # 1
Color Image Denoising CBSD68 sigma55 HyperRes PSNR 27.78 # 1
SSIM 0.78 # 1
Color Image Denoising CBSD68 sigma65 HyperRes PSNR 27.06 # 1
SSIM 0.76 # 1
Color Image Denoising CBSD68 sigma75 HyperRes PSNR 26.46 # 1
SSIM 0.73 # 1
Color Image Denoising CBSD68 sigma85 HyperRes PSNR 25.95 # 1
SSIM 0.71 # 1
JPEG Artifact Correction Live1 (Quality 10 Grayscale) HyperRes PSNR 28.81 # 12
SSIM 0.82 # 10
JPEG Artifact Correction LIVE1 (Quality 30 Grayscale) HyperRes PSNR 32.56 # 6
SSIM 0.91 # 4
JPEG Artifact Correction Live1 (Quality 50 Grayscale) HyperRes PSNR 34.39 # 1
SSIM 0.94 # 1
JPEG Artifact Correction Live1 (Quality 70 Grayscale) HyperRes PSNR 36.38 # 1
SSIM 0.96 # 1
JPEG Artifact Correction Live1 (Quality 80 Grayscale) HyperRes PSNR 38.09 # 1
SSIM 0.97 # 1
Image Super-Resolution Set5 - 2x upscaling HyperRes PSNR 36.69 # 29
SSIM 0.94 # 16
Image Super-Resolution Set5 - 3x upscaling HyperRes PSNR 29.77 # 24
SSIM 0.84 # 12
Image Super-Resolution Set5 - 5x upscaling HyperRes PSNR 25.63 # 1
SSIM 0.74 # 1
Image Super-Resolution Set5 - 6x upscaling HyperRes PSNR 24.92 # 1
SSIM 0.71 # 1

Methods