Iterative Filter Adaptive Network for Single Image Defocus Deblurring

We propose a novel end-to-end learning-based approach for single image defocus deblurring. The proposed approach is equipped with a novel Iterative Filter Adaptive Network (IFAN) that is specifically designed to handle spatially-varying and large defocus blur. For adaptively handling spatially-varying blur, IFAN predicts pixel-wise deblurring filters, which are applied to defocused features of an input image to generate deblurred features. For effectively managing large blur, IFAN models deblurring filters as stacks of small-sized separable filters. Predicted separable deblurring filters are applied to defocused features using a novel Iterative Adaptive Convolution (IAC) layer. We also propose a training scheme based on defocus disparity estimation and reblurring, which significantly boosts the deblurring quality. We demonstrate that our method achieves state-of-the-art performance both quantitatively and qualitatively on real-world images.

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract

Datasets


Introduced in the Paper:

RealDOF

Used in the Paper:

DPD (Dual-view)
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Defocus Deblurring DPD IFAN Combined PSNR 25.37 # 7
Combined SSIM 0.789 # 5
LPIPS 0.217 # 5
Image Defocus Deblurring DPD (Dual-view) IFANet PSNR 25.99 # 10
SSIM 0.804 # 11
LPIPS 0.207 # 7
Image Defocus Deblurring RealDOF IFAN PSNR 24.71 # 3
SSIM 0.748 # 3
LPIPS 0.306 # 3

Methods