We propose a novel architecture to handle the problem of multi-frame super-resolution (MFSR). The proposed framework is known as Enhanced Burst Super-Resolution (EBSR), which divides the MFSR problem into three parts: alignment, fusion, and reconstruction. We propose a Feature Enhanced Pyramid Cascading and Deformable convolution (FEPCD) module to align multiple low-resolution burst images in the feature level. And then the aligned features are fused by a Cross Non-Local Fusion (CNLF) module. Finally, the SR image is reconstructed by the Long Range Concatenation Network (LRCN). In addition, we build a cascading residual pathway structure (CR) to improve the performance. We conduct several experiments to analyze and demonstrate these modules. Our EBSR model won the champion in the real track and second place in the synthetic track in the NTIRE21 Burst Super-Resolution Challenge.

PDF Abstract


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Burst Image Super-Resolution BurstSR EBSR PSNR 48.23 # 6
SSIM 0.985 # 3
LPIPS 0.024 # 3
Burst Image Super-Resolution SyntheticBurst EBSR PSNR 42.98 # 2
SSIM 0.972 # 2
LPIPS 0.031 # 3