Multi-Field De-interlacing using Deformable Convolution Residual Blocks and Self-Attention

21 Sep 2022  ·  Ronglei Ji, A. Murat Tekalp ·

Although deep learning has made significant impact on image/video restoration and super-resolution, learned deinterlacing has so far received less attention in academia or industry. This is despite deinterlacing is well-suited for supervised learning from synthetic data since the degradation model is known and fixed. In this paper, we propose a novel multi-field full frame-rate deinterlacing network, which adapts the state-of-the-art superresolution approaches to the deinterlacing task. Our model aligns features from adjacent fields to a reference field (to be deinterlaced) using both deformable convolution residual blocks and self attention. Our extensive experimental results demonstrate that the proposed method provides state-of-the-art deinterlacing results in terms of both numerical and perceptual performance. At the time of writing, our model ranks first in the Full FrameRate LeaderBoard at https://videoprocessing.ai/benchmarks/deinterlacer.html

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Video Deinterlacing MSU Deinterlacer Benchmark DfRes (SA) PSNR 43.486 # 2
SSIM 0.972 # 3
FPS on CPU 0.1 # 28
Subjective 0.925 # 3
VMAF 95.96 # 3
Video Deinterlacing MSU Deinterlacer Benchmark DfRes (122000 G2e 3) PSNR 43.200 # 4
SSIM 0.972 # 3
Subjective 0.862 # 6
VMAF 95.68 # 4
Video Deinterlacing MSU Deinterlacer Benchmark DfRes PSNR 40.590 # 9
SSIM 0.971 # 5
FPS on CPU 0.4 # 26
Subjective 0.912 # 4
VMAF 95.20 # 5

Methods