Asymmetric Bilateral Motion Estimation for Video Frame Interpolation

ICCV 2021  ·  Junheum Park, Chul Lee, Chang-Su Kim ·

We propose a novel video frame interpolation algorithm based on asymmetric bilateral motion estimation (ABME), which synthesizes an intermediate frame between two input frames. First, we predict symmetric bilateral motion fields to interpolate an anchor frame. Second, we estimate asymmetric bilateral motions fields from the anchor frame to the input frames. Third, we use the asymmetric fields to warp the input frames backward and reconstruct the intermediate frame. Last, to refine the intermediate frame, we develop a new synthesis network that generates a set of dynamic filters and a residual frame using local and global information. Experimental results show that the proposed algorithm achieves excellent performance on various datasets. The source codes and pretrained models are available at https://github.com/JunHeum/ABME.

PDF Abstract ICCV 2021 PDF ICCV 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Video Frame Interpolation MSU Video Frame Interpolation ABME PSNR 27.99 # 10
SSIM 0.919 # 10
VMAF 68.10 # 8
LPIPS 0.039 # 9
MS-SSIM 0.945 # 9
Video Frame Interpolation UCF101 ABME PSNR 35.38 # 8
SSIM 0.9698 # 8
Video Frame Interpolation Vimeo90K ABME PSNR 36.18 # 7
SSIM 0.9805 # 6
Video Frame Interpolation X4K1000FPS ABME PSNR 30.16 # 8
SSIM 0.8793 # 7

Methods


No methods listed for this paper. Add relevant methods here