About

The goal of Video Frame Interpolation is to synthesize several frames in the middle of two adjacent frames of the original video. Video Frame Interpolation can be applied to generate slow motion video, increase video frame rate, and frame recovery in video streaming.

Source: Reducing the X-ray radiation exposure frequency in cardio-angiography via deep-learning based video interpolation

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Greatest papers with code

Depth-Aware Video Frame Interpolation

CVPR 2019 baowenbo/DAIN

The proposed model then warps the input frames, depth maps, and contextual features based on the optical flow and local interpolation kernels for synthesizing the output frame.

OPTICAL FLOW ESTIMATION VIDEO FRAME INTERPOLATION

RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation

12 Nov 2020hzwer/Arxiv2020-RIFE

We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for Video Frame Interpolation (VFI).

VIDEO FRAME INTERPOLATION

Video Frame Interpolation via Adaptive Separable Convolution

ICCV 2017 sniklaus/sepconv-slomo

Our method develops a deep fully convolutional neural network that takes two input frames and estimates pairs of 1D kernels for all pixels simultaneously.

OPTICAL FLOW ESTIMATION VIDEO FRAME INTERPOLATION

GIMP-ML: Python Plugins for using Computer Vision Models in GIMP

27 Apr 2020kritiksoman/GIMP-ML

Apart from these, several image manipulation techniques using these plugins have been compiled and demonstrated in the YouTube channel (https://youtube. com/user/kritiksoman) with the objective of demonstrating the use-cases for machine learning based image modification.

COLORIZATION DEBLURRING DENOISING IMAGE INPAINTING IMAGE MANIPULATION IMAGE SUPER-RESOLUTION MONOCULAR DEPTH ESTIMATION SEMANTIC SEGMENTATION SINGLE IMAGE DEHAZING VIDEO FRAME INTERPOLATION

Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution

CVPR 2020 Mukosame/Zooming-Slow-Mo-CVPR-2020

Rather than synthesizing missing LR video frames as VFI networks do, we firstly temporally interpolate LR frame features in missing LR video frames capturing local temporal contexts by the proposed feature temporal interpolation network.

VIDEO FRAME INTERPOLATION VIDEO SUPER-RESOLUTION

Softmax Splatting for Video Frame Interpolation

CVPR 2020 sniklaus/softmax-splatting

In contrast, how to perform forward warping has seen less attention, partly due to additional challenges such as resolving the conflict of mapping multiple pixels to the same target location in a differentiable way.

DEPTH ESTIMATION OPTICAL FLOW ESTIMATION VIDEO FRAME INTERPOLATION

Enhanced Quadratic Video Interpolation

10 Sep 2020zhaohengyuan1/PAN

In this work, we further improve the performance of QVI from three facets and propose an enhanced quadratic video interpolation (EQVI) model.

SUPER-RESOLUTION VIDEO FRAME INTERPOLATION

Blurry Video Frame Interpolation

CVPR 2020 laomao0/BIN

Existing works reduce motion blur and up-convert frame rate through two separate ways, including frame deblurring and frame interpolation.

DEBLURRING VIDEO ENHANCEMENT VIDEO FRAME INTERPOLATION