Video Frame Interpolation
80 papers with code • 20 benchmarks • 11 datasets
The goal of Video Frame Interpolation is to synthesize several frames in the middle of two adjacent frames of the original video. Video Frame Interpolation can be applied to generate slow motion video, increase video frame rate, and frame recovery in video streaming.
Benchmarks
These leaderboards are used to track progress in Video Frame Interpolation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Video Frame Interpolation models and implementationsDatasets
UCF101
DAVIS
GoPro
Middlebury
Vimeo90K
X4K1000FPS
MSU Video Frame Interpolation
SlowFlow
ATD-12K
Inter4K
Most implemented papers
RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation
We propose RIFE, a Real-time Intermediate Flow Estimation algorithm for Video Frame Interpolation (VFI).
Video Frame Interpolation via Adaptive Separable Convolution
sniklaus/sepconv-slomo
•
•
ICCV 2017
Our method develops a deep fully convolutional neural network that takes two input frames and estimates pairs of 1D kernels for all pixels simultaneously.
Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation
avinashpaliwal/Super-SloMo
•
•
CVPR 2018
Finally, the two input images are warped and linearly fused to form each intermediate frame.
Depth-Aware Video Frame Interpolation
The proposed model then warps the input frames, depth maps, and contextual features based on the optical flow and local interpolation kernels for synthesizing the output frame.
Video Enhancement with Task-Oriented Flow
Many video enhancement algorithms rely on optical flow to register frames in a video sequence.
Implementing Adaptive Separable Convolution for Video Frame Interpolation
As Deep Neural Networks are becoming more popular, much of the attention is being devoted to Computer Vision problems that used to be solved with more traditional approaches.
Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution
Mukosame/Zooming-Slow-Mo-CVPR-2020
•
•
CVPR 2020
Rather than synthesizing missing LR video frames as VFI networks do, we firstly temporally interpolate LR frame features in missing LR video frames capturing local temporal contexts by the proposed feature temporal interpolation network.
Softmax Splatting for Video Frame Interpolation
sniklaus/softmax-splatting
•
•
CVPR 2020
In contrast, how to perform forward warping has seen less attention, partly due to additional challenges such as resolving the conflict of mapping multiple pixels to the same target location in a differentiable way.
Video Frame Interpolation via Residue Refinement
HopLee6/RRIN
•
•
2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2020
Video frame interpolation achieves temporal super-resolution by generating smooth transitions between frames.
Enhanced Quadratic Video Interpolation
lyh-18/EQVI
•
•
In this work, we further improve the performance of QVI from three facets and propose an enhanced quadratic video interpolation (EQVI) model.
