Video Super-resolution with Temporal Group Attention

Video super-resolution, which aims at producing a high-resolution video from its corresponding low-resolution version, has recently drawn increasing attention. In this work, we propose a novel method that can effectively incorporate temporal information in a hierarchical way. The input sequence is divided into several groups, with each one corresponding to a kind of frame rate. These groups provide complementary information to recover missing details in the reference frame, which is further integrated with an attention module and a deep intra-group fusion module. In addition, a fast spatial alignment is proposed to handle videos with large motion. Extensive results demonstrate the capability of the proposed model in handling videos with various motion. It achieves favorable performance against state-of-the-art methods on several benchmark datasets.

PDF Abstract CVPR 2020 PDF CVPR 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Video Super-Resolution MSU Video Super Resolution Benchmark: Detail Restoration TGA Subjective score 5.529 # 11
ERQAv1.0 0.669 # 14
QRCRv1.0 0.549 # 14
SSIM 0.831 # 16
PSNR 25.786 # 24
FPS 0.706 # 17
1 - LPIPS 0.859 # 21
Video Super-Resolution Vid4 - 4x upscaling - BD degradation TGA PSNR 27.63 # 12
SSIM 0.8423 # 12

Methods


No methods listed for this paper. Add relevant methods here