HINet: Half Instance Normalization Network for Image Restoration

13 May 2021  ·  Liangyu Chen, Xin Lu, Jie Zhang, Xiaojie Chu, Chengpeng Chen ·

In this paper, we explore the role of Instance Normalization in low-level vision tasks. Specifically, we present a novel block: Half Instance Normalization Block (HIN Block), to boost the performance of image restoration networks. Based on HIN Block, we design a simple and powerful multi-stage network named HINet, which consists of two subnetworks. With the help of HIN Block, HINet surpasses the state-of-the-art (SOTA) on various image restoration tasks. For image denoising, we exceed it 0.11dB and 0.28 dB in PSNR on SIDD dataset, with only 7.5% and 30% of its multiplier-accumulator operations (MACs), 6.8 times and 2.9 times speedup respectively. For image deblurring, we get comparable performance with 22.5% of its MACs and 3.3 times speedup on REDS and GoPro datasets. For image deraining, we exceed it by 0.3 dB in PSNR on the average result of multiple datasets with 1.4 times speedup. With HINet, we won 1st place on the NTIRE 2021 Image Deblurring Challenge - Track2. JPEG Artifacts, with a PSNR of 29.70. The code is available at https://github.com/megvii-model/HINet.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Spectral Reconstruction ARAD-1K HINet PSNR 32.51 # 6
MRAE 0.2032 # 6
RMSE 0.0303 # 6
Single Image Deraining Rain100H HINet PSNR 30.65 # 5
SSIM 0.894 # 7
Single Image Deraining Rain100L HINet PSNR 37.28 # 10
SSIM 0.97 # 11
Image Denoising SIDD HINet PSNR (sRGB) 39.99 # 6
SSIM (sRGB) 0.958 # 11
Single Image Deraining Test100 HINet PSNR 30.29 # 5
SSIM 0.906 # 3
Single Image Deraining Test1200 HINet PSNR 33.05 # 6
SSIM 0.919 # 7
Single Image Deraining Test2800 HINet PSNR 33.91 # 3
SSIM 0.941 # 3

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Deblurring GoPro HINet PSNR 32.71 # 23

Methods