Structure Representation Network and Uncertainty Feedback Learning for Dense Non-Uniform Fog Removal

6 Oct 2022  ·  Yeying Jin, Wending Yan, Wenhan Yang, Robby T. Tan ·

Few existing image defogging or dehazing methods consider dense and non-uniform particle distributions, which usually happen in smoke, dust and fog. Dealing with these dense and/or non-uniform distributions can be intractable, since fog's attenuation and airlight (or veiling effect) significantly weaken the background scene information in the input image. To address this problem, we introduce a structure-representation network with uncertainty feedback learning. Specifically, we extract the feature representations from a pre-trained Vision Transformer (DINO-ViT) module to recover the background information. To guide our network to focus on non-uniform fog areas, and then remove the fog accordingly, we introduce the uncertainty feedback learning, which produces the uncertainty maps, that have higher uncertainty in denser fog regions, and can be regarded as an attention map that represents fog's density and uneven distribution. Based on the uncertainty map, our feedback network refines our defogged output iteratively. Moreover, to handle the intractability of estimating the atmospheric light colors, we exploit the grayscale version of our input image, since it is less affected by varying light colors that are possibly present in the input image. The experimental results demonstrate the effectiveness of our method both quantitatively and qualitatively compared to the state-of-the-art methods in handling dense and non-uniform fog or smoke.

PDF Abstract


Introduced in the Paper:


Used in the Paper:


Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Image Dehazing Dense-Haze SRDefog SSIM 0.5 # 3
PSNR 16.67 # 2
Image Dehazing NH-HAZE SRDefog PSNR 20.99 # 3
Nonhomogeneous Image Dehazing NH-HAZE validation SRDefog PSNR 20.99 # 1
SSIM 0.61 # 2
Image Dehazing O-Haze SRDefog PSNR 24.61 # 1
SSIM 0.75 # 3