Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Images

This paper proposes crack segmentation augmented by super resolution (SR) with deep neural networks. In the proposed method, a SR network is jointly trained with a binary segmentation network in an end-to-end manner. This joint learning allows the SR network to be optimized for improving segmentation results. For realistic scenarios, the SR network is extended from non-blind to blind for processing a low-resolution image degraded by unknown blurs. The joint network is improved by our proposed two extra paths that further encourage the mutual optimization between SR and segmentation. Comparative experiments with State of The Art (SoTA) segmentation methods demonstrate the superiority of our joint learning, and various ablation studies prove the effects of our contributions.

PDF Abstract IEEE Transactions 2024 PDF IEEE Transactions 2024 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Crack Segmentation khanhha's dataset - 4x upscaling (blind) CSBSR (w/ PSPNet) IoU_max 0.573 # 1
Average IOU 0.552 # 1
AHD95 22.52 # 4
HD95_min 20.92 # 4
Crack Segmentation khanhha's dataset - 4x upscaling (blind) CSBSR (w/ PSPNet+FOW+BlurSkip) IoU_max 0.550 # 5
Average IOU 0.528 # 5
AHD95 19.10 # 1
HD95_min 18.06 # 2
Crack Segmentation khanhha's dataset - 4x upscaling (blind) CSBSR (w/ PSPNet+FOW) IoU_max 0.573 # 1
Average IOU 0.551 # 2
AHD95 21.70 # 3
HD95_min 18.73 # 3
Crack Segmentation khanhha's dataset - 4x upscaling (blind) CSBSR (w/ HRNet+OCR) IoU_max 0.553 # 4
Average IOU 0.534 # 4
AHD95 20.29 # 2
HD95_min 17.54 # 1

Methods


No methods listed for this paper. Add relevant methods here