Stepwise Feature Fusion: Local Guides Global

7 Mar 2022  ·  Jinfeng Wang, Qiming Huang, Feilong Tang, Jia Meng, Jionglong Su, Sifan Song ·

Colonoscopy, currently the most efficient and recognized colon polyp detection technology, is necessary for early screening and prevention of colorectal cancer. However, due to the varying size and complex morphological features of colonic polyps as well as the indistinct boundary between polyps and mucosa, accurate segmentation of polyps is still challenging. Deep learning has become popular for accurate polyp segmentation tasks with excellent results. However, due to the structure of polyps image and the varying shapes of polyps, it easy for existing deep learning models to overfitting the current dataset. As a result, the model may not process unseen colonoscopy data. To address this, we propose a new State-Of-The-Art model for medical image segmentation, the SSFormer, which uses a pyramid Transformer encoder to improve the generalization ability of models. Specifically, our proposed Progressive Locality Decoder can be adapted to the pyramid Transformer backbone to emphasize local features and restrict attention dispersion. The SSFormer achieves statet-of-the-art performance in both learning and generalization assessment.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Medical Image Segmentation 2018 Data Science Bowl SSFormer-L Dice 0.9230 # 2
mIoU 0.8614 # 3
Medical Image Segmentation CVC-ClinicDB SSFormer-L mean Dice 0.9447 # 10
mIoU 0.8995 # 9
Medical Image Segmentation CVC-ColonDB SSFormer-L mean Dice 0.802 # 10
mIoU 0.721 # 10
Medical Image Segmentation ETIS-LARIBPOLYPDB SSFormer-L mIoU 0.720 # 8
mean Dice 0.796 # 6
Medical Image Segmentation Kvasir-SEG SSFormer-L mean Dice 0.9357 # 7
mIoU 0.8905 # 6

Methods