MANGO: A Mask Attention Guided One-Stage Scene Text Spotter

8 Dec 2020  ·  Liang Qiao, Ying Chen, Zhanzhan Cheng, Yunlu Xu, Yi Niu, ShiLiang Pu, Fei Wu ·

Recently end-to-end scene text spotting has become a popular research topic due to its advantages of global optimization and high maintainability in real applications. Most methods attempt to develop various region of interest (RoI) operations to concatenate the detection part and the sequence recognition part into a two-stage text spotting framework. However, in such framework, the recognition part is highly sensitive to the detected results (e.g.), the compactness of text contours). To address this problem, in this paper, we propose a novel Mask AttentioN Guided One-stage text spotting framework named MANGO, in which character sequences can be directly recognized without RoI operation. Concretely, a position-aware mask attention module is developed to generate attention weights on each text instance and its characters. It allows different text instances in an image to be allocated on different feature map channels which are further grouped as a batch of instance features. Finally, a lightweight sequence decoder is applied to generate the character sequences. It is worth noting that MANGO inherently adapts to arbitrary-shaped text spotting and can be trained end-to-end with only coarse position information (e.g.), rectangular bounding box) and text annotations. Experimental results show that the proposed method achieves competitive and even new state-of-the-art performance on both regular and irregular text spotting benchmarks, i.e., ICDAR 2013, ICDAR 2015, Total-Text, and SCUT-CTW1500.

PDF Abstract

Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Text Spotting ICDAR 2015 MANGO F-measure (%) - Strong Lexicon 81.8 # 16
F-measure (%) - Weak Lexicon 78.9 # 9
F-measure (%) - Generic Lexicon 67.3 # 13
Text Spotting SCUT-CTW1500 MANGO F-measure (%) - No Lexicon 58.9 # 6
F-Measure (%) - Full Lexicon 78.7 # 7
Text Spotting Total-Text MANGO F-measure (%) - Full Lexicon 83.6 # 8
F-measure (%) - No Lexicon 72.9 # 10


No methods listed for this paper. Add relevant methods here