Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps

CVPR 2021  ·  Yuk Heo, Yeong Jun Koh, Chang-Su Kim ·

We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time. First, we design the reliability-based attention module to analyze the reliability of multiple annotated frames. Second, we develop the intersection-aware propagation module to propagate segmentation results to neighboring frames. Third, we introduce the GIS mechanism for a user to select unsatisfactory frames quickly with less effort. Experimental results demonstrate that the proposed algorithm provides more accurate segmentation results at a faster speed than conventional algorithms. Codes are available at https://github.com/yuk6heo/GIS-RAmap.

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Interactive Video Object Segmentation DAVIS 2017 GIS AUC-J 0.820 # 2
J@60s 0.829 # 2
AUC-J&F 0.856 # 2
J&F@60s 0.866 # 2

Methods


No methods listed for this paper. Add relevant methods here