Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation

NeurIPS 2020  ·  Yuxi Li, Ning Xu, Jinlong Peng, John See, Weiyao Lin ·

In this paper, we address several inadequacies of current video object segmentation pipelines. Firstly, a cyclic mechanism is incorporated to the standard semi-supervised process to produce more robust representations. By relying on the accurate reference mask in the starting frame, we show that the error propagation problem can be mitigated. Next, we introduce a simple gradient correction module, which extends the offline pipeline to an online method while maintaining the efficiency of the former. Finally we develop cycle effective receptive field (cycle-ERF) based on gradient correction to provide a new perspective into analyzing object-specific regions of interests. We conduct comprehensive experiments on challenging benchmarks of DAVIS17 and Youtube-VOS, demonstrating that the cyclic mechanism is beneficial to segmentation quality.

PDF Abstract NeurIPS 2020 PDF NeurIPS 2020 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semi-Supervised Video Object Segmentation YouTube-VOS 2018 STM-cycle F-Measure (Seen) 75.8 # 44
F-Measure (Unseen) 70.4 # 45
Overall 69.9 # 44
Speed (FPS) 61.4 # 2
Jaccard (Seen) 71.7 # 44

Methods


No methods listed for this paper. Add relevant methods here