Interactive Video Object Segmentation
9 papers with code • 1 benchmarks • 5 datasets
The interactive scenario assumes the user gives iterative refinement inputs to the algorithm, in our case in the form of a scribble, to segment the objects of interest. Methods have to produce a segmentation mask for that object in all the frames of a video sequence taking into account all the user interactions.
Benchmarks
These leaderboards are used to track progress in Interactive Video Object Segmentation
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
Libraries
Use these libraries to find Interactive Video Object Segmentation models and implementations
DAVIS
DAVIS 2017
MOSE
BL30K
PUMaVOS
Most implemented papers
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion
hkchengrex/MiVOS
•
•
CVPR 2021
We present Modular interactive VOS (MiVOS) framework which decouples interaction-to-mask and mask propagation, allowing for higher generalizability and better performance.
Interactive Video Object Segmentation Using Global and Local Transfer Modules
yuk6heo/IVOS-ATNet
•
•
ECCV 2020
The global transfer module conveys the segmentation information in an annotated frame to a target frame, while the local transfer module propagates the segmentation information in a temporally adjacent frame to the target frame.
Video Object Segmentation using Space-Time Memory Networks
In our framework, the past frames with object masks form an external memory, and the current frame as the query is segmented using the mask information in the memory.
Fast User-Guided Video Object Segmentation by Interaction-and-Propagation Networks
seoungwugoh/ivs-demo
•
•
CVPR 2019
We propose a new multi-round training scheme for the interactive video object segmentation so that the networks can learn how to understand the user's intention and update incorrect estimations during the training.
Fast Interactive Video Object Segmentation with Graph Neural Networks
Interactive video object segmentation aims to utilize automatic methods to speed up the process and reduce the workload of the annotators.
Learning to Recommend Frame for Interactive Video Object Segmentation in the Wild
This paper proposes a framework for the interactive video object segmentation (VOS) in the wild where users can choose some frames for annotations iteratively.
Guided Interactive Video Object Segmentation Using Reliability-Based Attention Maps
yuk6heo/GIS-RAmap
•
•
CVPR 2021
We propose a novel guided interactive segmentation (GIS) algorithm for video objects to improve the segmentation accuracy and reduce the interaction time.
Revisiting Click-based Interactive Video Object Segmentation
While current methods for interactive Video Object Segmentation (iVOS) rely on scribble-based interactions to generate precise object masks, we propose a Click-based interactive Video Object Segmentation (CiVOS) framework to simplify the required user workload as much as possible.
Segment Anything Meets Point Tracking
syscv/sam-pt
•
•
The Segment Anything Model (SAM) has established itself as a powerful zero-shot image segmentation model, enabled by efficient point-centric annotation and prompt-based models.
