Video Salient Object Detection

12 papers with code • 10 benchmarks • 4 datasets

Video salient object detection (VSOD) is significantly essential for understanding the underlying mechanism behind HVS during free-viewing in general and instrumental to a wide range of real-world applications, e.g., video segmentation, video captioning, video compression, autonomous driving, robotic interaction, weakly supervised attention. Besides its academic value and practical significance, VSOD presents great difficulties due to the challenges carried by video data (diverse motion patterns, occlusions, blur, large object deformations, etc.) and the inherent complexity of human visual attention behavior (i.e., selective attention allocation, attention shift) during dynamic scenes. Online benchmark: http://dpfan.net/davsod.

( Image credit: Shifting More Attention to Video Salient Object Detection, CVPR2019-Best Paper Finalist )

Greatest papers with code

Shifting More Attention to Video Salient Object Detection

DengPingFan/DAVSOD CVPR 2019

This is the first work that explicitly emphasizes the challenge of saliency shift, i. e., the video salient object(s) may dynamically change.

Salient Object Detection Video Salient Object Detection

Pyramid Dilated Deeper ConvLSTM for Video Salient Object Detection

shenjianbing/PDB-ConvLSTM ECCV 2018

This paper proposes a fast video salient object detection model, based on a novel recurrent network architecture, named Pyramid Dilated Bidirectional ConvLSTM (PDB-ConvLSTM).

 Ranked #1 on Video Salient Object Detection on UVSD (using extra training data)

Salient Object Detection Semantic Segmentation +3

Semi-Supervised Video Salient Object Detection Using Pseudo-Labels

Kinpzz/RCRNet-Pytorch ICCV 2019

Specifically, we present an effective video saliency detector that consists of a spatial refinement network and a spatiotemporal module.

 Ranked #1 on Video Salient Object Detection on VOS-T (using extra training data)

Salient Object Detection Unsupervised Video Object Segmentation +1

Structure-measure: A New Way to Evaluate Foreground Maps

DengPingFan/S-measure ICCV 2017

Our new measure simultaneously evaluates region-aware and object-aware structural similarity between a SM and a GT map.

Salient Object Detection Semantic Segmentation +3

Saliency-Aware Geodesic Video Object Segmentation

shenjianbing/videoseg15 CVPR 2015

Building on the observation that foreground areas are surrounded by the regions with high spatiotemporal edge values, geodesic distance provides an initial estimation for foreground and background.

Ranked #4 on Video Salient Object Detection on DAVSOD-Difficult20 (using extra training data)

Semantic Segmentation Video Salient Object Detection +1

Exploring Rich and Efficient Spatial Temporal Interactions for Real Time Video Salient Object Detection

guotaowang/STVS 7 Aug 2020

In this way, even though the overall video saliency quality is heavily dependent on its spatial branch, however, the performance of the temporal branch still matter.

Salient Object Detection Video Saliency Detection +1

Weakly Supervised Video Salient Object Detection

wangbo-zhao/WSVSOD CVPR 2021

Significant performance improvement has been achieved for fully-supervised video salient object detection with the pixel-wise labeled training datasets, which are time-consuming and expensive to obtain.

Salient Object Detection Video Saliency Detection +1

DS-Net: Dynamic Spatiotemporal Network for Video Salient Object Detection

TJUMMG/DS-Net 9 Dec 2020

In this paper, we investigate the complimentary roles of spatial and temporal information and propose a novel dynamic spatiotemporal network (DS-Net) for more effective fusion of spatiotemporal information.

Optical Flow Estimation Saliency Detection +2

Video Salient Object Detection via Adaptive Local-Global Refinement

piggy2021/ALGRF 29 Apr 2021

Despite their simplicity, such fusion strategies may introduce feature redundancy, and also fail to fully exploit the relationship between multi-level features extracted from both spatial and temporal domains.

Salient Object Detection Video Salient Object Detection

Real-Time Salient Object Detection With a Minimum Spanning Tree

cj4L/MST-python CVPR 2016

In this paper, we present a real-time salient object detection system based on the minimum spanning tree.

Ranked #5 on Video Salient Object Detection on ViSal (using extra training data)

Salient Object Detection Video Salient Object Detection