Learning Regularity in Skeleton Trajectories for Anomaly Detection in Videos

Appearance features have been widely used in video anomaly detection even though they contain complex entangled factors. We propose a new method to model the normal patterns of human movements in surveillance video for anomaly detection using dynamic skeleton features. We decompose the skeletal movements into two sub-components: global body movement and local body posture. We model the dynamics and interaction of the coupled features in our novel Message-Passing Encoder-Decoder Recurrent Network. We observed that the decoupled features collaboratively interact in our spatio-temporal model to accurately identify human-related irregular events from surveillance video sequences. Compared to traditional appearance-based models, our method achieves superior outlier detection performance. Our model also offers "open-box" examination and decision explanation made possible by the semantically understandable features and a network architecture supporting interpretability.

PDF Abstract CVPR 2019 PDF CVPR 2019 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Video Anomaly Detection HR-UBnormal MPED-RNN AUC 61.2 # 6
Anomaly Detection ShanghaiTech MPED-RNN AUC 73.40% # 20

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Video Anomaly Detection HR-Avenue MPED-RNN AUC 86.3 # 7
Video Anomaly Detection HR-ShanghaiTech MPED-RNN AUC 75.4 # 6

Methods


No methods listed for this paper. Add relevant methods here