An Exploratory Study on Human-Centric Video Anomaly Detection through Variational Autoencoders and Trajectory Prediction

29 Apr 2024  ·  Ghazal Alinezhad Noghre, Armin Danesh Pazho, Hamed Tabkhi ·

Video Anomaly Detection (VAD) represents a challenging and prominent research task within computer vision. In recent years, Pose-based Video Anomaly Detection (PAD) has drawn considerable attention from the research community due to several inherent advantages over pixel-based approaches despite the occasional suboptimal performance. Specifically, PAD is characterized by reduced computational complexity, intrinsic privacy preservation, and the mitigation of concerns related to discrimination and bias against specific demographic groups. This paper introduces TSGAD, a novel human-centric Two-Stream Graph-Improved Anomaly Detection leveraging Variational Autoencoders (VAEs) and trajectory prediction. TSGAD aims to explore the possibility of utilizing VAEs as a new approach for pose-based human-centric VAD alongside the benefits of trajectory prediction. We demonstrate TSGAD's effectiveness through comprehensive experimentation on benchmark datasets. TSGAD demonstrates comparable results with state-of-the-art methods showcasing the potential of adopting variational autoencoders. This suggests a promising direction for future research endeavors. The code base for this work is available at https://github.com/TeCSAR-UNCC/TSGAD.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Video Anomaly Detection HR-ShanghaiTech TSGAD AUC 81.77 # 3
Anomaly Detection ShanghaiTech TSGAD AUC 80.6% # 18
Video Anomaly Detection ShanghaiTech TSGAD AUC 80.6% # 5
Anomaly Detection ShanghaiTech Campus TSGAD AUC-ROC 80.67 # 1
Video Anomaly Detection ShanghaiTech Campus TSGAD AUC 80.6 # 2

Methods