Learning Memory-guided Normality for Anomaly Detection

CVPR 2020  ·  Hyunjong Park, Jongyoun Noh, Bumsub Ham ·

We address the problem of anomaly detection, that is, detecting anomalous events in a video sequence. Anomaly detection methods based on convolutional neural networks (CNNs) typically leverage proxy tasks, such as reconstructing input video frames, to learn models describing normality without seeing anomalous samples at training time, and quantify the extent of abnormalities using the reconstruction error at test time. The main drawbacks of these approaches are that they do not consider the diversity of normal patterns explicitly, and the powerful representation capacity of CNNs allows to reconstruct abnormal video frames. To address this problem, we present an unsupervised learning approach to anomaly detection that considers the diversity of normal patterns explicitly, while lessening the representation capacity of CNNs. To this end, we propose to use a memory module with a new update scheme where items in the memory record prototypical patterns of normal data. We also present novel feature compactness and separateness losses to train the memory, boosting the discriminative power of both memory items and deeply learned features from normal data. Experimental results on standard benchmarks demonstrate the effectiveness and efficiency of our approach, which outperforms the state of the art.

PDF Abstract CVPR 2020 PDF CVPR 2020 Abstract

Reproducibility Reports

Jan 29 2021
[Re] Learning Memory Guided Normality for Anomaly Detection

We obtain results that are within a 3% range of the reported results for all datasets other than on the ShanghaiTech dataset[2]. The anomalous run stuck out since the ”Non Memory” of the same run could score markedly better than the ”Memory” variant. This led us to investigate the behaviour of the memory module and found valuable insights which are presented in Section 5.

Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Anomaly Detection MVTec LOCO AD MNAD Avg. Detection AUROC 65.1 # 30
Detection AUROC (only logical) 60.0 # 32
Detection AUROC (only structural) 70.2 # 29
Segmentation AU-sPRO (until FPR 5%) 33.9 # 20
Physical Video Anomaly Detection PHANTOM MNAD Avg. ROC-AUC 0.55 # 3
General Action Video Anomaly Detection Something-Something V2 MNAD Avg. ROC-AUC 0.52 # 2


No methods listed for this paper. Add relevant methods here