Robust Subspace Recovery Layer for Unsupervised Anomaly Detection

ICLR 2020  ·  Chieh-Hsin Lai, Dongmian Zou, Gilad Lerman ·

We propose a neural network for unsupervised anomaly detection with a novel robust subspace recovery layer (RSR layer). This layer seeks to extract the underlying subspace from a latent representation of the given data and removes outliers that lie away from this subspace. It is used within an autoencoder. The encoder maps the data into a latent space, from which the RSR layer extracts the subspace. The decoder then smoothly maps back the underlying subspace to a "manifold" close to the original inliers. Inliers and outliers are distinguished according to the distances between the original and mapped positions (small for inliers and large for outliers). Extensive numerical experiments with both image and document datasets demonstrate state-of-the-art precision and recall.

PDF Abstract ICLR 2020 PDF ICLR 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Unsupervised Anomaly Detection 20NEWS RSRAE AUC (outlier ratio = 0.5) 0.831 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly ASSIRA Cat Vs Dog RSRAE AUC-ROC 0.835 # 2
Compare
Unsupervised Anomaly Detection Caltech-101 RSRAE AUC (outlier ratio = 0.5) 0.772 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly cats_vs_dogs RSRAE AUC-ROC 0.981 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly cats_vs_dogs RSRAE AUC-ROC 0.917 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly cats_vs_dogs RSRAE AUC-ROC 0.982 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly cats_vs_dogs RSRAE AUC-ROC 0.961 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly cifar10 RSRAE AUC-ROC 0.814 # 4
Compare
Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly CIFAR-10 RSRAE AUC-ROC 0.901 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly CIFAR-10 RSRAE AUC-ROC 0.800 # 4
Compare
Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly CIFAR-10 RSRAE AUC-ROC 0.739 # 4
Compare
Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly CIFAR-10 RSRAE AUC-ROC 0.911 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly Fashion-MNIST RSRAE AUC-ROC 0.854 # 4
Compare
Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly Fashion-MNIST RSRAE AUC-ROC 0.689 # 5
Compare
Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly Fashion-MNIST RSRAE AUC-ROC 0.689 # 5
Compare
Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly Fashion-MNIST RSRAE AUC-ROC 0.748 # 5
Compare
Unsupervised Anomaly Detection Fashion-MNIST RSRAE AUC (outlier ratio = 0.5) 0.833 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly Fashion-MNIST RSRAE AUC-ROC 0.900 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly MNIST RSRAE AUC-ROC 0.966 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly MNIST RSRAE AUC-ROC 0.794 # 3
Compare
Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly MNIST RSRAE AUC-ROC 0.948 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly MNIST RSRAE AUC-ROC 0.851 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly MNIST RSRAE AUC-ROC 0.763 # 4
Compare
Unsupervised Anomaly Detection Reuters-21578 RSRAE AUC (outlier ratio = 0.5) 0.849 # 1
Compare
Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly STL-10 RSRAE AUC-ROC 0.944 # 3
Compare
Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly STL-10 RSARE AUC-ROC 0.971 # 3
Compare
Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly STL-10 RSRAE AUC-ROC 0.995 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly STL-10 RSRAE AUC-ROC 0.992 # 2
Compare
Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly STL-10 RSRAE AUC-ROC 0.972 # 3
Compare

Methods
Add Remove

No methods listed for this paper. Add relevant methods here
Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy