Deep Multimodal Subspace Clustering Networks

17 Apr 2018Mahdi AbavisaniVishal M. Patel

We present convolutional neural network (CNN) based approaches for unsupervised multimodal subspace clustering. The proposed framework consists of three main stages - multimodal encoder, self-expressive layer, and multimodal decoder... (read more)

PDF Abstract

Evaluation Results from the Paper


TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK USES EXTRA
TRAINING DATA
COMPARE
Image Clustering ARL Polarimetric Thermal Face Dataset DMSC Accuracy 0.983 # 1
Multi-view Subspace Clustering ARL Polarimetric Thermal Face Dataset DMSC Accuracy 0.988 # 1
Image Clustering Extended Yale-B DMSC Accuracy 0.992 # 1
Image Clustering Extended Yale-B DMSC NMI 0.988 # 2
Image Clustering MNIST DMSC Accuracy 0.951 # 6
Image Clustering MNIST DMSC NMI 0.929 # 4
Multi-view Subspace Clustering ORL DMSC Accuracy 0.833 # 2
Image Clustering USPS DMSC NMI 0.929 # 3
Image Clustering USPS DMSC Accuracy 0.951 # 5