Lets keep it simple, Using simple architectures to outperform deeper and more complex architectures

22 Aug 2016Seyyed Hossein HasanpourMohammad RouhaniMohsen FayyazMohammad Sabokrou

Major winning Convolutional Neural Networks (CNNs), such as AlexNet, VGGNet, ResNet, GoogleNet, include tens to hundreds of millions of parameters, which impose considerable computation and memory overhead. This limits their practical use for training, optimization and memory efficiency... (read more)

PDF Abstract

Evaluation results from the paper

Task Dataset Model Metric name Metric value Global rank Compare
Image Classification CIFAR-10 SimpleNetv1 Percentage correct 95.51 # 15
Image Classification CIFAR-100 SimpleNetv1 Percentage correct 78.37 # 10
Image Classification MNIST SimpleNetv1 Percentage error 0.2 # 2