Learning Class Unique Features in Fine-Grained Visual Classification

22 Nov 2020  ·  Runkai Zheng, Zhijia Yu, Yinqi Zhang, Chris Ding, Hei Victor Cheng, Li Liu ·

A major challenge in Fine-Grained Visual Classification (FGVC) is distinguishing various categories with high inter-class similarity by learning the feature that differentiate the details. Conventional cross entropy trained Convolutional Neural Network (CNN) fails this challenge as it may suffer from producing inter-class invariant features in FGVC. In this work, we innovatively propose to regularize the training of CNN by enforcing the uniqueness of the features to each category from an information theoretic perspective. To achieve this goal, we formulate a minimax loss based on a game theoretic framework, where a Nash equilibria is proved to be consistent with this regularization objective. Besides, to prevent from a feasible solution of minimax loss that may produce redundant features, we present a Feature Redundancy Loss (FRL) based on normalized inner product between each selected feature map pair to complement the proposed minimax loss. Superior experimental results on several influential benchmarks along with visualization show that our method gives full play to the performance of the baseline model without additional computation and achieves comparable results with state-of-the-art models.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Image Classification CIFAR-10 ResNet-18+MM+FRL Percentage correct 95.33 # 124
Image Classification CIFAR-100 ResNet-18+MM+FRL Percentage correct 76.64 # 141
Fine-Grained Image Classification CUB-200-2011 DenseNet161+MM+FRL Accuracy 88.5 # 16
Fine-Grained Image Classification FGVC Aircraft DenseNet161+MM+FRL Accuracy 94.0 % # 12
Fine-Grained Image Classification Stanford Cars DenseNet161+MM+FRL Accuracy 95.2% # 16
Image Classification STL-10 ResNet-18+MM+FRL Percentage correct 85.42 # 50

Methods


No methods listed for this paper. Add relevant methods here