Faster hyperspectral image classification based on selective kernel mechanism using deep convolutional networks

14 Feb 2022  ·  Guandong Li, Chunju Zhang ·

Hyperspectral imagery is rich in spatial and spectral information. Using 3D-CNN can simultaneously acquire features of spatial and spectral dimensions to facilitate classification of features, but hyperspectral image information spectral dimensional information redundancy. The use of continuous 3D-CNN will result in a high amount of parameters, and the computational power requirements of the device are high, and the training takes too long. This letter designed the Faster selective kernel mechanism network (FSKNet), FSKNet can balance this problem. It designs 3D-CNN and 2D-CNN conversion modules, using 3D-CNN to complete feature extraction while reducing the dimensionality of spatial and spectrum. However, such a model is not lightweight enough. In the converted 2D-CNN, a selective kernel mechanism is proposed, which allows each neuron to adjust the receptive field size based on the two-way input information scale. Under the Selective kernel mechanism, it mainly includes two components, se module and variable convolution. Se acquires channel dimensional attention and variable convolution to obtain spatial dimension deformation information of ground objects. The model is more accurate, faster, and less computationally intensive. FSKNet achieves high accuracy on the IN, UP, Salinas, and Botswana data sets with very small parameters.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Hyperspectral Image Classification Botswana FSKNet Overall Accuracy 1 # 1
Hyperspectral Image Classification Indian Pines FSKNet Overall Accuracy 99.83% # 3
Hyperspectral Image Classification Pavia University FSKNet Overall Accuracy 99.96% # 5
Hyperspectral Image Classification Salinas FSKNet Overall Accuracy 99.98% # 1