SKResNet

Last updated on Feb 14, 2021

skresnet18

Parameters 12 Million
FLOPs 2 Billion
File Size 45.70 MB
Training Data ImageNet
Training Resources 8x GPUs
Training Time

Training Techniques SGD with Momentum, Weight Decay
Architecture Convolution, Residual Connection, Dense Connections, Global Average Pooling, Max Pooling, Selective Kernel, Softmax
ID skresnet18
LR 0.1
Epochs 100
Layers 18
Crop Pct 0.875
Momentum 0.9
Batch Size 256
Image Size 224
Weight Decay 0.00004
Interpolation bicubic
SHOW MORE
SHOW LESS
skresnet34

Parameters 22 Million
FLOPs 5 Billion
File Size 85.16 MB
Training Data ImageNet
Training Resources 8x GPUs
Training Time

Training Techniques SGD with Momentum, Weight Decay
Architecture Convolution, Residual Connection, Dense Connections, Global Average Pooling, Max Pooling, Selective Kernel, Softmax
ID skresnet34
LR 0.1
Epochs 100
Layers 34
Crop Pct 0.875
Momentum 0.9
Batch Size 256
Image Size 224
Weight Decay 0.00004
Interpolation bicubic
SHOW MORE
SHOW LESS
README.md

Summary

SK ResNet is a variant of a ResNet that employs a Selective Kernel unit. In general, all the large kernel convolutions in the original bottleneck blocks in ResNet are replaced by the proposed SK convolutions, enabling the network to choose appropriate receptive field sizes in an adaptive manner.

How do I load this model?

To load a pretrained model:

import timm
m = timm.create_model('skresnet34', pretrained=True)
m.eval()

Replace the model name with the variant you want to use, e.g. skresnet34. You can find the IDs in the model summaries at the top of this page.

How do I train this model?

You can follow the timm recipe scripts for training a new model afresh.

Citation

@misc{li2019selective,
      title={Selective Kernel Networks}, 
      author={Xiang Li and Wenhai Wang and Xiaolin Hu and Jian Yang},
      year={2019},
      eprint={1903.06586},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Results

Image Classification on ImageNet

Image Classification
BENCHMARK MODEL METRIC NAME METRIC VALUE GLOBAL RANK
ImageNet skresnet34 Top 1 Accuracy 76.93% # 200
Top 5 Accuracy 93.32% # 200
ImageNet skresnet18 Top 1 Accuracy 73.03% # 253
Top 5 Accuracy 91.17% # 253