The Vision Transformer, or ViT, is a model for image classification that employs a Transformer-like architecture over patches of the image. An image is split into fixed-size patches, each of them are then linearly embedded, position embeddings are added, and the resulting sequence of vectors is fed to a standard Transformer encoder. In order to perform classification, the standard approach of adding an extra learnable “classification token” to the sequence is used.
Source: An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalePaper | Code | Results | Date | Stars |
---|
Task | Papers | Share |
---|---|---|
Semantic Segmentation | 78 | 9.00% |
Image Classification | 64 | 7.38% |
Object Detection | 38 | 4.38% |
Self-Supervised Learning | 30 | 3.46% |
Image Segmentation | 23 | 2.65% |
Classification | 18 | 2.08% |
Instance Segmentation | 17 | 1.96% |
Autonomous Driving | 15 | 1.73% |
Language Modelling | 14 | 1.61% |