Vision Transformer Explained | Papers With Code

Vision Transformer

Introduced by Dosovitskiy et al. in An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

The Vision Transformer is a model for image classification that employs a Transformer-like architecture over patches of the image.

Source: An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Paper

Latest Papers

PAPER	DATE
Deepfake Detection Scheme Based on Vision Transformer and Distillation Young-Jin Heo • Young-Ju Choi • Young-Woon Lee • Byung-Gyu Kim	2021-04-03
Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis Ajay Jain • Matthew Tancik • Pieter Abbeel	2021-04-01
Rethinking Spatial Dimensions of Vision Transformers \| Byeongho Heo • Sangdoo Yun • Dongyoon Han • Sanghyuk Chun • Junsuk Choe • Seong Joon Oh # 76 IMAGE CLASSIFICATION ON IMAGENET	2021-03-30
CvT: Introducing Convolutions to Vision Transformers \| Haiping Wu • Bin Xiao • Noel Codella • Mengchen Liu • Xiyang Dai • Lu Yuan • Lei Zhang # 3 IMAGE CLASSIFICATION ON CIFAR-100	2021-03-29
Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encoding Pengchuan Zhang • Xiyang Dai • Jianwei Yang • Bin Xiao • Lu Yuan • Lei Zhang • Jianfeng Gao # 6 INSTANCE SEGMENTATION ON COCO MINIVAL	2021-03-29
CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification \| Chun-Fu Chen • Quanfu Fan • Rameswar Panda # 116 IMAGE CLASSIFICATION ON IMAGENET	2021-03-27
Understanding Robustness of Transformers for Image Classification Srinadh Bhojanapalli • Ayan Chakrabarti • Daniel Glasner • Daliang Li • Thomas Unterthiner • Andreas Veit	2021-03-26
Vision Transformers for Dense Prediction \| René Ranftl • Alexey Bochkovskiy • Vladlen Koltun # 1 MONOCULAR DEPTH ESTIMATION ON NYU-DEPTH V2	2021-03-24
Danish Fungi 2020 -- Not Just Another Image Recognition Dataset \| Lukáš Picek • Milan Šulc • Jiří Matas • Jacob Heilmann-Clausen • Thomas S. Jeppesen • Thomas Læssøe • Tobias Frøslev # 1 FINE-GRAINED IMAGE CLASSIFICATION ON DF20 - MINI	2021-03-18
TransFG: A Transformer Architecture for Fine-grained Recognition \| Ju He • Jie-Neng Chen • Shuai Liu • Adam Kortylewski • Cheng Yang • Yutong Bai • Changhu Wang • Alan Yuille # 1 FINE-GRAINED IMAGE CLASSIFICATION ON CUB-200-2011	2021-03-14
Vision Transformer for COVID-19 CXR Diagnosis using Chest X-ray Feature Corpus Sangjoon Park • Gwanghyun Kim • Yujin Oh • Joon Beom Seo • Sang Min Lee • Jin Hwan Kim • Sungjun Moon • Jae-Kwang Lim • Jong Chul Ye	2021-03-12
Severity Quantification and Lesion Localization of COVID-19 on CXR using Vision Transformer Gwanghyun Kim • Sangjoon Park • Yujin Oh • Joon Beom Seo • Sang Min Lee • Jin Hwan Kim • Sungjun Moon • Jae-Kwang Lim • Jong Chul Ye	2021-03-12
Deepfake Video Detection Using Convolutional Vision Transformer \| Deressa Wodajo • Solomon Atnafu	2021-02-22
Conditional Positional Encodings for Vision Transformers \| Xiangxiang Chu • Zhi Tian • Bo Zhang • Xinlong Wang • Xiaolin Wei • Huaxia Xia • Chunhua Shen	2021-02-22
TransReID: Transformer-based Object Re-Identification \| Shuting He • Hao Luo • Pichao Wang • Fan Wang • Hao Li • Wei Jiang # 2 PERSON RE-IDENTIFICATION ON MSMT17	2021-02-08
PipeTransformer: Automated Elastic Pipelining for Distributed Training of Transformers Chaoyang He • Shen Li • Mahdi Soltanolkotabi • Salman Avestimehr	2021-02-05
Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet \| Li Yuan • Yunpeng Chen • Tao Wang • Weihao Yu • Yujun Shi • Zihang Jiang • Francis EH Tay • Jiashi Feng • Shuicheng Yan # 98 IMAGE CLASSIFICATION ON IMAGENET	2021-01-28
DAF:re: A Challenging, Crowd-Sourced, Large-Scale, Long-Tailed Dataset For Anime Character Recognition \| Edwin Arkel Rios • Wen-Huang Cheng • Bo-Cheng Lai	2021-01-21
Investigating the Vision Transformer Model for Image Retrieval Tasks Socratis Gkelios • Yiannis Boutalis • Savvas A. Chatzichristofis	2021-01-11
Transformer for Image Quality Assessment \| Junyong You • Jari Korhonen	2020-12-30
Toward Transformer-Based Object Detection Josh Beal • Eric Kim • Eric Tzeng • Dong Huk Park • Andrew Zhai • Dmitry Kislyuk	2020-12-17
AdaBins: Depth Estimation using Adaptive Bins \| Shariq Farooq Bhat • Ibraheem Alhashim • Peter Wonka # 1 MONOCULAR DEPTH ESTIMATION ON KITTI EIGEN SPLIT	2020-11-28
On the Effectiveness of Vision Transformers for Zero-shot Face Anti-Spoofing Anjith George • Sebastien Marcel	2020-11-16
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale \| Alexey Dosovitskiy • Lucas Beyer • Alexander Kolesnikov • Dirk Weissenborn • Xiaohua Zhai • Thomas Unterthiner • Mostafa Dehghani • Matthias Minderer • Georg Heigold • Sylvain Gelly • Jakob Uszkoreit • Neil Houlsby # 1 FINE-GRAINED IMAGE CLASSIFICATION ON OXFORD-IIIT PETS	2020-10-22

Tasks

TASK	PAPERS	SHARE
Image Classification	11	26.83%
Object Detection	3	7.32%
Fine-Grained Image Classification	3	7.32%
DeepFake Detection	2	4.88%
Face Swapping	2	4.88%
Depth Estimation	2	4.88%
Monocular Depth Estimation	2	4.88%
Face Recognition	2	4.88%
Image Reconstruction	1	2.44%