Search Results for author: Jaesin Ahn

Found 1 papers, 0 papers with code

Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints

no code implementations19 Nov 2021 Jaesin Ahn, Jiuk Hong, Jeongwoo Ju, Heechul Jung

The proposed method achieved $71. 4\%$ with a few parameters (of $3. 1M$) on the ImageNet-1k dataset compared to that required by the original transformer model of XCiT-N12 ($69. 9\%$).

Image Classification Inductive Bias +1

Cannot find the paper you are looking for? You can Submit a new open access paper.