Search Results for author: Jiuk Hong

Found 2 papers, 1 papers with code

Fair Comparison between Efficient Attentions

1 code implementation1 Jun 2022 Jiuk Hong, Chaehyeon Lee, Soyoun Bang, Heechul Jung

Transformers have been successfully used in various fields and are becoming the standard tools in computer vision.

Rethinking Query, Key, and Value Embedding in Vision Transformer under Tiny Model Constraints

no code implementations19 Nov 2021 Jaesin Ahn, Jiuk Hong, Jeongwoo Ju, Heechul Jung

The proposed method achieved $71. 4\%$ with a few parameters (of $3. 1M$) on the ImageNet-1k dataset compared to that required by the original transformer model of XCiT-N12 ($69. 9\%$).

Image Classification Inductive Bias +1

Cannot find the paper you are looking for? You can Submit a new open access paper.