no code implementations • 7 Apr 2023 • Jae-Hun Lee, Doyoung Yoon, ByeongMoon Ji, Kyungyul Kim, Sangheum Hwang
Linear probing (LP) (and $k$-NN) on the upstream dataset with labels (e. g., ImageNet) and transfer learning (TL) to various downstream datasets are commonly employed to evaluate the quality of visual representations learned via self-supervised learning (SSL).
1 code implementation • ICCV 2021 • Kyungyul Kim, ByeongMoon Ji, Doyoung Yoon, Sangheum Hwang
Hence, it can be interpreted within a framework of knowledge distillation as a student becomes a teacher itself.
Ranked #1 on Multimodal Machine Translation on Multi30K (BLUE (DE-EN) metric)