COOKIE: Contrastive Cross-Modal Knowledge Sharing Pre-Training for Vision-Language Representation

1 code implementation • ICCV 2021 • Keyu Wen, Jin Xia, Yuanyuan Huang, Linyang Li, Jiayan Xu, Jie Shao

There are two key designs in it, one is the weight-sharing transformer on top of the visual and textual encoders to align text and image semantically, the other is three kinds of contrastive learning designed for sharing knowledge between different modalities.

Contrastive Learning Cross-Modal Retrieval +3