Search Results for author:
Found 5 papers, 3 papers with code
Generalizing Multimodal Pre-training into Multilingual via Language Acquisition
Specifically, we design a lightweight language acquisition encoder based on state-of-the-art monolingual VLP models.
A Roadmap for Big Model
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm.
ICECAP: Information Concentrated Entity-aware Image Captioning
In this work, we focus on the entity-aware news image captioning task which aims to generate informative captions by leveraging the associated news articles to provide background knowledge about the target image.
Question-controlled Text-aware Image Captioning
To explore how to generate personalized text-aware captions, we define a new challenging task, namely Question-controlled Text-aware Image Captioning (Qc-TextCap).
WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training
We further construct a large Chinese multi-source image-text dataset called RUC-CAS-WenLan for pre-training our BriVL model.
Ranked #1 on
Image-to-Text Retrieval
on AIC-ICC
