Search Results for author:
Found 4 papers, 4 papers with code
Understanding Retrieval Robustness for Retrieval-Augmented Image Captioning
Recent advances in retrieval-augmented models for image captioning highlight the benefit of retrieving related captions for efficient, lightweight models with strong domain-transfer capabilities.
LMCap: Few-shot Multilingual Image Captioning by Retrieval Augmented Language Model Prompting
Multilingual image captioning has recently been tackled by training with large-scale machine translated data, which is an expensive, noisy, and time-consuming process.
Retrieval-augmented Image Captioning
The encoder in our model jointly processes the image and retrieved captions using a pretrained V&L BERT, while the decoder attends to the multimodal encoder representations, benefiting from the extra textual evidence from the retrieved captions.
SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
Recent advances in image captioning have focused on scaling the data and model size, substantially increasing the cost of pre-training and finetuning.
