Search Results for author:
Found 3 papers, 2 papers with code
Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
In this work, we introduce Sketchpad, a framework that gives multimodal LMs a visual sketchpad and tools to draw on the sketchpad.
TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
We introduce TIFA (Text-to-Image Faithfulness evaluation with question Answering), an automatic evaluation metric that measures the faithfulness of a generated image to its text input via visual question answering (VQA).
PromptCap: Prompt-Guided Task-Aware Image Captioning
PromptCap outperforms generic captions by a large margin and achieves state-of-the-art accuracy on knowledge-based VQA tasks (60. 4% on OK-VQA and 59. 6% on A-OKVQA).
Ranked #1 on
Visual Question Answering
on TextVQA test-standard
