Search Results for author: Lilitta Muradjan

Found 1 papers, 1 papers with code

VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

1 code implementation • ACL 2022 • Letitia Parcalabescu, Michele Cafagna, Lilitta Muradjan, Anette Frank, Iacer Calixto, Albert Gatt

We propose VALSE (Vision And Language Structured Evaluation), a novel benchmark designed for testing general-purpose pretrained vision and language (V&L) models for their visio-linguistic grounding capabilities on specific linguistic phenomena.

Ranked #1 on image-sentence alignment on VALSE counting small numbers

image-sentence alignment valid

Paper
Code

Cannot find the paper you are looking for? You can Submit a new open access paper.