Search Results for author: Michele Cafagna

Found 7 papers, 3 papers with code

VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena

1 code implementation ACL 2022 Letitia Parcalabescu, Michele Cafagna, Lilitta Muradjan, Anette Frank, Iacer Calixto, Albert Gatt

We propose VALSE (Vision And Language Structured Evaluation), a novel benchmark designed for testing general-purpose pretrained vision and language (V&L) models for their visio-linguistic grounding capabilities on specific linguistic phenomena.

image-sentence alignment

What Vision-Language Models `See' when they See Scenes

no code implementations15 Sep 2021 Michele Cafagna, Kees Van Deemter, Albert Gatt

Images can be described in terms of the objects they contain, or in terms of the types of scene or place that they instantiate.

On the interaction of automatic evaluation and task framing in headline style transfer

1 code implementation ACL (EvalNLGEval, INLG) 2020 Lorenzo De Mattei, Michele Cafagna, Huiyuan Lai, Felice Dell'Orletta, Malvina Nissim, Albert Gatt

An ongoing debate in the NLG community concerns the best way to evaluate systems, with human evaluation often being considered the most reliable method, compared to corpus-based metrics.

Style Transfer

Norm It! Lexical Normalization for Italian and Its Downstream Effects for Dependency Parsing

no code implementations LREC 2020 Rob van der Goot, Alan Ramponi, Tommaso Caselli, Michele Cafagna, Lorenzo De Mattei

However, for Italian, there is no benchmark available for lexical normalization, despite the presence of many benchmarks for other tasks involving social media data.

Dependency Parsing Lexical Normalization

GePpeTto Carves Italian into a Language Model

1 code implementation29 Apr 2020 Lorenzo De Mattei, Michele Cafagna, Felice Dell'Orletta, Malvina Nissim, Marco Guerini

We provide a thorough analysis of GePpeTto's quality by means of both an automatic and a human-based evaluation.

Language Modelling Sentence Completion

Cannot find the paper you are looking for? You can Submit a new open access paper.