Search Results for author: Julen Etxaniz

Found 4 papers, 4 papers with code

XNLIeu: a dataset for cross-lingual NLI in Basque

2 code implementations10 Apr 2024 Maite Heredia, Julen Etxaniz, Muitze Zulaika, Xabier Saralegi, Jeremy Barnes, Aitor Soroa

We have conducted a series of experiments using mono- and multilingual LLMs to assess a) the effect of professional post-edition on the MT system; b) the best cross-lingual strategy for NLI in Basque; and c) whether the choice of the best cross-lingual strategy is influenced by the fact that the dataset is built by translation.

Natural Language Inference Natural Language Understanding +1

NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark

1 code implementation27 Oct 2023 Oscar Sainz, Jon Ander Campos, Iker García-Ferrero, Julen Etxaniz, Oier Lopez de Lacalle, Eneko Agirre

In this position paper, we argue that the classical evaluation on Natural Language Processing (NLP) tasks using annotated benchmarks is in trouble.

Language Modelling Large Language Model +1

Do Multilingual Language Models Think Better in English?

1 code implementation2 Aug 2023 Julen Etxaniz, Gorka Azkune, Aitor Soroa, Oier Lopez de Lacalle, Mikel Artetxe

In this work, we introduce a new approach called self-translate, which overcomes the need of an external translation system by leveraging the few-shot translation capabilities of multilingual language models.

Common Sense Reasoning Cross-Lingual Natural Language Inference +6

Cannot find the paper you are looking for? You can Submit a new open access paper.