Search Results for author: Aarne Talman

Found 5 papers, 3 papers with code

NLI Data Sanity Check: Assessing the Effect of Data Corruption on Model Performance

1 code implementation10 Apr 2021 Aarne Talman, Marianna Apidianaki, Stergios Chatzikyriakidis, Jörg Tiedemann

We propose a new diagnostics test suite which allows to assess whether a dataset constitutes a good testbed for evaluating the models' meaning understanding capabilities.

Natural Language Inference

The University of Helsinki submissions to the WMT19 news translation task

no code implementations WS 2019 Aarne Talman, Umut Sulubacak, Raúl Vázquez, Yves Scherrer, Sami Virpioja, Alessandro Raganato, Arvi Hurskainen, Jörg Tiedemann

In this paper, we present the University of Helsinki submissions to the WMT 2019 shared task on news translation in three language pairs: English-German, English-Finnish and Finnish-English.


Testing the Generalization Power of Neural Network Models Across NLI Benchmarks

no code implementations WS 2019 Aarne Talman, Stergios Chatzikyriakidis

We show that models trained on a natural language inference dataset drawn from one benchmark fail to perform well in others, even if the notion of inference assumed in these benchmarks is the same or similar.

Natural Language Inference Transfer Learning

Sentence Embeddings in NLI with Iterative Refinement Encoders

1 code implementation27 Aug 2018 Aarne Talman, Anssi Yli-Jyrä, Jörg Tiedemann

We can show that the sentence embeddings learned in this way can be utilized in a wide variety of transfer learning tasks, outperforming InferSent on 7 out of 10 and SkipThought on 8 out of 9 SentEval sentence embedding evaluation tasks.

Natural Language Inference Sentence Embedding +1

Cannot find the paper you are looking for? You can Submit a new open access paper.