no code implementations • SLTAT (LREC) 2022 • Neha Deshpande, Fabrizio Nunnari, Eleftherios Avramidis
In this paper, we investigate the capability of convolutional neural networks to recognize in sign language video frames the six basic Ekman facial expressions for ‘fear’, ‘disgust’, ‘surprise’, ‘sadness’, ‘happiness’, ‘anger’ along with the ‘neutral’ class.
1 code implementation • LREC 2022 • Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, He Wang, Renlong Ai, Shushen Manakhimova, Ursula Strohriegel, Sebastian Möller, Hans Uszkoreit
Furthermore, we present various exemplary applications of our test suite that have been implemented in the past years, like contributions to the Conference of Machine Translation, the usage of the test suite and MT outputs for quality estimation, and the expansion of the test suite to the language pair Portuguese–English.
1 code implementation • ACL 2022 • Galina Angelova, Eleftherios Avramidis, Sebastian Möller
We examine methods and techniques, proven to be helpful for the text-to-text translation of spoken languages in the context of gloss-to-text translation systems, where the glosses are the written representation of the signs.
no code implementations • WMT (EMNLP) 2021 • Vivien Macketanz, Eleftherios Avramidis, Shushen Manakhimova, Sebastian Möller
We are using a semi-automated test suite in order to provide a fine-grained linguistic evaluation for state-of-the-art machine translation systems.
no code implementations • MTSummit 2021 • Lan Thao Nguyen, Florian Schicktanz, Aeneas Stankowski, Eleftherios Avramidis
In this paper we present a prototypical implementation of a pipeline that allows the automatic generation of a German Sign Language avatar from 2D video material.
no code implementations • ACL 2021 • Patrick Stadler, Vivien Macketanz, Eleftherios Avramidis
In this paper we present our observations and evaluations by observing the linguistic performance of the system on several steps on the training process of various English-to-German Neural Machine Translation models.
no code implementations • WMT (EMNLP) 2020 • Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Aljoscha Burchardt, Sebastian Möller
This paper describes a test suite submission providing detailed statistics of linguistic performance for the state-of-the-art German-English systems of the Fifth Conference of Machine Translation (WMT20).
no code implementations • WS 2018 • Vivien Macketanz, Eleftherios Avramidis, Aljoscha Burchardt, Hans Uszkoreit
We present an analysis of 16 state-of-the-art MT systems on German-English based on a linguistically-motivated test suite.
no code implementations • WS 2019 • Eleftherios Avramidis, Vivien Macketanz, Ursula Strohriegel, Hans Uszkoreit
We present the results of the application of a grammatical test suite for German$\rightarrow$English MT on the systems submitted at WMT19, with a detailed analysis for 107 phenomena organized in 14 categories.
1 code implementation • NAACL 2019 • Robert Schwarzenberg, David Harbecke, Vivien Macketanz, Eleftherios Avramidis, Sebastian Möller
Evaluating translation models is a trade-off between effort and detail.
no code implementations • WS 2017 • Eleftherios Avramidis
This submission investigates alternative machine learning models for predicting the HTER score on the sentence level.
no code implementations • LREC 2016 • Nora Aranberri, Eleftherios Avramidis, Aljoscha Burchardt, Ond{\v{r}}ej Klejch, Martin Popel, Maja Popovi{\'c}
This work addresses the need to aid Machine Translation (MT) development cycles with a complete workflow of MT evaluation methods.
no code implementations • LREC 2014 • Eleftherios Avramidis, Aljoscha Burchardt, Sabine Hunsicker, Maja Popovi{\'c}, Cindy Tscherwinka, David Vilar, Hans Uszkoreit
Human translators are the key to evaluating machine translation (MT) quality and also to addressing the so far unanswered question when and how to use MT in professional translation workflows.
no code implementations • LREC 2012 • Christian Federmann, Eleftherios Avramidis, Marta R. Costa-juss{\`a}, Josef van Genabith, Maite Melero, Pavel Pecina
We describe the Shared Task on Applying Machine Learning Techniques to Optimise the Division of Labour in Hybrid Machine Translation (ML4HMT) which aims to foster research on improved system combination approaches for machine translation (MT).
no code implementations • LREC 2012 • Eleftherios Avramidis, Aljoscha Burchardt, Christian Federmann, Maja Popovi{\'c}, Cindy Tscherwinka, David Vilar
Significant breakthroughs in machine translation only seem possible if human translators are taken into the loop.
no code implementations • LREC 2012 • Eleftherios Avramidis, Marta R. Costa-juss{\`a}, Christian Federmann, Josef van Genabith, Maite Melero, Pavel Pecina
This corpus aims to serve as a basic resource for further research on whether hybrid machine translation algorithms and system combination techniques can benefit from additional (linguistically motivated, decoding, and runtime) information provided by the different systems involved.