Search Results for author:
Found 9 papers, 1 papers with code
Results of the WMT20 Metrics Shared Task
Participants were asked to score the outputs of the translation systems competing in the WMT20 News Translation Task with automatic metrics.
Tencent submission for WMT20 Quality Estimation Shared Task
This paper presents Tencent’s submission to the WMT20 Quality Estimation (QE) Shared Task: Sentence-Level Post-editing Effort for English-Chinese in Task 2.
Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMs
To foster progress in this domain, we hold a new shared task at WMT 2023, the first edition of the Discourse-Level Literary Translation.
Results of the WMT19 Metrics Shared Task: Segment-Level and Strong MT Systems Pose Big Challenges
This paper presents the results of the WMT19 Metrics Shared Task.
Results of the WMT18 Metrics Shared Task: Both characters and embeddings achieve good performance
We asked participants of this task to score the outputs of the MT systems involved in the WMT18 News Translation Task with automatic metrics.
Further Investigation into Reference Bias in Monolingual Evaluation of Machine Translation
Monolingual evaluation of Machine Translation (MT) aims to simplify human assessment by requiring assessors to compare the meaning of the MT output with a reference translation, opening up the task to a much larger pool of genuinely qualified evaluators.
Improving Evaluation of Document-level Machine Translation Quality Estimation
Meaningful conclusions about the relative performance of NLP systems are only possible if the gold standard employed in a given evaluation is both valid and reliable.
