A General Benchmarking Framework for Text Generation

1 code implementation • ACL (WebNLG, INLG) 2020 • Diego Moussallem, Paramjot Kaur, Thiago Ferreira, Chris van der Lee, Anastasia Shimorina, Felix Conrads, Michael Röder, René Speck, Claire Gardent, Simon Mille, Nikolai Ilinykh, Axel-Cyrille Ngonga Ngomo

The RDF-to-text task has recently gained substantial attention due to the continuous growth of RDF knowledge graphs in number and size.

Benchmarking Knowledge Graphs +1

A Reference-less Quality Metric for Automatic Speech Recognition via Contrastive-Learning of a Multi-Language Model with Self-Supervision

1 code implementation • 21 Jun 2023 • Kamer Ali Yuksel, Thiago Ferreira, Ahmet Gunduz, Mohamed Al-Badrashiny, Golara Javadi

The common standard for quality evaluation of automatic speech recognition (ASR) systems is reference-based metrics such as the Word Error Rate (WER), computed using manual ground-truth transcriptions that are time-consuming and expensive to obtain.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +5

NoRefER: a Referenceless Quality Metric for Automatic Speech Recognition via Semi-Supervised Language Model Fine-Tuning with Contrastive Learning

1 code implementation • 21 Jun 2023 • Kamer Ali Yuksel, Thiago Ferreira, Golara Javadi, Mohamed El-Badrashiny, Ahmet Gunduz

The self-supervised NoRefER exploits the known quality relationships between hypotheses from multiple compression levels of an ASR for learning to rank intra-sample hypotheses by quality, which is essential for model comparisons.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

Zoom: a corpus of natural language descriptions of map locations

no code implementations • IJCNLP 2015 • Romina Altamirano, Thiago Ferreira, Iv Paraboni, r{\'e}, Luciana Benotti

Text Generation