no code implementations • EMNLP (CODI) 2020 • Fahime Same, Kees Van Deemter
First, we discuss the most common linguistic perspectives on the concept of recency and propose a taxonomy of recency metrics employed in Machine Learning studies for choosing the form of referring expressions in discourse context.
no code implementations • LREC 2022 • T. Mark Ellison, Fahime Same
We add to this work, by introducing a method for exploring variation in human RE choice on the basis of longitudinal corpora - substantial corpora with a single human judgement (in the process of composition) per RE.
no code implementations • 12 Feb 2024 • Guanyi Chen, Fahime Same, Kees Van Deemter
Recently, a human evaluation study of Referring Expression Generation (REG) models had an unexpected conclusion: on \textsc{webnlg}, Referring Expressions (REs) generated by the state-of-the-art neural models were not only indistinguishable from the REs in \textsc{webnlg} but also from the REs generated by a simple rule-based system.
1 code implementation • 27 Jul 2023 • Fahime Same, Guanyi Chen, Kees Van Deemter
We conclude that GREC can no longer be regarded as offering a reliable assessment of models' ability to mimic human reference production, because the results are highly impacted by the choice of corpus and evaluation metrics.
no code implementations • 10 Oct 2022 • Guanyi Chen, Fahime Same, Kees Van Deemter
Previous work on Neural Referring Expression Generation (REG) all uses WebNLG, an English dataset that has been shown to reflect a very limited range of referring expression (RE) use.
no code implementations • ACL 2022 • Fahime Same, Guanyi Chen, Kees Van Deemter
In recent years, neural models have often outperformed rule-based and classic Machine Learning approaches in NLG.
no code implementations • INLG (ACL) 2021 • Guanyi Chen, Fahime Same, Kees Van Deemter
Despite achieving encouraging results, neural Referring Expression Generation models are often thought to lack transparency.
no code implementations • COLING 2020 • Fahime Same, Kees Van Deemter
This paper reports on a structured evaluation of feature-based Machine Learning algorithms for selecting the form of a referring expression in discourse context.