Search Results for author:
Found 17 papers, 3 papers with code
Evaluation rules! On the use of grammars and rule-based systems for NLG evaluation
NLG researchers often use uncontrolled corpora to train and evaluate their systems, using textual similarity metrics, such as BLEU.
The CACAPO Dataset: A Multilingual, Multi-Domain Dataset for Neural Pipeline and End-to-End Data-to-Text Generation
This paper describes the CACAPO dataset, built for training both neural pipeline and end-to-end data-to-text language generation systems.
The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task: Overview and Evaluation Results (WebNLG+ 2020)
WebNLG+ offers two challenges: (i) mapping sets of RDF triples to English or Russian text (generation) and (ii) converting English or Russian text to sets of RDF triples (semantic parsing).
A General Benchmarking Framework for Text Generation
The RDF-to-text task has recently gained substantial attention due to the continuous growth of RDF knowledge graphs in number and size.
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study examining what makes human evaluations in NLP more/less reproducible.
Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Model
In terms of output quality, extending the training set of a data-to-text system with a language model using the pseudo-labeling approach did increase text quality scores, but the data augmentation approach yielded similar scores to the system without training set extension.
Preregistering NLP Research
Preregistration refers to the practice of specifying what you are going to do, and what you expect to find in your study, before carrying out the study.
Automatic identification of writers' intentions: Comparing different methods for predicting relationship goals in online dating profile texts
Results show that LIWC and machine learning models correlate with human evaluations in terms of content-related labels.
Best practices for the human evaluation of automatically generated text
Currently, there is little agreement as to how Natural Language Generation (NLG) systems should be evaluated.
A Personalized Data-to-Text Support Tool for Cancer Patients
In this paper, we present a novel data-to-text system for cancer patients, providing information on quality of life implications after treatment, which can be embedded in the context of shared decision making.
Neural data-to-text generation: A comparison between pipeline and end-to-end architectures
In contrast, recent neural models for data-to-text generation have been proposed as end-to-end approaches, where the non-linguistic input is rendered in natural language with much less explicit intermediate representations in-between.
Ranked #8 on
Data-to-Text Generation
on WebNLG Full
Template-based multilingual football reports generation using Wikidata as a knowledge base
This paper presents a new version of a football reports generation system called PASS.
Automated learning of templates for data-to-text generation: comparing rule-based, statistical and neural methods
The current study investigated novel techniques and methods for trainable approaches to data-to-text generation.
Evaluating the text quality, human likeness and tailoring component of PASS: A Dutch data-to-text system for soccer
We present an evaluation of PASS, a data-to-text system that generates Dutch soccer reports from match statistics which are automatically tailored towards fans of one club or the other.
Language Identification and Morphosyntactic Tagging: The Second VarDial Evaluation Campaign
We present the results and the findings of the Second VarDial Evaluation Campaign on Natural Language Processing (NLP) for Similar Languages, Varieties and Dialects.
PASS: A Dutch data-to-text system for soccer, targeted towards specific audiences
We present PASS, a data-to-text system that generates Dutch soccer reports from match statistics.
Exploring Lexical and Syntactic Features for Language Variety Identification
We present a method to discriminate between texts written in either the Netherlandic or the Flemish variant of the Dutch language.
