no code implementations • CLTW (LREC) 2022 • Johannes Heinecke, Anastasia Shimorina
Deep Semantic Parsing into Abstract Meaning Representation (AMR) graphs has reached a high quality with neural-based seq2seq approaches.
no code implementations • INLG (ACL) 2021 • Anya Belz, Anastasia Shimorina, Shubham Agarwal, Ehud Reiter
The NLP field has recently seen a substantial increase in work related to reproducibility of results, and more generally in recognition of the importance of having shared definitions and practices relating to evaluation.
1 code implementation • ACL (WebNLG, INLG) 2020 • Diego Moussallem, Paramjot Kaur, Thiago Ferreira, Chris van der Lee, Anastasia Shimorina, Felix Conrads, Michael Röder, René Speck, Claire Gardent, Simon Mille, Nikolai Ilinykh, Axel-Cyrille Ngonga Ngomo
The RDF-to-text task has recently gained substantial attention due to the continuous growth of RDF knowledge graphs in number and size.
1 code implementation • HumEval (ACL) 2022 • Anastasia Shimorina, Anya Belz
This paper presents the Human Evaluation Datasheet (HEDS), a template for recording the details of individual human evaluation experiments in Natural Language Processing (NLP), and reports on first experience of researchers using HEDS sheets in practice.
no code implementations • INLG (ACL) 2020 • Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter
Across NLP, a growing body of work is looking at the issue of reproducibility.
1 code implementation • NAACL (ACL) 2022 • Anastasia Shimorina, Johannes Heinecke, Frédéric Herledan
This paper presents an effort within our company of developing knowledge extraction pipeline for English, which can be further used for constructing an entreprise-specific knowledge base.
no code implementations • ACL (WebNLG, INLG) 2020 • Thiago castro Ferreira, Claire Gardent, Nikolai Ilinykh, Chris van der Lee, Simon Mille, Diego Moussallem, Anastasia Shimorina
WebNLG+ offers two challenges: (i) mapping sets of RDF triples to English or Russian text (generation) and (ii) converting English or Russian text to sets of RDF triples (semantic parsing).
no code implementations • 17 Mar 2021 • Anastasia Shimorina, Anya Belz
This paper introduces the Human Evaluation Datasheet, a template for recording the details of individual human evaluation experiments in Natural Language Processing (NLP).
1 code implementation • EACL 2021 • Anya Belz, Shubham Agarwal, Anastasia Shimorina, Ehud Reiter
Against the background of what has been termed a reproducibility crisis in science, the NLP field is becoming increasingly interested in, and conscientious about, the reproducibility of its results.
no code implementations • ACL (GEM) 2021 • Sebastian Gehrmann, Tosin Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondřej Dušek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Mihir Kale, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics.
Ranked #1 on Extreme Summarization on GEM-XSum
Abstractive Text Summarization Cross-Lingual Abstractive Summarization +5
no code implementations • WS 2019 • Anastasia Shimorina, Claire Gardent
This paper presents the LORIA / Lorraine University submission at the Multilingual Surface Realisation shared task 2019 for the shallow track.
no code implementations • IJCNLP 2019 • Anastasia Shimorina, Claire Gardent
Surface realisation (SR) maps a meaning representation to a sentence and can be viewed as consisting of three subtasks: word ordering, morphological inflection and contraction generation (e. g., clitic attachment in Portuguese or elision in French).
1 code implementation • WS 2019 • Anastasia Shimorina, Elena Khasanova, Claire Gardent
In this paper, we propose an approach for semi-automatically creating a data-to-text (D2T) corpus for Russian that can be used to learn a D2T natural language generation model.
2 code implementations • WS 2018 • Anastasia Shimorina, Claire Gardent
Neural approaches to data-to-text generation generally handle rare input items using either delexicalisation or a copy mechanism.
Ranked #5 on KG-to-Text Generation on WebNLG 2.0 (Constrained)
1 code implementation • 29 May 2018 • Anastasia Shimorina
This paper discusses two existing approaches to the correlation analysis between automatic evaluation metrics and human scores in the area of natural language generation.
no code implementations • WS 2017 • Claire Gardent, Anastasia Shimorina, Shashi Narayan, Laura Perez-Beltrachini
The WebNLG challenge consists in mapping sets of RDF triples to text.
2 code implementations • EMNLP 2017 • Shashi Narayan, Claire Gardent, Shay B. Cohen, Anastasia Shimorina
We propose a new sentence simplification task (Split-and-Rephrase) where the aim is to split a complex sentence into a meaning preserving sequence of shorter sentences.
no code implementations • ACL 2017 • Claire Gardent, Anastasia Shimorina, Shashi Narayan, Laura Perez-Beltrachini
In this paper, we present a novel framework for semi-automatically creating linguistically challenging micro-planning data-to-text corpora from existing Knowledge Bases.