no code implementations • EMNLP (newsum) 2021 • Don Tuggener, Margot Mieskes, Jan Deriu, Mark Cieliebak
Dialogue summarization is a long-standing task in the field of NLP, and several data sets with dialogues and associated human-written summaries of different styles exist.
1 code implementation • 19 May 2022 • Michel Plüss, Manuela Hürlimann, Marc Cuny, Alla Stöckli, Nikolaos Kapotis, Julia Hartmann, Malgorzata Anna Ulasik, Christian Scheller, Yanick Schraner, Amit Jain, Jan Deriu, Mark Cieliebak, Manfred Vogel
We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers.
no code implementations • 18 Mar 2022 • Shikib Mehri, Jinho Choi, Luis Fernando D'Haro, Jan Deriu, Maxine Eskenazi, Milica Gasic, Kallirroi Georgila, Dilek Hakkani-Tur, Zekang Li, Verena Rieser, Samira Shaikh, David Traum, Yi-Ting Yeh, Zhou Yu, Yizhe Zhang, Chen Zhang
This is a report on the NSF Future Directions Workshop on Automatic Evaluation of Dialog.
1 code implementation • ACL 2022 • Jan Deriu, Don Tuggener, Pius von Däniken, Mark Cieliebak
This paper introduces an adversarial method to stress-test trained metrics to evaluate conversational dialogue systems.
1 code implementation • EMNLP 2020 • Jan Deriu, Don Tuggener, Pius von Däniken, Jon Ander Campos, Alvaro Rodrigo, Thiziri Belkacem, Aitor Soroa, Eneko Agirre, Mark Cieliebak
In this work, we introduce \emph{Spot The Bot}, a cost-efficient and robust evaluation framework that replaces human-bot conversations with conversations between bots.
no code implementations • ACL 2020 • Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
We present DoQA, a dataset with 2, 437 dialogues and 10, 917 QA pairs.
no code implementations • 4 May 2020 • Jon Ander Campos, Arantxa Otegi, Aitor Soroa, Jan Deriu, Mark Cieliebak, Eneko Agirre
We present DoQA, a dataset with 2, 437 dialogues and 10, 917 QA pairs.
no code implementations • ACL 2020 • Jan Deriu, Katsiaryna Mlynchyk, Philippe Schläpfer, Alvaro Rodrigo, Dirk von Grünigen, Nicolas Kaiser, Kurt Stockinger, Eneko Agirre, Mark Cieliebak
For this, we introduce an intermediate representation that is based on the logical query plan in a database called Operation Trees (OT).
no code implementations • WS 2019 • Jan Deriu, Mark Cieliebak
We present "AutoJudge", an automated evaluation method for conversational dialogue systems.
no code implementations • 10 May 2019 • Jan Deriu, Alvaro Rodrigo, Arantxa Otegi, Guillermo Echegoyen, Sophie Rosset, Eneko Agirre, Mark Cieliebak
We cover each class by introducing the main technologies developed for the dialogue systems and then by presenting the evaluation methods regarding this class.
no code implementations • COLING 2018 • Fern Benites, o, Ralf Grubenmann, Pius von D{\"a}niken, Dirk von Gr{\"u}nigen, Jan Deriu, Mark Cieliebak
We describe our approaches used in the German Dialect Identification (GDI) task at the VarDial Evaluation Campaign 2018.
no code implementations • SEMEVAL 2017 • Simon M{\"u}ller, Tobias Huonder, Jan Deriu, Mark Cieliebak
In this paper, we propose a classifier for predicting topic-specific sentiments of English Twitter messages.
1 code implementation • 7 Mar 2017 • Jan Deriu, Aurelien Lucchi, Valeria De Luca, Aliaksei Severyn, Simon Müller, Mark Cieliebak, Thomas Hofmann, Martin Jaggi
This paper presents a novel approach for multi-lingual sentiment classification in short texts.
no code implementations • 11 Nov 2015 • Jan Deriu, Rolf Jagerman, Kai-En Tsay
The problem of inpainting involves reconstructing the missing areas of an image.