no code implementations • 17 Dec 2024 • Michael Heck, Christian Geishauser, Nurul Lubis, Carel van Niekerk, Shutong Feng, Hsien-Chin Lin, Benjamin Matthias Ruppik, Renato Vukovic, Milica Gašić
However, creating high-quality labels is expensive, and even professionally labeled data contains errors and ambiguities.
no code implementations • 7 Aug 2024 • Benjamin Matthias Ruppik, Michael Heck, Carel van Niekerk, Renato Vukovic, Hsien-Chin Lin, Shutong Feng, Marcus Zibrowius, Milica Gašić
Second, the high performance of these models relies on fine-tuning the embedding model in conjunction with the classifier, which may not always be feasible due to the size or inaccessibility of the underlying feature-generation model.
no code implementations • 5 Aug 2024 • Shutong Feng, Hsien-Chin Lin, Christian Geishauser, Nurul Lubis, Carel van Niekerk, Michael Heck, Benjamin Ruppik, Renato Vukovic, Milica Gašić
Emotions are indispensable in human communication, but are often overlooked in task-oriented dialogue (ToD) modelling, where the task success is the primary focus.
no code implementations • 13 Nov 2023 • Guangzhi Sun, Shutong Feng, Dongcheng Jiang, Chao Zhang, Milica Gašić, Philip C. Woodland
Recently, advancements in large language models (LLMs) have shown an unprecedented ability across various language tasks.
no code implementations • 13 Oct 2023 • Carel van Niekerk, Christian Geishauser, Michael Heck, Shutong Feng, Hsien-Chin Lin, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Milica Gašić
Furthermore, the data corrections suggested by our method contribute to an overall improvement in the quality of the resulting datasets.
no code implementations • 22 Sep 2023 • Shutong Feng, Guangzhi Sun, Nurul Lubis, Wen Wu, Chao Zhang, Milica Gašić
Affect recognition, encompassing emotions, moods, and feelings, plays a pivotal role in human communication.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
1 code implementation • 24 Aug 2023 • Shutong Feng, Nurul Lubis, Benjamin Ruppik, Christian Geishauser, Michael Heck, Hsien-Chin Lin, Carel van Niekerk, Renato Vukovic, Milica Gašić
Our framework yields significant improvements for a range of chit-chat ERC models on EmoWOZ, a large-scale dataset for user emotion in ToDs.
1 code implementation • 2 Jun 2023 • Michael Heck, Nurul Lubis, Benjamin Ruppik, Renato Vukovic, Shutong Feng, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk, Milica Gašić
Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas.
no code implementations • 2 Jun 2023 • Hsien-Chin Lin, Shutong Feng, Christian Geishauser, Nurul Lubis, Carel van Niekerk, Michael Heck, Benjamin Ruppik, Renato Vukovic, Milica Gašić
Existing user simulators (USs) for task-oriented dialogue systems only model user behaviour on semantic and natural language levels without considering the user persona and emotions.
1 code implementation • 30 Nov 2022 • Qi Zhu, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk, Baolin Peng, Zheng Zhang, Michael Heck, Nurul Lubis, Dazhen Wan, Xiaochen Zhu, Jianfeng Gao, Milica Gašić, Minlie Huang
Task-oriented dialogue (TOD) systems function as digital assistants, guiding users through various tasks such as booking flights or finding restaurants.
no code implementations • SIGDIAL (ACL) 2022 • Nurul Lubis, Christian Geishauser, Hsien-Chin Lin, Carel van Niekerk, Michael Heck, Shutong Feng, Milica Gašić
They are ideally evaluated with human users, which however is unattainable to do at every iteration of the development phase.
no code implementations • SIGDIAL (ACL) 2022 • Hsien-Chin Lin, Christian Geishauser, Shutong Feng, Nurul Lubis, Carel van Niekerk, Michael Heck, Milica Gašić
In addition, its behaviour can be further shaped with reinforcement learning opening the door to training specialised user simulators.
no code implementations • SIGDIAL (ACL) 2022 • Renato Vukovic, Michael Heck, Benjamin Matthias Ruppik, Carel van Niekerk, Marcus Zibrowius, Milica Gašić
Goal oriented dialogue systems were originally designed as a natural language interface to a fixed data-set of entities that users might inquire about, further described by domain, slots, and values.
no code implementations • COLING 2022 • Christian Geishauser, Carel van Niekerk, Nurul Lubis, Michael Heck, Hsien-Chin Lin, Shutong Feng, Milica Gašić
The lack of a framework with training protocols, baseline models and suitable metrics, has so far hindered research in this direction.
no code implementations • 7 Feb 2022 • Michael Heck, Nurul Lubis, Carel van Niekerk, Shutong Feng, Christian Geishauser, Hsien-Chin Lin, Milica Gašić
Our architecture and training strategies improve robustness towards sample sparsity, new concepts and topics, leading to state-of-the-art performance on a range of benchmarks.
no code implementations • 15 Sep 2021 • Christian Geishauser, Songbo Hu, Hsien-Chin Lin, Nurul Lubis, Michael Heck, Shutong Feng, Carel van Niekerk, Milica Gašić
The dialogue management component of a task-oriented dialogue system is typically optimised via reinforcement learning (RL).
1 code implementation • LREC 2022 • Shutong Feng, Nurul Lubis, Christian Geishauser, Hsien-Chin Lin, Michael Heck, Carel van Niekerk, Milica Gašić
We report a set of experimental results to show the usability of this corpus for emotion recognition and state tracking in task-oriented dialogues.
Ranked #1 on
Emotion Recognition in Conversation
on EmoWoz
Emotion Recognition in Conversation
Task-Oriented Dialogue Systems
no code implementations • EMNLP 2021 • Carel van Niekerk, Andrey Malinin, Christian Geishauser, Michael Heck, Hsien-Chin Lin, Nurul Lubis, Shutong Feng, Milica Gašić
This highlights the importance of developing neural dialogue belief trackers that take uncertainty into account.
no code implementations • SIGDIAL (ACL) 2021 • Hsien-Chin Lin, Nurul Lubis, Songbo Hu, Carel van Niekerk, Christian Geishauser, Michael Heck, Shutong Feng, Milica Gašić
TUS can compete with rule-based user simulators on pre-defined domains and is able to generalise to unseen domains in a zero-shot fashion.
no code implementations • COLING 2020 • Michael Heck, Carel van Niekerk, Nurul Lubis, Christian Geishauser, Hsien-Chin Lin, Marco Moresi, Milica Gašić
Dialog state tracking (DST) suffers from severe data sparsity.
1 code implementation • COLING 2020 • Nurul Lubis, Christian Geishauser, Michael Heck, Hsien-Chin Lin, Marco Moresi, Carel van Niekerk, Milica Gašić
In this paper, we explore three ways of leveraging an auxiliary task to shape the latent variable distribution: via pre-training, to obtain an informed prior, and via multitask learning.
no code implementations • Joint Conference on Lexical and Computational Semantics 2020 • Alexander Jakubowski, Milica Gašić, Marcus Zibrowius
We argue that we should, more accurately, expect them to live on a pinched manifold: a singular quotient of a manifold obtained by identifying some of its points.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Carel van Niekerk, Michael Heck, Christian Geishauser, Hsien-Chin Lin, Nurul Lubis, Marco Moresi, Milica Gašić
The ability to accurately track what happens during a conversation is essential for the performance of a dialogue system.
no code implementations • SIGDIAL (ACL) 2020 • Michael Heck, Carel van Niekerk, Nurul Lubis, Christian Geishauser, Hsien-Chin Lin, Marco Moresi, Milica Gašić
In this paper we present a new approach to DST which makes use of various copy mechanisms to fill slots with values.
Ranked #11 on
Multi-domain Dialogue State Tracking
on MULTIWOZ 2.1
dialog state tracking
Multi-domain Dialogue State Tracking
+2
no code implementations • WS 2019 • Bo-Hsiang Tseng, Paweł Budzianowski, Yen-chen Wu, Milica Gašić
Domain adaptation in natural language generation (NLG) remains challenging because of the high complexity of input semantics across domains and limited data of a target domain.
no code implementations • WS 2018 • Stefan Ultes, Paweł\ Budzianowski, Iñigo Casanueva, Lina Rojas-Barahona, Bo-Hsiang Tseng, Yen-chen Wu, Steve Young, Milica Gašić
Statistical spoken dialogue systems usually rely on a single- or multi-domain dialogue model that is restricted in its capabilities of modelling complex dialogue structures, e. g., relations.
5 code implementations • EMNLP 2018 • Paweł Budzianowski, Tsung-Hsien Wen, Bo-Hsiang Tseng, Iñigo Casanueva, Stefan Ultes, Osman Ramadan, Milica Gašić
Even though machine learning has become the major scene in dialogue research community, the real breakthrough has been blocked by the scale of data available.
2 code implementations • ACL 2018 • Osman Ramadan, Paweł Budzianowski, Milica Gašić
Robust dialogue belief tracking is a key component in maintaining good quality dialogue systems.
Ranked #22 on
Multi-domain Dialogue State Tracking
on MULTIWOZ 2.0
no code implementations • NAACL 2018 • Iñigo Casanueva, Paweł Budzianowski, Pei-Hao Su, Stefan Ultes, Lina Rojas-Barahona, Bo-Hsiang Tseng, Milica Gašić
Reinforcement learning (RL) is a promising approach to solve dialogue policy optimisation.
no code implementations • 11 Feb 2018 • Gellért Weisz, Paweł Budzianowski, Pei-Hao Su, Milica Gašić
A part of this effort is the policy optimisation task, which attempts to find a policy describing how to respond to humans, in the form of a function taking the current state of the dialogue and returning the response of the system.
no code implementations • 30 Nov 2017 • Christopher Tegho, Paweł Budzianowski, Milica Gašić
This paper examines approaches to extract uncertainty estimates from deep Q-networks (DQN) in the context of dialogue management.
no code implementations • 29 Nov 2017 • Iñigo Casanueva, Paweł Budzianowski, Pei-Hao Su, Nikola Mrkšić, Tsung-Hsien Wen, Stefan Ultes, Lina Rojas-Barahona, Steve Young, Milica Gašić
Dialogue assistants are rapidly becoming an indispensable daily aid.
no code implementations • WS 2017 • Stefan Ultes, Paweł Budzianowski, Iñigo Casanueva, Nikola Mrkšić, Lina Rojas-Barahona, Pei-Hao Su, Tsung-Hsien Wen, Milica Gašić, Steve Young
Reinforcement learning is widely used for dialogue policy optimization where the reward function often consists of more than one component, e. g., the dialogue success and the dialogue length.
Multi-Objective Reinforcement Learning
reinforcement-learning
+2
no code implementations • WS 2017 • Paweł Budzianowski, Stefan Ultes, Pei-Hao Su, Nikola Mrkšić, Tsung-Hsien Wen, Iñigo Casanueva, Lina Rojas-Barahona, Milica Gašić
In doing that, we show that our approach has the potential to facilitate policy optimisation for more sophisticated multi-domain dialogue systems.
2 code implementations • 1 Jun 2017 • Nikola Mrkšić, Ivan Vulić, Diarmuid Ó Séaghdha, Ira Leviant, Roi Reichart, Milica Gašić, Anna Korhonen, Steve Young
We present Attract-Repel, an algorithm for improving the semantic quality of word vectors by injecting constraints extracted from lexical resources.
2 code implementations • NAACL 2016 • Nikola Mrkšić, Diarmuid Ó Séaghdha, Blaise Thomson, Milica Gašić, Lina Rojas-Barahona, Pei-Hao Su, David Vandyke, Tsung-Hsien Wen, Steve Young
In this work, we present a novel counter-fitting method which injects antonymy and synonymy constraints into vector space representations in order to improve the vectors' capability for judging semantic similarity.
no code implementations • IJCNLP 2015 • Nikola Mrkšić, Diarmuid Ó Séaghdha, Blaise Thomson, Milica Gašić, Pei-Hao Su, David Vandyke, Tsung-Hsien Wen, Steve Young
Dialog state tracking is a key component of many modern dialog systems, most of which are designed with a single, well-defined domain in mind.