Transformer-Capsule Model for Intent Detection

Thirty-Fourth AAAI Conference on Artificial Intelligence 2020  ·  Aleksander Obuchowski, Michał Lew ·

Intent recognition is one of the most crucial tasks in NLUsystems, which are nowadays especially important for design-ing intelligent conversation. We propose a novel approach to intent recognition which involves combining transformer architecture with capsule networks... Our results show that such architecture performs better than original capsule-NLU net-work implementations and achieves state-of-the-art results on datasets such as ATIS, AskUbuntu , and WebApp. read more

No code implementations yet. Submit your code now


Results from the Paper

Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Intent Detection ATIS Transformer-Capsule Accuracy 98.89 # 2