no code implementations • 25 Apr 2024 • Ulme Wennberg, Gustav Eje Henter
It has been found that Transformer-based language models have the ability to perform basic quantitative reasoning.
no code implementations • 22 Feb 2022 • Gustavo Teodoro Döhler Beck, Ulme Wennberg, Zofia Malisz, Gustav Eje Henter
Deep learning has revolutionised synthetic speech quality.
1 code implementation • ACL 2021 • Ulme Wennberg, Gustav Eje Henter
In this paper, we analyze the position embeddings of existing language models, finding strong evidence of translation invariance, both for the embeddings themselves and for their effect on self-attention.
4 code implementations • IJCNLP 2019 • David Wadden, Ulme Wennberg, Yi Luan, Hannaneh Hajishirzi
We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction.
Ranked #6 on Joint Entity and Relation Extraction on SciERC