Search Results for author: Ulme Wennberg

Found 3 papers, 2 papers with code

The Case for Translation-Invariant Self-Attention in Transformer-Based Language Models

1 code implementation ACL 2021 Ulme Wennberg, Gustav Eje Henter

In this paper, we analyze the position embeddings of existing language models, finding strong evidence of translation invariance, both for the embeddings themselves and for their effect on self-attention.

Position Translation

Entity, Relation, and Event Extraction with Contextualized Span Representations

3 code implementations IJCNLP 2019 David Wadden, Ulme Wennberg, Yi Luan, Hannaneh Hajishirzi

We examine the capabilities of a unified, multi-task framework for three information extraction tasks: named entity recognition, relation extraction, and event extraction.

Event Extraction Joint Entity and Relation Extraction +5

Cannot find the paper you are looking for? You can Submit a new open access paper.