Search Results for author: Benjamin Winter

Found 3 papers, 2 papers with code

KIMERA: Injecting Domain Knowledge into Vacant Transformer Heads

no code implementations LREC 2022 Benjamin Winter, Alexei Figueroa, Alexander Löser, Felix Alexander Gers, Amy Siu

We apply KIMERA to BERT-base to evaluate the extent of the domain transfer and also improve on the already strong results of BioBERT in the clinical domain.

Information Retrieval Model Compression +1

VisBERT: Hidden-State Visualizations for Transformers

1 code implementation9 Nov 2020 Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers

At the same time, they are difficult to incorporate into the large, black-box models that achieve state-of-the-art results in a multitude of NLP tasks.

Multi-hop Question Answering Question Answering

How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer Representations

2 code implementations11 Sep 2019 Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers

In order to better understand BERT and other Transformer-based models, we present a layer-wise analysis of BERT's hidden states.

Question Answering

Cannot find the paper you are looking for? You can Submit a new open access paper.