no code implementations • LREC 2022 • Benjamin Winter, Alexei Figueroa, Alexander Löser, Felix Alexander Gers, Amy Siu
We apply KIMERA to BERT-base to evaluate the extent of the domain transfer and also improve on the already strong results of BioBERT in the clinical domain.
1 code implementation • 9 Nov 2020 • Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers
At the same time, they are difficult to incorporate into the large, black-box models that achieve state-of-the-art results in a multitude of NLP tasks.
2 code implementations • 11 Sep 2019 • Betty van Aken, Benjamin Winter, Alexander Löser, Felix A. Gers
In order to better understand BERT and other Transformer-based models, we present a layer-wise analysis of BERT's hidden states.