no code implementations • ICLR 2020 • Gino Brunner, Yang Liu, Damián Pascual, Oliver Richter, Massimiliano Ciaramita, Roger Wattenhofer
We show that, for sequences longer than the attention head dimension, attention weights are not identifiable.
no code implementations • 15 Sep 2021 • Jens Hauser, Zhao Meng, Damián Pascual, Roger Wattenhofer
We combine a human evaluation of individual word substitutions and a probabilistic analysis to show that between 96% and 99% of the analyzed attacks do not preserve semantics, indicating that their success is mainly based on feeding poor data to the model.
3 code implementations • 6 Nov 2021 • Ard Kastrati, Martyna Beata Płomecka, Damián Pascual, Lukas Wolf, Victor Gillioz, Roger Wattenhofer, Nicolas Langer
We present a new dataset and benchmark with the goal of advancing research in the intersection of brain activities and eye movements.