Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?

1 code implementation • ACL 2022 • Stephanie Brandl, Oliver Eberle, Jonas Pilot, Anders Søgaard

We investigate whether self-attention in large-scale pre-trained language models is as predictive of human eye fixation patterns during task-reading as classical cognitive models of human attention.

Relation Extraction Sentiment Analysis