Search Results for author:
Found 11 papers, 4 papers with code
Revenge of the Fallen? Recurrent Models Match Transformers at Predicting Human Language Comprehension Metrics
Transformers have generally supplanted recurrent neural networks as the dominant architecture for both natural language processing tasks and for modelling the effect of predictability on online human language comprehension.
Structural Priming Demonstrates Abstract Grammatical Representations in Multilingual Language Models
We measure crosslingual structural priming in large language models, comparing model behavior to human experimental results from eight crosslingual experiments covering six languages, and four monolingual structural priming experiments in three non-English languages.
Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models
Do multilingual language models share abstract grammatical representations across languages, and if so, when do these develop?
Emergent inabilities? Inverse scaling over the course of pretraining
Does inverse scaling only occur as a function of model parameter size, or can it also occur over the course of training?
Can Peanuts Fall in Love with Distributional Semantics?
Context changes expectations about upcoming words - following a story involving an anthropomorphic peanut, comprehenders expect the sentence the peanut was in love more than the peanut was salted, as indexed by N400 amplitude (Nieuwland & van Berkum, 2006).
Rarely a problem? Language models exhibit inverse scaling in their predictions following few-type quantifiers
How well do language models deal with quantification?
Collateral facilitation in humans and language models
Are the predictions of humans and language models affected by similar things?
Do language models make human-like predictions about the coreferents of Italian anaphoric zero pronouns?
Some languages allow arguments to be omitted in certain contexts.
So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgements
In this study, we investigate whether the linguistic predictions of computational language models or humans better reflect the way in which natural language stimuli modulate the amplitude of the N400.
Different kinds of cognitive plausibility: why are transformers better than RNNs at predicting N400 amplitude?
Despite being designed for performance rather than cognitive plausibility, transformer language models have been found to be better at predicting metrics used to assess human language comprehension than language models with other architectures, such as recurrent neural networks.
How well does surprisal explain N400 amplitude under different experimental conditions?
We investigate the extent to which word surprisal can be used to predict a neural measure of human language processing difficulty - the N400.
