Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs

IJCNLP 2019 Alex WarstadtYu CaoIoana GrosuWei PengHagen BlixYining NieAnna AlsopShikha BordiaHaokun LiuAlicia ParrishSheng-Fu WangJason PhangAnhad MohananeyPhu Mon HtutPaloma JeretičSamuel R. Bowman

Though state-of-the-art sentence representation models can perform tasks requiring significant knowledge of grammar, it is an open question how best to evaluate their grammatical knowledge. We explore five experimental methods inspired by prior work evaluating pretrained sentence representation models... (read more)

PDF Abstract

Evaluation Results from the Paper


  Submit results from this paper to get state-of-the-art GitHub badges and help the community compare results to other papers.