Search Results for author:
Found 6 papers, 4 papers with code
How to Distill your BERT: An Empirical Study on the Impact of Weight Initialisation and Distillation Objectives
To the best of our knowledge, this is the first work comprehensively evaluating distillation objectives in both settings.
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs
This demonstrates the benefits of colexification for multilingual NLP.
A Crosslingual Investigation of Conceptualization in 1335 Languages
The resulting measure for the conceptual similarity of two languages is complementary to standard genealogical, typological, and surface similarity measures.
Construction Grammar Provides Unique Insight into Neural Language Models
Construction Grammar (CxG) has recently been used as the basis for probing studies that have investigated the performance of large pretrained language models (PLMs) with respect to the structure and meaning of constructions.
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative
Construction Grammar (CxG) is a paradigm from cognitive linguistics emphasising the connection between syntax and semantics.
CaMEL: Case Marker Extraction without Labels
We introduce CaMEL (Case Marker Extraction without Labels), a novel and challenging task in computational morphology that is especially relevant for low-resource languages.
