Search Results for author:
Found 9 papers, 6 papers with code
Putting Words in BERT’s Mouth: Navigating Contextualized Vector Spaces with Pseudowords
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond to word senses.
Does Mapo Tofu Contain Coffee? Probing LLMs for Food-related Cultural Knowledge
Recent studies have highlighted the presence of cultural biases in Large Language Models (LLMs), yet often lack a robust methodology to dissect these phenomena comprehensively.
Improving Cross-Lingual Transfer through Subtree-Aware Word Reordering
Despite the impressive growth of the abilities of multilingual language models, such as XLM-R and mT5, it has been shown that they still face difficulties when tackling typologically-distant languages, particularly in the low-resource setting.
MuLER: Detailed and Scalable Reference-based Evaluation
For example, nouns and verbs are among the most frequent POS tags.
Jump to Conclusions: Short-Cutting Transformers With Linear Transformations
Moreover, in the context of language modeling, our method allows "peeking" into early layer representations of GPT-2 and BERT, showing that often LMs already predict the final output in early layers.
On the Relation between Syntactic Divergence and Zero-Shot Performance
We explore the link between the extent to which syntactic relations are preserved in translation and the ease of correctly constructing a parse tree in a zero-shot setting.
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond to word senses.
Fine-Grained Analysis of Cross-Linguistic Syntactic Divergences
The patterns in which the syntax of different languages converges and diverges are often used to inform work on cross-lingual transfer.
Topological Analysis of Syntactic Structures
We use the persistent homology method of topological data analysis and dimensional analysis techniques to study data of syntactic structures of world languages.
