Search Results for author:
Found 11 papers, 5 papers with code
Causal Analysis of Syntactic Agreement Mechanisms in Neural Language Models
Targeted syntactic evaluations have demonstrated the ability of language models to perform subject-verb agreement given difficult contexts.
Fine-tuning Encoders for Improved Monolingual and Zero-shot Polylingual Neural Topic Modeling
Neural topic models can augment or replace bag-of-words inputs with the learned representations of deep pre-trained transformer-based word prediction models.
Decoding Methods for Neural Narrative Generation
Narrative generation is an open-ended NLP task in which a model generates a story given a prompt.
Demographic Representation and Collective Storytelling in the Me Too Twitter Hashtag Activism Movement
The #MeToo movement on Twitter has drawn attention to the pervasive nature of sexual harassment and violence.
An Analysis of Massively Multilingual Neural Machine Translation for Low-Resource Languages
We find that best practices in this domain are highly language-specific: adding more languages to a training set is often better, but too many harms performance{---}the best number depends on the source language.
Fine-grained Morphosyntactic Analysis and Generation Tools for More Than One Thousand Languages
Exploiting the broad translation of the Bible into the world{'}s languages, we train and distribute morphosyntactic tools for approximately one thousand languages, vastly outstripping previous distributions of tools devoted to the processing of inflectional morphology.
The Johns Hopkins University Bible Corpus: 1600+ Tongues for Typological Exploration
The corpus consists of over 4000 unique translations of the Christian Bible and counting.
Cross-Linguistic Syntactic Evaluation of Word Prediction Models
On other constructions, agreement accuracy was generally higher in languages with richer morphology.
Modeling Color Terminology Across Thousands of Languages
There is an extensive history of scholarship into what constitutes a "basic" color term, as well as a broadly attested acquisition sequence of basic color terms across many languages, as articulated in the seminal work of Berlin and Kay (1969).
Quantity doesn't buy quality syntax with neural language models
We investigate to what extent these shortcomings can be mitigated by increasing the size of the network and the corpus on which it is trained.