Search Results for author:
Found 21 papers, 13 papers with code
Vapur: A Search Engine to Find Related Protein - Compound Pairs in COVID-19 Literature
Coronavirus Disease of 2019 (COVID-19) created dire consequences globally and triggered an intense scientific effort from different domains.
How far can bias go? -- Tracing bias from pretraining data to alignment
Our findings reveal that biases present in pre-training data are amplified in model outputs.
Evaluating Morphological Compositional Generalization in Large Language Models
While humans exhibit compositional generalization and linguistic creativity in language use, the extent to which LLMs replicate these abilities, particularly in morphology, is under-explored.
MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions
Instruction tuning enhances large language models (LLMs) by aligning them with human preferences across diverse tasks.
CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation
Building high-quality datasets for specialized tasks is a time-consuming and resource-intensive process that often requires specialized domain knowledge.
SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists
In this work, we propose SYNTHEVAL, a hybrid behavioral testing framework that leverages large language models (LLMs) to generate a wide range of test types for a comprehensive evaluation of NLP models.
TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkish
These questions are written by curriculum experts, suitable for the high-school curricula in Turkey, covering subjects ranging from natural sciences and math questions to more culturally representative topics such as Turkish Literature and the history of the Turkish Republic.
Consistent Document-Level Relation Extraction via Counterfactuals
We first demonstrate that models trained on factual data exhibit inconsistent behavior: while they accurately extract triples from factual data, they fail to extract the same triples after counterfactual modification.
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory
While current large language models (LLMs) demonstrate some capabilities in knowledge-intensive tasks, they are limited by relying on their parameters as an implicit storage mechanism.
Hybrid Human-LLM Corpus Construction and LLM Evaluation for Rare Linguistic Phenomena
Argument Structure Constructions (ASCs) are one of the most well-studied construction groups, providing a unique opportunity to demonstrate the usefulness of Construction Grammar (CxG).
Hallucination Augmented Recitations for Language Models
For open book QA as a case study, we demonstrate that models finetuned with our counterfactual datasets improve text grounding, leading to better open book QA performance, with up to an 8. 0% increase in F1 score.
Language-Agnostic Bias Detection in Language Models with Bias Probing
For nationality as a case study, we show that LABDet `surfaces' nationality bias by training a classifier on top of a frozen PLM on non-nationality sentiment detection.
LongForm: Effective Instruction Tuning with Reverse Instructions
We generate instructions via LLMs for human-written corpus examples using reverse instructions.
Sociocultural knowledge is needed for selection of shots in hate speech detection tasks
We introduce HATELEXICON, a lexicon of slurs and targets of hate speech for the countries of Brazil, Germany, India and Kenya, to aid training and interpretability of models.
MEAL: Stable and Active Learning for Few-Shot Prompting
Few-shot classification has made great strides due to foundation models that, through priming and prompting, are highly effective few-shot learners.
The Better Your Syntax, the Better Your Semantics? Probing Pretrained Language Models for the English Comparative Correlative
Construction Grammar (CxG) is a paradigm from cognitive linguistics emphasising the connection between syntax and semantics.
SilverAlign: MT-Based Silver Data Algorithm For Evaluating Word Alignment
Word alignments are essential for a variety of NLP tasks.
Balancing Methods for Multi-label Text Classification with Long-Tailed Class Distribution
Here, we introduce the application of balancing loss functions for multi-label text classification.
Ranked #1 on
Multi-Label Text Classification
on Reuters-21578
The RELX Dataset and Matching the Multilingual Blanks for Cross-Lingual Relation Classification
Relation classification is one of the key topics in information extraction, which can be used to construct knowledge bases or to provide useful information for question answering.
Vapur: A Search Engine to Find Related Protein-Compound Pairs in COVID-19 Literature
Coronavirus Disease of 2019 (COVID-19) created dire consequences globally and triggered an intense scientific effort from different domains.
Resources for Turkish Dependency Parsing: Introducing the BOUN Treebank and the BoAT Annotation Tool
In addition, we report the parsing results of a state-of-the-art dependency parser obtained over the BOUN Treebank as well as two other treebanks in Turkish.
Cultural Vocal Bursts Intensity Prediction
Dependency Parsing
