Search Results for author: John Lalor

Found 2 papers, 1 papers with code

Clustering Examples in Multi-Dataset Benchmarks with Item Response Theory

no code implementations insights (ACL) 2022 Pedro Rodriguez, Phu Mon Htut, John Lalor, João Sedoc

In natural language processing, multi-dataset benchmarks for common tasks (e. g., SuperGLUE for natural language inference and MRQA for question answering) have risen in importance.

Clustering Natural Language Inference +1

Benchmarking Intersectional Biases in NLP

1 code implementation NAACL 2022 John Lalor, Yi Yang, Kendall Smith, Nicole Forsgren, Ahmed Abbasi

While much work has highlighted biases embedded in state-of-the-art language models, and more recent efforts have focused on how to debias, research assessing the fairness and performance of biased/debiased models on downstream prediction tasks has been limited.

Benchmarking BIG-bench Machine Learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.