A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains

no code implementations • 1 Feb 2024 • Alon Jacovi, Yonatan Bitton, Bernd Bohnet, Jonathan Herzig, Or Honovich, Michael Tseng, Michael Collins, Roee Aharoni, Mor Geva

REVEAL includes comprehensive labels for the relevance, attribution to evidence passages, and logical correctness of each reasoning step in a language model's answer, across a variety of datasets and state-of-the-art language models.

Open-Domain Question Answering

Points, Paths, and Playscapes: Large-scale Spatial Language Understanding Tasks Set in the Real World

no code implementations • WS 2018 • Jason Baldridge, Tania Bedrax-Weiss, Daphne Luong, Srini Narayanan, Bo Pang, Fernando Pereira, Radu Soricut, Michael Tseng, Yuan Zhang

Natural Language Understanding Sentence

Community-Driven Crowdsourcing: Data Collection with Local Developers

no code implementations • LREC 2018 • Christina Funk, Michael Tseng, Ravindran Rajakumar, Linne Ha