1 code implementation • 8 May 2024 • Ana Brassard, Benjamin Heinzerling, Keito Kudo, Keisuke Sakaguchi, Kentaro Inui
We further quantified this difference by comparing the correlation between LLM-generated ratings with majority-voted human ratings across different quality aspects.
1 code implementation • 2 Aug 2023 • Yunmeng Li, Jun Suzuki, Makoto Morishita, Kaori Abe, Ryoko Tokuhisa, Ana Brassard, Kentaro Inui
In this paper, we describe the development of a communication support system that detects erroneous translations to facilitate crosslingual communications due to the limitations of current machine chat translation methods.
no code implementations • EACL 2023 • Pride Kavumba, Ana Brassard, Benjamin Heinzerling, Kentaro Inui
Explanation prompts ask language models to not only assign a particular label to a giveninput, such as true, entailment, or contradiction in the case of natural language inference but also to generate a free-text explanation that supports this label.
Ranked #1 on Natural Language Inference on ANLI test
1 code implementation • 16 Feb 2023 • Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Ana Brassard, Masashi Yoshikawa, Keisuke Sakaguchi, Kentaro Inui
Neural reasoning accuracy improves when generating intermediate reasoning steps.
1 code implementation • 15 Feb 2023 • Keito Kudo, Yoichi Aoki, Tatsuki Kuribayashi, Ana Brassard, Masashi Yoshikawa, Keisuke Sakaguchi, Kentaro Inui
Compositionality is a pivotal property of symbolic reasoning.
1 code implementation • 23 May 2022 • Tatsuki Kuribayashi, Yohei Oseki, Ana Brassard, Kentaro Inui
Language models (LMs) have been used in cognitive modeling as well as engineering studies -- they compute information-theoretic complexity metrics that simulate humans' cognitive load during reading.
1 code implementation • LREC 2022 • Ana Brassard, Benjamin Heinzerling, Pride Kavumba, Kentaro Inui
We present Semi-Structured Explanations for COPA (COPA-SSE), a new crowdsourced dataset of 9, 747 semi-structured, English common sense explanations for Choice of Plausible Alternatives (COPA) questions.
no code implementations • NAACL 2021 • Pride Kavumba, Benjamin Heinzerling, Ana Brassard, Kentaro Inui
Here, we propose to explicitly learn a model that does well on both the easy test set with superficial cues and hard test set without superficial cues.
1 code implementation • WS 2019 • Takumi Ito, Tatsuki Kuribayashi, Hayato Kobayashi, Ana Brassard, Masato Hagiwara, Jun Suzuki, Kentaro Inui
The writing process consists of several stages such as drafting, revising, editing, and proofreading.
no code implementations • SEMEVAL 2018 • Ana Brassard, Tin Kuculo, Filip Boltu{\v{z}}i{\'c}, Jan {\v{S}}najder
This paper describes our system for the SemEval-2018 Task 12: Argument Reasoning Comprehension Task.