Evaluating and Characterizing Human Rationales

1 code implementation • EMNLP 2020 • Samuel Carton, Anirudh Rathore, Chenhao Tan

Two main approaches for evaluating the quality of machine-generated rationales are: 1) using human rationales as a gold standard; and 2) automated metrics based on how rationales affect model behavior.

Open-Ended Question Answering