COPA (Choice of Plausible Alternatives)

Introduced by Melissa Roemmele et al. in Choice of Plausible Alternatives: An Evaluation of Commonsense Causal Reasoning

The Choice Of Plausible Alternatives (COPA) evaluation provides researchers with a tool for assessing progress in open-domain commonsense causal reasoning. COPA consists of 1000 questions, split equally into development and test sets of 500 questions each. Each question is composed of a premise and two alternatives, where the task is to select the alternative that more plausibly has a causal relation with the premise. The correct alternative is randomized so that the expected performance of randomly guessing is 50%.

Source: Choice of Plausible Alternatives (COPA)


Paper Code Results Date Stars

Dataset Loaders


Similar Datasets