Search Results for author: Deuk Sin Kwon

Found 4 papers, 1 papers with code

BECEL: Benchmark for Consistency Evaluation of Language Models

1 code implementation COLING 2022 Myeongjun Jang, Deuk Sin Kwon, Thomas Lukasiewicz

Behavioural consistency is a critical condition for a language model (LM) to become trustworthy like humans.

Language Modelling

KOBEST: Korean Balanced Evaluation of Significant Tasks

no code implementations COLING 2022 Dohyeong Kim, Myeongjun Jang, Deuk Sin Kwon, Eric Davis

To this end, we propose a new benchmark named Korean balanced evaluation of significant tasks (KoBEST), which consists of five Korean-language downstream tasks.

Accurate, yet inconsistent? Consistency Analysis on Language Understanding Models

no code implementations15 Aug 2021 Myeongjun Jang, Deuk Sin Kwon, Thomas Lukasiewicz

Consistency, which refers to the capability of generating the same predictions for semantically similar contexts, is a highly desirable property for a sound language understanding model.

Paraphrase Identification

Cannot find the paper you are looking for? You can Submit a new open access paper.