Search Results for author: Juhyun Oh

Found 5 papers, 3 papers with code

Uncovering Factor Level Preferences to Improve Human-Model Alignment

no code implementations9 Oct 2024 Juhyun Oh, Eunsu Kim, Jiseon Kim, Wenda Xu, Inha Cha, William Yang Wang, Alice Oh

Our factor level analysis reveals a substantial discrepancy between human and LLM preferences in generation tasks, whereas LLMs show strong alignment with human preferences in evaluation tasks.

Language Modelling Large Language Model +2

Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScore

1 code implementation28 Feb 2024 Sheikh Shafayat, Eunsu Kim, Juhyun Oh, Alice Oh

Evaluating the factuality of long-form large language model (LLM)-generated text is an important challenge.

Diversity Form +5

The Generative AI Paradox on Evaluation: What It Can Solve, It May Not Evaluate

no code implementations9 Feb 2024 Juhyun Oh, Eunsu Kim, Inha Cha, Alice Oh

This paper explores the assumption that Large Language Models (LLMs) skilled in generation tasks are equally adept as evaluators.

Question Answering TriviaQA

KOLD: Korean Offensive Language Dataset

1 code implementation23 May 2022 Younghoon Jeong, Juhyun Oh, Jaimeen Ahn, Jongwon Lee, Jihyung Moon, Sungjoon Park, Alice Oh

Recent directions for offensive language detection are hierarchical modeling, identifying the type and the target of offensive language, and interpretability with offensive span annotation and prediction.

Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.