no code implementations • 26 Jun 2023 • Damrin Kim, NamHyeok Kim, Chanjun Park, Harksoo Kim
This paper presents a novel approach of leveraging Inter-Annotator Agreement (IAA), traditionally used for assessing labeling consistency, to optimize Data Management Operations (DMOps).
no code implementations • 26 Jun 2023 • NamHyeok Kim, Chanjun Park
Inter-Annotator Agreement (IAA) is commonly used as a measure of label consistency in natural language processing tasks.