no code implementations • BioNLP (ACL) 2022 • Russell Richie, Sachin Grover, Fuchiang (Rich) Tsui
It is commonly claimed that inter-annotator agreement (IAA) is the ceiling of machine learning (ML) performance, i. e., that the agreement between an ML system’s predictions and an annotator can not be higher than the agreement between two annotators.