Inter-Coder Agreement for Computational
โ
Artstein, Ron; Poesio, Massimo
๐
Article
๐
2008
๐
MIT Press
๐
English
โ 329 KB
This article is a survey of methods for measuring agreement among corpus annotators. It exposes the mathematics and underlying assumptions of agreement coefficients, covering Krippendorff's alpha as well as Scott's pi and Cohen's kappa; discusses the use of coefficients in several annotation tasks;