MetaTOC stay on top of your field, easily

Agreement Lambda for Weighted Disagreement With Ordinal Scales: Correction for Category Prevalence

Educational and Psychological Measurement

Published online on

Abstract

Educational and Psychological Measurement, Volume 86, Issue 3, Page 484-524, June 2026.
Weighted inter-rater agreement allows for differentiation between levels of disagreement among rating categories and is especially useful when there is an ordinal relationship between categories. Many existing weighted inter-rater agreement coefficients ...