Cohen’s Kappa: Rater Agreement
Inter-rater agreement in R with Cohen’s kappa (irr package) — how much two raters agree beyond chance.
When two raters classify the same items, how much do they really agree?
Run the code
Everything in the video — edit it and press Run Code to run real R right here, or copy it:
Download this R script · ▶ Open the full playground
When to use it. Use kappa to quantify agreement corrected for chance: 0 is chance-level, 1 is perfect; above ~0.6 is usually considered good agreement.
Try the Cohen’s kappa calculator.