2 x 2 kappa coefficients: measures of agreement or association

Abstract

Two general but different contexts in which kappa might be used are defined: agreement and association. Two models, one for agreement and one for utility of association, are defined yielding different kappa coefficients and different sampling theory. Asymptotic results are derived for both models. Small-sample evaluations are presented for the model for agreement.