Measuring agreement between two judges on the presence or absence of a trait
- PMID: 1174623
Item in Clipboard
Measuring agreement between two judges on the presence or absence of a trait
Biometrics.
1975 Sep.
Abstract
At least a dozen indexes have been proposed for measuring agreement between two judges on a categorical scale. Using the binary (positive-negative) case as a model, this paper presents and critically evaluates some of these proposed measures. The importance of correcting for chance-expected agreement is emphasized, and identities with intraclass correlation coefficients are pointed out.
Similar articles
-
A generalized concordance correlation coefficient for continuous and categorical data.Stat Med. 2001 Jul 30;20(14):2131-47. doi: 10.1002/sim.845. Stat Med. 2001. PMID: 11439426
-
Identification of children's stuttered and nonstuttered speech by highly experienced judges: binary judgments and comparisons with disfluency-types definitions.J Speech Lang Hear Res. 2008 Aug;51(4):867-78. doi: 10.1044/1092-4388(2008/063). J Speech Lang Hear Res. 2008. PMID: 18658057
-
[Measuring agreement between 2 observers: a quantitative case].Rev Epidemiol Sante Publique. 1984;32(6):408-13. Rev Epidemiol Sante Publique. 1984. PMID: 6531504 French.
-
Agreement measurement and the judgment process.J Nerv Ment Dis. 1979 Jun;167(6):343-7. doi: 10.1097/00005053-197906000-00003. J Nerv Ment Dis. 1979. PMID: 376781 Review.
-
Determinants of linear judgment: a meta-analysis of lens model studies.Psychol Bull. 2008 May;134(3):404-26. doi: 10.1037/0033-2909.134.3.404. Psychol Bull. 2008. PMID: 18444703 Review.
Cited by
-
Immunological assays employed for the elucidation of an histoplasmosis outbreak in São Paulo, SP.Braz J Microbiol. 2015 Mar 4;45(4):1357-61. doi: 10.1590/s1517-83822014000400028. eCollection 2014. Braz J Microbiol. 2015. PMID: 25763041 Free PMC article.
-
Individual and joint expert judgments as reference standards in artifact detection.J Am Med Inform Assoc. 2008 Mar-Apr;15(2):227-34. doi: 10.1197/jamia.M2493. Epub 2007 Dec 20. J Am Med Inform Assoc. 2008. PMID: 18096912 Free PMC article.
-
Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: A Simulation Study and Debate on Delphi Design and Interpretation.PLoS One. 2015 Aug 13;10(8):e0135162. doi: 10.1371/journal.pone.0135162. eCollection 2015. PLoS One. 2015. PMID: 26270647 Free PMC article.
-
Users' guide to the surgical literature: how to use a systematic literature review and meta-analysis.Can J Surg. 2004 Feb;47(1):60-7. Can J Surg. 2004. PMID: 14997929 Free PMC article. No abstract available.
-
Pharmacokinetic observations on piroxicam in young adult, middle-aged and elderly patients.Br J Clin Pharmacol. 1983 Oct;16(4):433-7. doi: 10.1111/j.1365-2125.1983.tb02191.x. Br J Clin Pharmacol. 1983. PMID: 6626437 Free PMC article.