Multireader multicase variance analysis for binary data
- PMID: 18059916
- DOI: 10.1364/josaa.24.000b70
Multireader multicase variance analysis for binary data
Abstract
Multireader multicase (MRMC) variance analysis has become widely utilized to analyze observer studies for which the summary measure is the area under the receiver operating characteristic (ROC) curve. We extend MRMC variance analysis to binary data and also to generic study designs in which every reader may not interpret every case. A subset of the fundamental moments central to MRMC variance analysis of the area under the ROC curve (AUC) is found to be required. Through multiple simulation configurations, we compare our unbiased variance estimates to naïve estimates across a range of study designs, average percent correct, and numbers of readers and cases.
Similar articles
-
The average receiver operating characteristic curve in multireader multicase imaging studies.Br J Radiol. 2014 Aug;87(1040):20140016. doi: 10.1259/bjr.20140016. Epub 2014 Jun 2. Br J Radiol. 2014. PMID: 24884728 Free PMC article.
-
One-shot estimate of MRMC variance: AUC.Acad Radiol. 2006 Mar;13(3):353-62. doi: 10.1016/j.acra.2005.11.030. Acad Radiol. 2006. PMID: 16488848
-
Multireader multicase reader studies with binary agreement data: simulation, analysis, validation, and sizing.J Med Imaging (Bellingham). 2014 Oct;1(3):031011. doi: 10.1117/1.JMI.1.3.031011. Epub 2014 Dec 4. J Med Imaging (Bellingham). 2014. PMID: 26158051 Free PMC article.
-
Multireader, multicase receiver operating characteristic analysis: an empirical comparison of five methods.Acad Radiol. 2004 Sep;11(9):980-95. doi: 10.1016/j.acra.2004.04.014. Acad Radiol. 2004. PMID: 15350579
-
Multireader Diagnostic Accuracy Imaging Studies: Fundamentals of Design and Analysis.Radiology. 2022 Apr;303(1):26-34. doi: 10.1148/radiol.211593. Epub 2022 Feb 15. Radiology. 2022. PMID: 35166584 Review.
Cited by
-
Impact of prevalence and case distribution in lab-based diagnostic imaging studies.J Med Imaging (Bellingham). 2019 Jan;6(1):015501. doi: 10.1117/1.JMI.6.1.015501. Epub 2019 Jan 21. J Med Imaging (Bellingham). 2019. PMID: 30713851 Free PMC article.
-
Relationship between Roe and Metz simulation model for multireader diagnostic data and Obuchowski-Rockette model parameters.Stat Med. 2018 Jun 15;37(13):2067-2093. doi: 10.1002/sim.7616. Epub 2018 Apr 2. Stat Med. 2018. PMID: 29609206 Free PMC article.
-
Artificial Intelligence Empowers Novice Users to Acquire Diagnostic-Quality Echocardiography.JACC Adv. 2025 Jul 22;4(8):102005. doi: 10.1016/j.jacadv.2025.102005. Online ahead of print. JACC Adv. 2025. PMID: 40700992 Free PMC article.
-
Generalized Roe and Metz receiver operating characteristic model: analytic link between simulated decision scores and empirical AUC variances and covariances.J Med Imaging (Bellingham). 2014 Oct;1(3):031006. doi: 10.1117/1.JMI.1.3.031006. Epub 2014 Sep 25. J Med Imaging (Bellingham). 2014. PMID: 26158048 Free PMC article.
-
In silico imaging clinical trials: cheaper, faster, better, safer, and more scalable.Trials. 2021 Jan 19;22(1):64. doi: 10.1186/s13063-020-05002-w. Trials. 2021. PMID: 33468186 Free PMC article.
LinkOut - more resources
Full Text Sources