Summary ROC curve based on a weighted Youden index for selecting an optimal cutpoint in meta-analysis of diagnostic accuracy
- PMID: 21170902
- DOI: 10.1002/sim.3937
Summary ROC curve based on a weighted Youden index for selecting an optimal cutpoint in meta-analysis of diagnostic accuracy
Abstract
Established approaches for analyzing meta-analyses of diagnostic accuracy model the bivariate distribution of the observed pairs of specificity Sp and sensitivity Se, thus accounting for across-study correlation. However, it is still a matter of debate how to define a summary ROC (SROC) curve. It was recently pointed out that the SROC curve is in principle unidentifiable if only one (Sp, Se) pair per study is known. We evaluate an alternative approach, modeling the study-specific ROC curves based on the assumption of linearity in logit space. A setting is considered in which the pair (Sp, Se) that is selected for publication in a particular study maximizes a weighted Youden index λSe+(1-λ)Sp with a given weight λ.This leads to a fixed slope (1-λ)/λ of the ROC curve in (1-Sp, Se), equivalent to a slope of (1-λ)Sp(1-Sp)/(λSe(1-Se)) for the corresponding straight line in logit space. While the slope depends on the variance ratio of the underlying distributions, the intercept is a function of the mean difference. Our approach leads in a natural way to a new, model-based proposal for a summary ROC curve. It is illustrated using an example from the literature.
Copyright © 2010 John Wiley & Sons, Ltd.
Similar articles
-
Bivariate random effects meta-analysis of ROC curves.Med Decis Making. 2008 Sep-Oct;28(5):621-38. doi: 10.1177/0272989X08319957. Epub 2008 Jun 30. Med Decis Making. 2008. PMID: 18591542
-
Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews.J Clin Epidemiol. 2005 Oct;58(10):982-90. doi: 10.1016/j.jclinepi.2005.02.022. J Clin Epidemiol. 2005. PMID: 16168343 Review.
-
Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis.J Clin Epidemiol. 2004 Sep;57(9):925-32. doi: 10.1016/j.jclinepi.2003.12.019. J Clin Epidemiol. 2004. PMID: 15504635
-
The partial area under the summary ROC curve.Stat Med. 2005 Jul 15;24(13):2025-40. doi: 10.1002/sim.2103. Stat Med. 2005. PMID: 15900606
-
Measuring diagnostic and predictive accuracy in disease management: an introduction to receiver operating characteristic (ROC) analysis.J Eval Clin Pract. 2006 Apr;12(2):132-9. doi: 10.1111/j.1365-2753.2005.00598.x. J Eval Clin Pract. 2006. PMID: 16579821 Review.
Cited by
-
Diagnostic accuracy of ascitic cholesterol concentration for malignant ascites: a meta-analysis.Int J Clin Exp Med. 2015 Oct 15;8(10):18494-9. eCollection 2015. Int J Clin Exp Med. 2015. PMID: 26770458 Free PMC article.
-
Assessment of fluid responsiveness using pulse pressure variation, stroke volume variation, plethysmographic variability index, central venous pressure, and inferior vena cava variation in patients undergoing mechanical ventilation: a systematic review and meta-analysis.Crit Care. 2024 Aug 31;28(1):289. doi: 10.1186/s13054-024-05078-9. Crit Care. 2024. PMID: 39217370 Free PMC article.
-
Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies.BMC Med Res Methodol. 2016 Aug 12;16(1):97. doi: 10.1186/s12874-016-0196-1. BMC Med Res Methodol. 2016. PMID: 27520527 Free PMC article.
-
Association between Low-density lipoprotein cholesterol and occipital periventricular hyperintensities in a group of Chinese patients: an observational study.Lipids Health Dis. 2017 Feb 27;16(1):48. doi: 10.1186/s12944-017-0436-3. Lipids Health Dis. 2017. PMID: 28241772 Free PMC article.
-
Diagnostic Accuracy of Fecal Calprotectin for Predicting Relapse in Inflammatory Bowel Disease: A Meta-Analysis.J Clin Med. 2023 Feb 2;12(3):1206. doi: 10.3390/jcm12031206. J Clin Med. 2023. PMID: 36769850 Free PMC article. Review.