Statistical approaches using longitudinal biomarkers for disease early detection: A comparison of methodologies

Abstract

Early detection of clinical outcomes such as cancer may be predicted using longitudinal biomarker measurements. Tracking longitudinal biomarkers as a way to identify early disease onset may help to reduce mortality from diseases like ovarian cancer that are more treatable if detected early. Two disease risk prediction frameworks, the shared random effects model (SREM) and the pattern mixture model (PMM) could be used to assess longitudinal biomarkers on disease early detection. In this article, we studied the discrimination and calibration performances of SREM and PMM on disease early detection through an application to ovarian cancer, where early detection using the risk of ovarian cancer algorithm (ROCA) has been evaluated. Comparisons of the above three approaches were performed via analyses of the ovarian cancer data from the Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial. Discrimination was evaluated by the time-dependent receiver operating characteristic curve and its area, while calibration was assessed using calibration plot and the ratio of observed to expected number of diseased subjects. The out-of-sample performances were calculated via using leave-one-out cross-validation, aiming to minimize potential model overfitting. A careful analysis of using the biomarker cancer antigen 125 for ovarian cancer early detection showed significantly improved discrimination performance of PMM as compared with SREM and ROCA, nevertheless all approaches were generally well calibrated. Robustness of all approaches was further investigated in extensive simulation studies. The improved performance of PMM relative to ROCA is in part due to the fact that the biomarker measurements were taken at a yearly interval, which is not frequent enough to reliably estimate the changepoint or the slope after changepoint in cases under ROCA.

Keywords: disease early detection; pattern mixture model; risk of ovarian cancer algorithm; shared random effects model; time-dependent AUC.

FIGURE 1

CA-125 trajectories of 50 cases and 50 controls that were randomly selected from the PLCO cancer screening trial

FIGURE 2

A, Time-dependent AUCs. B, Calibration plots. C, Predictiveness curves for ROCA (ROCA-CS2-CN3), PMM (PMM-CN3), and SREM in the PLCO ovarian cancer data example