Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2020 Nov 2;18(1):302.
doi: 10.1186/s12916-020-01766-9.

External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis

Collaborators, Affiliations
Meta-Analysis

External validation of prognostic models predicting pre-eclampsia: individual participant data meta-analysis

Kym I E Snell et al. BMC Med. .

Abstract

Background: Pre-eclampsia is a leading cause of maternal and perinatal mortality and morbidity. Early identification of women at risk during pregnancy is required to plan management. Although there are many published prediction models for pre-eclampsia, few have been validated in external data. Our objective was to externally validate published prediction models for pre-eclampsia using individual participant data (IPD) from UK studies, to evaluate whether any of the models can accurately predict the condition when used within the UK healthcare setting.

Methods: IPD from 11 UK cohort studies (217,415 pregnant women) within the International Prediction of Pregnancy Complications (IPPIC) pre-eclampsia network contributed to external validation of published prediction models, identified by systematic review. Cohorts that measured all predictor variables in at least one of the identified models and reported pre-eclampsia as an outcome were included for validation. We reported the model predictive performance as discrimination (C-statistic), calibration (calibration plots, calibration slope, calibration-in-the-large), and net benefit. Performance measures were estimated separately in each available study and then, where possible, combined across studies in a random-effects meta-analysis.

Results: Of 131 published models, 67 provided the full model equation and 24 could be validated in 11 UK cohorts. Most of the models showed modest discrimination with summary C-statistics between 0.6 and 0.7. The calibration of the predicted compared to observed risk was generally poor for most models with observed calibration slopes less than 1, indicating that predictions were generally too extreme, although confidence intervals were wide. There was large between-study heterogeneity in each model's calibration-in-the-large, suggesting poor calibration of the predicted overall risk across populations. In a subset of models, the net benefit of using the models to inform clinical decisions appeared small and limited to probability thresholds between 5 and 7%.

Conclusions: The evaluated models had modest predictive performance, with key limitations such as poor calibration (likely due to overfitting in the original development datasets), substantial heterogeneity, and small net benefit across settings. The evidence to support the use of these prediction models for pre-eclampsia in clinical decision-making is limited. Any models that we could not validate should be examined in terms of their predictive performance, net benefit, and heterogeneity across multiple UK settings before consideration for use in practice.

Trial registration: PROSPERO ID: CRD42015029349 .

Keywords: External validation; Individual participant data; Pre-eclampsia; Prediction model.

PubMed Disclaimer

Conflict of interest statement

The authors disclose support from NIHR HTA for the submitted work. LCC reports being Chair of the HTA CET Committee from January 2019. AK reports being a member of the NIHR HTA board. BWM reports grants from Merck; personal fees from OvsEva, Merck, and Guerbet; and other from NHMRC, Guerbet, and Merch, outside the submitted work. GS reports grants and personal fees from GlaxoSmithKline Research and Development Limited, grants from Sera Prognostics Inc., non-financial support from Illumina Inc., and personal fees and non-financial support from Roche Diagnostics Ltd., outside the submitted work. JK reports personal fees from Roche Canada, outside the submitted work. JM reports grants from National Health Research and Development Program, Health and Welfare Canada, during the conduct of the study. JEN reports grants from Chief Scientist Office Scotland, other from GlaxoSmithKline and Dilafor, outside the submitted work. AG reports personal fees from Roche Diagnostics, outside the submitted work. IH reports personal fees from Roche Diagnostics and Thermo Fisher, outside the submitted work. RR reports personal fees from the BMJ, Roche, and Universities of Leeds, Edinburgh, and Exeter, outside the submitted work.

Figures

Fig. 1
Fig. 1
Identification of prediction models for validation in IPPIC-UK cohorts
Fig. 2
Fig. 2
Calibration plots for clinical characteristic and biomarker models predicting any-onset pre-eclampsia (cohorts with ≥ 100 events)
Fig. 3
Fig. 3
Decision curves for models of any-onset pre-eclampsia

Similar articles

Cited by

  • Understanding the Pathophysiology of Preeclampsia: Exploring the Role of Antiphospholipid Antibodies and Future Directions.
    Mitranovici MI, Chiorean DM, Moraru R, Moraru L, Caravia L, Tiron AT, Craina M, Cotoi OS. Mitranovici MI, et al. J Clin Med. 2024 May 2;13(9):2668. doi: 10.3390/jcm13092668. J Clin Med. 2024. PMID: 38731197 Free PMC article. Review.
  • Development and validation of a prognostic model to predict birth weight: individual participant data meta-analysis.
    Allotey J, Archer L, Snell KIE, Coomar D, Massé J, Sletner L, Wolf H, Daskalakis G, Saito S, Ganzevoort W, Ohkuchi A, Mistry H, Farrar D, Mone F, Zhang J, Seed PT, Teede H, Da Silva Costa F, Souka AP, Smuk M, Ferrazzani S, Salvi S, Prefumo F, Gabbay-Benziv R, Nagata C, Takeda S, Sequeira E, Lapaire O, Cecatti JG, Morris RK, Baschat AA, Salvesen K, Smits L, Anggraini D, Rumbold A, van Gelder M, Coomarasamy A, Kingdom J, Heinonen S, Khalil A, Goffinet F, Haqnawaz S, Zamora J, Riley RD, Thangaratinam S; International Prediction of Pregnancy Complications collaborative network; Kwong A, Savitri AI, Bhattacharya S, Uiterwaal CS, Staff AC, Andersen LB, Olive EL, Redman C, Macleod M, Thilaganathan B, Ramírez JA, Audibert F, Magnus PM, Jenum AK, McAuliffe FM, West J, Askie LM, Zimmerman PA, Riddell C, van de Post J, Illanes SE, Holzman C, van Kuijk SMJ, Carbillon L, Villa PM, Eskild A, Chappell L, Velauthar L, van Oostwaard M, Verlohren S, Poston L, Ferrazzi E, Vinter CA, Brown M, Vollebregt KC, Langenveld J, Widmer M, Haavaldsen C, Carroli G, Olsen J, Zavaleta N, Eisensee I, Vergani P, Lumbiganon P, Makrides M, Facchinetti F, Temmerman M, Gibson R, Frusca T, Norman JE, Figueiró-Filho EA,… See abstract for full author list ➔ Allotey J, et al. BMJ Med. 2024 Aug 14;3(1):e000784. doi: 10.1136/bmjmed-2023-000784. eCollection 2024. BMJ Med. 2024. PMID: 39184566 Free PMC article.
  • Prediction and prevention of preeclampsia by physicians in Brazil: An original study.
    da Cunha Filho EV, Rodrigues TCGF, Sandrim VC, Veiga ECA, Cavalli RC. da Cunha Filho EV, et al. Front Glob Womens Health. 2022 Oct 19;3:983131. doi: 10.3389/fgwh.2022.983131. eCollection 2022. Front Glob Womens Health. 2022. PMID: 36337683 Free PMC article.
  • Development and validation of prediction models for fetal growth restriction and birthweight: an individual participant data meta-analysis.
    Allotey J, Archer L, Coomar D, Snell KI, Smuk M, Oakey L, Haqnawaz S, Betrán AP, Chappell LC, Ganzevoort W, Gordijn S, Khalil A, Mol BW, Morris RK, Myers J, Papageorghiou AT, Thilaganathan B, Da Silva Costa F, Facchinetti F, Coomarasamy A, Ohkuchi A, Eskild A, Arenas Ramírez J, Galindo A, Herraiz I, Prefumo F, Saito S, Sletner L, Cecatti JG, Gabbay-Benziv R, Goffinet F, Baschat AA, Souza RT, Mone F, Farrar D, Heinonen S, Salvesen KÅ, Smits LJ, Bhattacharya S, Nagata C, Takeda S, van Gelder MM, Anggraini D, Yeo S, West J, Zamora J, Mistry H, Riley RD, Thangaratinam S. Allotey J, et al. Health Technol Assess. 2024 Aug;28(47):1-119. doi: 10.3310/DABW4814. Health Technol Assess. 2024. PMID: 39252507 Free PMC article.
  • Development and validation of an interpretable longitudinal preeclampsia risk prediction using machine learning.
    Eberhard BW, Cohen RY, Wheeler N, Kleinlein R, Rigoni J, Bates DW, Gray KJ, Kovacheva VP. Eberhard BW, et al. PLoS One. 2025 Jun 10;20(6):e0323873. doi: 10.1371/journal.pone.0323873. eCollection 2025. PLoS One. 2025. PMID: 40493626 Free PMC article.

References

    1. Cantwell R, Clutton-Brock T, Cooper G, Dawson A, Drife J, Garrod D, et al. Saving mothers’ lives: reviewing maternal deaths to make motherhood safer: 2006-2008. The Eighth Report of the Confidential Enquiries into Maternal Deaths in the United Kingdom. BJOG. 2011;118(Suppl 1):1–203. - PubMed
    1. Ng VK, Lo TK, Tsang HH, Lau WL, Leung WC. Intensive care unit admission of obstetric cases: a single centre experience with contemporary update. Hong Kong Med J. 2014;20(1):24–31. - PubMed
    1. Kleinrouweler CE, Cheong-See Mrcog FM, Collins GS, Kwee A, Thangaratinam S, Khan KS, et al. Prognostic models in obstetrics: available, but far from applicable. Am J Obstet Gynecol. 2016;214(1):79–90.e36. - PubMed
    1. Herraiz I, Arbues J, Camano I, Gomez-Montes E, Graneras A, Galindo A. Application of a first-trimester prediction model for pre-eclampsia based on uterine arteries and maternal history in high-risk pregnancies. Prenat Diagn. 2009;29(12):1123–1129. doi: 10.1002/pd.2383. - DOI - PubMed
    1. Farina A, Rapacchia G, Freni Sterrantino A, Pula G, Morano D, Rizzo N. Prospective evaluation of ultrasound and biochemical-based multivariable models for the prediction of late pre-eclampsia. Prenat Diagn. 2011;31(12):1147–1152. doi: 10.1002/pd.2849. - DOI - PubMed

Publication types