Improvements and limitations in developing multivariate models of hemorrhage and transfusion risk for the obstetric population

Abstract

Background: Maternal hemorrhage protocols involve risk screening. These protocols prepare clinicians for potential hemorrhage and transfusion in individual patients. Patient-specific estimation and stratification of risk may improve maternal outcomes.

Study design and methods: Prediction models for hemorrhage and transfusion were trained and tested in a data set of 74 variables from 63 973 deliveries (97.6% of the source population of 65 560 deliveries included in a perinatal database from an academic urban delivery center) with sufficient data at pertinent time points: antepartum, peripartum, and postpartum. Hemorrhage and transfusion were present in 6% and 1.6% of deliveries, respectively. Model performance was evaluated with the receiver operating characteristic (ROC), precision-recall curves, and the Hosmer-Lemeshow calibration statistic.

Results: For hemorrhage risk prediction, logistic regression model discrimination showed ROCs of 0.633, 0.643, and 0.661 for the antepartum, peripartum, and postpartum models, respectively. These improve upon the California Maternal Quality Care Collaborative (CMQCC) accuracy of 0.613 for hemorrhage. Predictions of transfusion resulted in ROCs of 0.806, 0.822, and 0.854 for the antepartum, peripartum, and postpartum models, respectively. Previously described and new risk factors were identified. Models were not well calibrated with Hosmer-Lemeshow statistic P values between .001 and .6.

Conclusions: Our models improve on existing risk assessment; however, further enhancement might require the inclusion of more granular, dynamic data. With the goal of increasing translatability, this work was distilled to an online open-source repository, including a form allowing risk factor inputs and outputs of CMQCC risk, alongside our numerical risk estimation and stratification of hemorrhage and transfusion.

Keywords: CMQCC; MOMI database; antepartum; logistic regression; maternal hemorrhage; peripartum; postpartum; risk prediction.