Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 6, 2021
Date Accepted: Jun 13, 2022

The final, peer-reviewed published version of this preprint can be found here:

Prediction of Maternal Hemorrhage Using Machine Learning: Retrospective Cohort Study

Westcott JM, Hughes F, Liu W, Grivainis M, Hoskins I, Fenyo D

Prediction of Maternal Hemorrhage Using Machine Learning: Retrospective Cohort Study

J Med Internet Res 2022;24(7):e34108

DOI: 10.2196/34108

PMID: 35849436

PMCID: 9345059

Prediction of Maternal Hemorrhage: Using Machine Learning to Identify Patients at Risk

  • Jill M Westcott; 
  • Francine Hughes; 
  • Wenke Liu; 
  • Mark Grivainis; 
  • Iffath Hoskins; 
  • David Fenyo

ABSTRACT

Background:

Postpartum hemorrhage remains one of the largest causes of maternal morbidity and mortality in the United States.

Objective:

To utilize machine learning techniques to identify patients at risk for postpartum hemorrhage at obstetric delivery.

Methods:

Women aged 18 to 55 delivering at a major academic center from July 2013 to October 2018 were included for analysis (n = 30,867). A total of 497 variables were collected from the electronic medical record including demographic information, obstetric, medical, surgical, and family history, vital signs, laboratory results, labor medication exposures, and delivery outcomes. Postpartum hemorrhage was defined as a blood loss of ≥ 1000 mL at the time of delivery, regardless of delivery method, with 2179 positive cases observed (7.06%). Supervised learning with regression-, tree-, and kernel-based machine learning methods was used to create classification models based upon training (n = 21,606) and validation (n = 4,630) cohorts. Models were tuned using feature selection algorithms and domain knowledge. An independent test cohort (n = 4,631) determined final performance by assessing for accuracy, area under the receiver operating curve (AUC), and sensitivity for proper classification of postpartum hemorrhage. Separate models were created using all collected data versus limited to data available prior to the second stage of labor/at the time of decision to proceed with cesarean delivery. Additional models examined patients by mode of delivery.

Results:

Gradient boosted decision trees achieved the best discrimination in the overall model. The model including all data mildly outperformed the second stage model (AUC 0.979, 95% CI 0.971-0.986 vs. AUC 0.955, 95% CI 0.939-0.970). Optimal model accuracy was 98.1% with a sensitivity of 0.763 for positive prediction of postpartum hemorrhage. The second stage model achieved an accuracy of 98.0% with a sensitivity of 0.737. Other selected algorithms returned models that performed with decreased discrimination. Models stratified by mode of delivery achieved good to excellent discrimination, but lacked sensitivity necessary for clinical applicability.

Conclusions:

Machine learning methods can be used to identify women at risk for postpartum hemorrhage who may benefit from individualized preventative measures. Models limited to data available prior to delivery perform nearly as well as those with more complete datasets, supporting their potential utility in the clinical setting. Further work is necessary to create successful models based upon mode of delivery. An unbiased approach to hemorrhage risk prediction may be superior to human risk assessment and represents an area for future research.


 Citation

Please cite as:

Westcott JM, Hughes F, Liu W, Grivainis M, Hoskins I, Fenyo D

Prediction of Maternal Hemorrhage Using Machine Learning: Retrospective Cohort Study

J Med Internet Res 2022;24(7):e34108

DOI: 10.2196/34108

PMID: 35849436

PMCID: 9345059

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.