Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jun 12, 2023
Date Accepted: Apr 2, 2024

The final, peer-reviewed published version of this preprint can be found here:

Development and Validation of an Explainable Deep Learning Model to Predict In-Hospital Mortality for Patients With Acute Myocardial Infarction: Algorithm Development and Validation Study

Xie P, Wang H, Xiao J, Xu F, Liu J, Chen Z, Zhao W, Hou S, Wu D, Ma Y, Xiao J

Development and Validation of an Explainable Deep Learning Model to Predict In-Hospital Mortality for Patients With Acute Myocardial Infarction: Algorithm Development and Validation Study

J Med Internet Res 2024;26:e49848

DOI: 10.2196/49848

PMID: 38728685

PMCID: 11127140

Development and Validation of An Explainable Deep Learning Model to Predict In-hospital Mortality for Patients with Acute Myocardial Infarction: A Multicentre Study

  • Puguang Xie; 
  • Hao Wang; 
  • Jun Xiao; 
  • Fan Xu; 
  • Jingyang Liu; 
  • Zihang Chen; 
  • Weijie Zhao; 
  • Siyu Hou; 
  • Dongdong Wu; 
  • Yu Ma; 
  • Jingjing Xiao

ABSTRACT

Background:

Acute myocardial infarction (AMI) is one of the most severe cardiovascular diseases and is associated with high risk of in-hospital mortality. However, the current deep learning models for in-hospital mortality prediction are lack of interpretability.

Objective:

This study aimed to establish an explainable deep learning model to provide individualized in-hospital mortality prediction and risk factor assessment in patients with AMI.

Methods:

In this retrospective multicentre study, we used data for consecutive patients hospitalized with AMI from Chongqing University Central Hospital between July 2016 and December 2022 and eICU Collaborative Research Database (eICU-CRD). These patients were randomly divided into training (70%) and internal testing (30%) datasets. In addition, patients with AMI from Medical Information Mart for Intensive Care (MIMIC-IV) database were used for external validation. Deep learning models were used to predict in-hospital mortality in patients with AMI, and compared with linear and tree-based models. The SHapley Additive exPlanations (SHAP) method was utilized to explain the best-performing model to quantify and visualize the features that drive predictions.

Results:

11,055 patients with AMI who were admitted to Chongqing University Central Hospital or included in the eICU-CRD were randomly divided into a training dataset of 7,668 (70%) patients and a testing dataset of 3,287 (30%) patients. 9,355 patients from MIMIC-IV database were used for independent external validation. In-hospital mortality occurred in 670 (8.7%), 287 (8.7%), and 853 (9.1%) patients in the training, test, and external validation cohorts, respectively. The Self-Attention and Intersample Attention Transformer (SAINT) model performed best in both the test set and the external validation set among the 9 prediction models, with the highest AUC of 0.86 (95% CI 0.84, 0.88) and 0.85 (95% CI 0.84, 0.87), respectively. Older age, high heart rate, and low body temperature were the three most important predictors of increased mortality, according to the explanations of the SAINT model.

Conclusions:

The developed explainable deep learning model could provide estimates of mortality and visual contribution of the features to the prediction for a patient with AMI. The explanations suggested that more attention should be given to these modifiable risk factors related to vital signs, biochemistry, and metabolism in the treatment of AMI.


 Citation

Please cite as:

Xie P, Wang H, Xiao J, Xu F, Liu J, Chen Z, Zhao W, Hou S, Wu D, Ma Y, Xiao J

Development and Validation of an Explainable Deep Learning Model to Predict In-Hospital Mortality for Patients With Acute Myocardial Infarction: Algorithm Development and Validation Study

J Med Internet Res 2024;26:e49848

DOI: 10.2196/49848

PMID: 38728685

PMCID: 11127140

Per the author's request the PDF is not available.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.