Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Aug 26, 2021
Date Accepted: Jan 2, 2022

The final, peer-reviewed published version of this preprint can be found here:

Automatically Explaining Machine Learning Predictions on Severe Chronic Obstructive Pulmonary Disease Exacerbations: Retrospective Cohort Study

Zeng S, Arjomandi M, Luo G

Automatically Explaining Machine Learning Predictions on Severe Chronic Obstructive Pulmonary Disease Exacerbations: Retrospective Cohort Study

JMIR Med Inform 2022;10(2):e33043

DOI: 10.2196/33043

PMID: 35212634

PMCID: 8917430

Automatically Explaining Machine Learning Predictions on Severe Chronic Obstructive Pulmonary Disease Exacerbations: Retrospective Cohort Study

  • Siyang Zeng; 
  • Mehrdad Arjomandi; 
  • Gang Luo

ABSTRACT

Background:

Chronic obstructive pulmonary disease (COPD) is a major cause of death and places a heavy burden on healthcare. To optimize the allocation of precious preventive care management resources and improve the outcomes for high-risk patients with COPD, we recently built the most accurate model to date to predict severe COPD exacerbations, which need inpatient stays or emergency department visits, in the following 12 months. Our model is a machine learning model. As is the case with most machine learning models, our model does not explain its predictions, forming a barrier for clinical use. Previously, we designed a method to automatically give rule-type explanations for machine learning predictions and suggest tailored interventions with no loss of model performance. This method has been tested on asthma outcome prediction, but not on COPD outcome prediction before.

Objective:

To assess the generalizability of our automatic explanation method for predicting severe COPD exacerbations.

Methods:

The patient cohort included all patients with COPD who ever visited the University of Washington Medicine facilities during 2011-2019. In a secondary analysis on 43,576 data instances, we used our formerly developed automatic explanation method to automatically explain our model’s predictions and suggest tailored interventions.

Results:

Our method explained the predictions for 97.1% (100/103) of the patients with COPD whom our model correctly predicted to have severe COPD exacerbations in the following 12 months, and the predictions on 73.6% (134/182) of the patients with COPD who had ≥1 severe COPD exacerbation in the following 12 months.

Conclusions:

Our automatic explanation method worked well for predicting severe COPD exacerbations. After further improving our method, we hope we can use it to facilitate future clinical use of our model.


 Citation

Please cite as:

Zeng S, Arjomandi M, Luo G

Automatically Explaining Machine Learning Predictions on Severe Chronic Obstructive Pulmonary Disease Exacerbations: Retrospective Cohort Study

JMIR Med Inform 2022;10(2):e33043

DOI: 10.2196/33043

PMID: 35212634

PMCID: 8917430

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.