Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Jul 3, 2020
Date Accepted: Nov 15, 2020

The final, peer-reviewed published version of this preprint can be found here:

Automatically Explaining Machine Learning Prediction Results on Asthma Hospital Visits in Patients With Asthma: Secondary Analysis

Luo G, Johnson MD, Nkoy FL, He S, Stone BL

Automatically Explaining Machine Learning Prediction Results on Asthma Hospital Visits in Patients With Asthma: Secondary Analysis

JMIR Med Inform 2020;8(12):e21965

DOI: 10.2196/21965

PMID: 33382379

PMCID: 7808890

Automatically Explaining Machine Learning Prediction Results on Asthma Hospital Visits in Asthmatic Patients: Secondary Analysis

  • Gang Luo; 
  • Michael D Johnson; 
  • Flory L Nkoy; 
  • Shan He; 
  • Bryan L Stone

ABSTRACT

Background:

Asthma is a major chronic disease posing a heavy burden on healthcare. To facilitate preventive care and improve outcomes for high-risk asthmatic patients via care management, we recently built a machine learning model to predict asthma hospital visits in the subsequent year in asthmatic patients. This model is more accurate than the prior models. However, like most machine learning models, our model offers no explanation of its prediction results. This creates a hurdle to use it in care management, where interpretability is desired.

Objective:

To address this limitation, this study aims to develop a method to automatically explain the model’s prediction results and to recommend tailored interventions without lowering any of the performance measures of the model.

Methods:

Our data are imbalanced, with only a small portion of data instances linking to future asthma hospital visits. To handle imbalanced data, we extended our prior method for automatically offering rule-formed explanations for any machine learning model’s prediction results on tabular data without lowering any of the performance measures of the model. In a secondary analysis of the 334,564 data instances from Intermountain Healthcare during 2005-2018 used to form our model, we employed the extended method to automatically explain our model’s prediction results and to recommend tailored interventions. The patient cohort consisted of all asthmatic patients who obtained care at Intermountain Healthcare during 2005 to 2018 and resided in Utah or Idaho as recorded at the visit.

Results:

Our method explained the prediction results for 89.68% (391/436) of the asthmatic patients whom our model correctly predicted to incur asthma hospital visits in the subsequent year.

Conclusions:

This study is the first to demonstrate the feasibility of automatically offering rule-formed explanations for any machine learning model’s prediction results on imbalanced tabular data without lowering any of the performance measures of the model. After further improvement, our asthma outcome prediction model coupled with the automatic explanation function could be used for decision support to guide allocation of limited asthma care management resources.


 Citation

Please cite as:

Luo G, Johnson MD, Nkoy FL, He S, Stone BL

Automatically Explaining Machine Learning Prediction Results on Asthma Hospital Visits in Patients With Asthma: Secondary Analysis

JMIR Med Inform 2020;8(12):e21965

DOI: 10.2196/21965

PMID: 33382379

PMCID: 7808890

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.