Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Aug 23, 2021
Date Accepted: Jan 8, 2022

The final, peer-reviewed published version of this preprint can be found here:

A Roadmap for Boosting Model Generalizability for Predicting Hospital Encounters for Asthma

Luo G

A Roadmap for Boosting Model Generalizability for Predicting Hospital Encounters for Asthma

JMIR Med Inform 2022;10(3):e33044

DOI: 10.2196/33044

PMID: 35230246

PMCID: 8924785

A Roadmap for Boosting Model Generalizability for Predicting Hospital Encounters for Asthma

  • Gang Luo

ABSTRACT

In the United States, ~9% of people have asthma. Each year, asthma incurs high healthcare cost and many hospital encounters covering 1.8 million emergency room visits and 439,000 hospitalizations. A small percentage of patients with asthma use most healthcare resources. To improve outcomes and cut resource use, many healthcare systems use predictive models to prospectively find high-risk patients and enroll them in care management for preventive care. For maximal benefit from costly care management with limited service capacity, only patients at the highest risk should be enrolled. Yet, prior models built by others miss >50% of true highest-risk patients and mislabel many low-risk patients as high risk, leading to suboptimal care and wasted resources. To address this issue, we recently built three site-specific models to predict hospital encounters for asthma and gained up to 11%+ better performance. But, these models do not generalize well across sites and patient subgroups, creating two gaps before translating these models into clinical use. This paper points out these two gaps and outlines two corresponding solutions: a) a new machine learning technique to create cross-site generalizable predictive models to accurately find high-risk patients, and b) a new machine learning technique to automatically raise model performance for poorly performing subgroups while maintaining model performance on other subgroups. This gives a roadmap for future research.


 Citation

Please cite as:

Luo G

A Roadmap for Boosting Model Generalizability for Predicting Hospital Encounters for Asthma

JMIR Med Inform 2022;10(3):e33044

DOI: 10.2196/33044

PMID: 35230246

PMCID: 8924785

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.