Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Aug 27, 2021
Open Peer Review Period: Aug 27, 2021 - Sep 20, 2021
Date Accepted: Mar 11, 2022
Date Submitted to PubMed: Mar 11, 2022
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Improving the Prediction of Persistent High Health Care Utilizers: Retrospective Analysis Using Ensemble Methodology

Howson SN, McShea MJ, Ramachandran R, Burkom HS, Chang HY, Weiner JP, Kharrazi H

Improving the Prediction of Persistent High Health Care Utilizers: Retrospective Analysis Using Ensemble Methodology

JMIR Med Inform 2022;10(3):e33212

DOI: 10.2196/33212

PMID: 35275063

PMCID: 8990371

Improving the Prediction of Persistent High Healthcare Utilizers: Using an Ensemble Methodology

  • Stephanie N Howson; 
  • Michael J McShea; 
  • Raghav Ramachandran; 
  • Howard S Burkom; 
  • Hsien-Yen Chang; 
  • Jonathan P Weiner; 
  • Hadi Kharrazi

ABSTRACT

Background:

A small proportion of high-need patients persistently use the bulk of healthcare services and incur disproportionate costs. Population health management (PHM) programs often refer to these patients as persistent high users/utilizers (PHUs). Accurate PHU prediction enables PHM programs to better align scarce healthcare resources with high-need PHUs while generally improving outcomes. While prior research in PHU prediction has shown promise, traditional regression methods used in these studies have yielded limited accuracy.

Objective:

We sought to improve PHU predictions with an ensemble approach in a retrospective observational study design using insurance claim records.

Methods:

We defined a PHU as a patient with healthcare costs in the top 20% of all patients for four consecutive 6-month periods. We used 2013 claims data to predict PHU status in next 24 months. Our study population included 165,595 patients in the Johns Hopkins Health Care plan, with 8359 (5.1%) patients identified as PHUs in 2014 and 2015. We assessed the performance of several standalone machine learning methods and then an ensemble approach combining multiple models.

Results:

The candidate ensemble with Complement Naïve Bayes and Random Forest layers produced increased sensitivity and PPV (49.0% and 50.3%, respectively) compared to logistic regression (46.8% and 46.1%).

Conclusions:

Our results suggest that ensemble machine learning can improve prediction of care management needs. Improved PPV implies reduced incorrect referral of low-risk patients. With the improved sensitivity/PPV balance of this approach, resources may be directed more efficiently to patients needing them most.


 Citation

Please cite as:

Howson SN, McShea MJ, Ramachandran R, Burkom HS, Chang HY, Weiner JP, Kharrazi H

Improving the Prediction of Persistent High Health Care Utilizers: Retrospective Analysis Using Ensemble Methodology

JMIR Med Inform 2022;10(3):e33212

DOI: 10.2196/33212

PMID: 35275063

PMCID: 8990371

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.