Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Diabetes

Date Submitted: Sep 12, 2023
Date Accepted: Feb 15, 2024

The final, peer-reviewed published version of this preprint can be found here:

New Approach to Equitable Intervention Planning to Improve Engagement and Outcomes in a Digital Health Program: Simulation Study

Killian JA, Jain M, Jia Y, Amar J, Huang E, Tambe M

New Approach to Equitable Intervention Planning to Improve Engagement and Outcomes in a Digital Health Program: Simulation Study

JMIR Diabetes 2024;9:e52688

DOI: 10.2196/52688

PMID: 38488828

PMCID: 10980993

A New Approach to Equitable Intervention Planning to Improve Engagement and Outcomes in a Digital Health Program: Simulation Study

  • Jackson A. Killian; 
  • Manish Jain; 
  • Yugang Jia; 
  • Jonathan Amar; 
  • Erich Huang; 
  • Milind Tambe

ABSTRACT

Background:

Digital health programs provide individualized support to patients with chronic diseases and their effectiveness is measured by the extent to which patients achieve target individual clinical outcomes and the program’s ability to sustain patient engagement. However, patient dropout and inequitable intervention delivery strategies, which may unintentionally penalize certain patient subgroups, represent challenges to maximizing effectiveness. Therefore, methodologies that optimize the balance between success factors (achievement of target clinical outcomes and sustained engagement) in an equitable fashion would be desirable, particularly when there are resource constraints.

Objective:

Our objectives were to propose a model for digital health program resource management that accounts jointly for the interaction between individual clinical outcomes and patient engagement, ensures equitable allocation as well as allows for capacity planning, and to conduct extensive simulations using publicly available data on type 2 diabetes, a chronic disease.

Methods:

We propose a restless multiarmed bandit (RMAB) model to plan interventions which jointly optimize long-term engagement and individual clinical outcomes (in this case measured as achievement of target healthy glucose levels). To mitigate the tendency of RMAB to achieve good aggregate performance by exacerbating disparities between groups, we propose new equitable objectives for RMAB and apply bilevel optimization algorithms for solving them. We formulated a model for the joint evolution of patient engagement and individual clinical outcome trajectory to capture the key dynamics of interest in digital chronic disease management programs.

Results:

In simulation exercises, our optimized intervention policies lead to up to 10% more patients reaching healthy glucose levels after 12 months, with 10% reduction in dropout compared to standard-of-care baselines. Further, our new equitable policies reduce the mean absolute difference of engagement and health outcomes across six demographic groups by up to 85% compared to state-of-the art.

Conclusions:

It is feasible and effective to plan digital health interventions accounting for individual clinical outcome objectives and for long-term engagement dynamics, using an RMAB sequential decision-making framework that can also provide capabilities in capacity planning. By applying our new algorithmic contribution, equitable RMAB, this approach can also reach equitable solutions. Overall we present an approach that allows program designers to toggle between different priorities and modulate trade-offs across their desired objectives. Clinical Trial: NA


 Citation

Please cite as:

Killian JA, Jain M, Jia Y, Amar J, Huang E, Tambe M

New Approach to Equitable Intervention Planning to Improve Engagement and Outcomes in a Digital Health Program: Simulation Study

JMIR Diabetes 2024;9:e52688

DOI: 10.2196/52688

PMID: 38488828

PMCID: 10980993

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.