Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Mar 31, 2023
Date Accepted: Nov 30, 2023

The final, peer-reviewed published version of this preprint can be found here:

The Goldilocks Dilemma on Balancing User Response and Reflection in mHealth Interventions: Observational Study

Nelson LA, Spieker AJ, LeStourgeon LM, Greevy RA, Molli S, Roddy MK, Mayberry LS

The Goldilocks Dilemma on Balancing User Response and Reflection in mHealth Interventions: Observational Study

JMIR Mhealth Uhealth 2024;12:e47632

DOI: 10.2196/47632

PMID: 38297891

PMCID: 10850735

The Goldilocks Dilemma in mHealth Interventions: An Observational Study on Balancing User Response and Reflection

  • Lyndsay A. Nelson; 
  • Andrew J. Spieker; 
  • Lauren M. LeStourgeon; 
  • Robert A. Greevy; 
  • Samuel Molli; 
  • McKenzie K. Roddy; 
  • Lindsay S. Mayberry

ABSTRACT

Background:

mHealth has the potential to radically improve health behaviors and quality of life; however, there are still key gaps in understanding how to optimize mHealth engagement. Most engagement research reports only on system use without consideration of whether the user is reflecting on the content cognitively. Although interactions with mHealth are critical, cognitive investment may also be important for meaningful behavior change. Notably, content designed to request too much reflection, may lead users to disengage. Understanding how to strike the balance between response and reflection burden has critical implications for achieving effective engagement to impact intended outcomes.

Objective:

We sought to understand the interplay between response burden and reflection burden for impacting mHealth engagement in an observational study. Specifically, we explored how varying the response and reflection burden of mHealth content would impact users’ text message response rate as part of an mHealth intervention.

Methods:

We recruited support persons of people with diabetes for a randomized controlled trial (RCT) evaluating an mHealth intervention for diabetes management. Support person participants assigned to the intervention (N=148) completed a survey and received text messages for 9 months. During the two-year RCT, we sent four versions of a weekly two-way text message that varied in both reflection burden (level of cognitive reflection requested relative to other messages) and response burden (level of information requested in the response relative to other messages). We quantified engagement using participant-level response rate. We compared the odds of responding to each text and used Poisson regression to estimate associations between participant characteristics and response rate.

Results:

The texts requesting the most reflection had the lowest response rates (median 10-23%), regardless of response burden. Response rate was highest for the text requesting the least reflection (90%), yet still relatively high for the text with medium reflection (75%). Lower odds of responding were associated with higher reflection burden (P<.001). Participants with younger age or who had lower socioeconomic status had lower response rates to texts with more reflection burden relative to their counterparts (P<.01 for each).

Conclusions:

As reflection burden increased, engagement decreased, and we found more disparities in engagement by participants’ characteristics. Content encouraging moderate levels of reflection may be ideal for achieving both cognitive investment and system use. Our findings provide insights into mHealth design and optimizing both engagement and effectiveness. Clinical Trial: NCT04347291


 Citation

Please cite as:

Nelson LA, Spieker AJ, LeStourgeon LM, Greevy RA, Molli S, Roddy MK, Mayberry LS

The Goldilocks Dilemma on Balancing User Response and Reflection in mHealth Interventions: Observational Study

JMIR Mhealth Uhealth 2024;12:e47632

DOI: 10.2196/47632

PMID: 38297891

PMCID: 10850735

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.