Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Nov 15, 2017
Open Peer Review Period: Nov 15, 2017 - Mar 15, 2018
Date Accepted: Sep 10, 2018
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies

Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, Müller AM, Wark PA, Vandelanotte C, Poppe L, Hingle MD, Crutzen R

Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies

J Med Internet Res 2018;20(11):e292

DOI: 10.2196/jmir.9397

PMID: 30446482

PMCID: 6269627

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies

  • Camille E Short; 
  • Ann DeSmet; 
  • Catherine Woods; 
  • Susan L Williams; 
  • Carol Maher; 
  • Anouk Middelweerd; 
  • Andre Matthias Müller; 
  • Petra A Wark; 
  • Corneel Vandelanotte; 
  • Louise Poppe; 
  • Melanie D Hingle; 
  • Rik Crutzen

Engagement in electronic health (eHealth) and mobile health (mHealth) behavior change interventions is thought to be important for intervention effectiveness, though what constitutes engagement and how it enhances efficacy has been somewhat unclear in the literature. Recently published detailed definitions and conceptual models of engagement have helped to build consensus around a definition of engagement and improve our understanding of how engagement may influence effectiveness. This work has helped to establish a clearer research agenda. However, to test the hypotheses generated by the conceptual modules, we need to know how to measure engagement in a valid and reliable way. The aim of this viewpoint is to provide an overview of engagement measurement options that can be employed in eHealth and mHealth behavior change intervention evaluations, discuss methodological considerations, and provide direction for future research. To identify measures, we used snowball sampling, starting from systematic reviews of engagement research as well as those utilized in studies known to the authors. A wide range of methods to measure engagement were identified, including qualitative measures, self-report questionnaires, ecological momentary assessments, system usage data, sensor data, social media data, and psychophysiological measures. Each measurement method is appraised and examples are provided to illustrate possible use in eHealth and mHealth behavior change research. Recommendations for future research are provided, based on the limitations of current methods and the heavy reliance on system usage data as the sole assessment of engagement. The validation and adoption of a wider range of engagement measurements and their thoughtful application to the study of engagement are encouraged.


 Citation

Please cite as:

Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, Müller AM, Wark PA, Vandelanotte C, Poppe L, Hingle MD, Crutzen R

Measuring Engagement in eHealth and mHealth Behavior Change Interventions: Viewpoint of Methodologies

J Med Internet Res 2018;20(11):e292

DOI: 10.2196/jmir.9397

PMID: 30446482

PMCID: 6269627

Per the author's request the PDF is not available.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.