Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: May 9, 2019
Date Accepted: Aug 30, 2019

The final, peer-reviewed published version of this preprint can be found here:

User Engagement and Attrition in an App-Based Physical Activity Intervention: Secondary Analysis of a Randomized Controlled Trial

Edney S, Ryan JC, Olds T, Monroe C, Fraysse F, Vandelanotte C, Plotnikoff R, Curtis R, Maher C

User Engagement and Attrition in an App-Based Physical Activity Intervention: Secondary Analysis of a Randomized Controlled Trial

J Med Internet Res 2019;21(11):e14645

DOI: 10.2196/14645

PMID: 31774402

PMCID: 6906621

Engagement and churn in an app-based physical activity intervention

  • Sarah Edney; 
  • Jillian C Ryan; 
  • Tim Olds; 
  • Courtney Monroe; 
  • François Fraysse; 
  • Corneel Vandelanotte; 
  • Ronald Plotnikoff; 
  • Rachel Curtis; 
  • Carol Maher

ABSTRACT

Background:

The success of a smartphone application (app) in changing health behaviour is thought to be contingent on engagement, commonly operationalised as frequency of use.

Objective:

The current study examined user engagement with a 100-day physical activity (PA) intervention delivered via an app to examine rates of engagement, associations between user characteristics and engagement, and whether engagement was related to intervention efficacy.

Methods:

Engagement was captured in a real-time log of user interactions with either a gamified app (n=141) or a non-gamified version of the same app (n=160). PA was assessed via accelerometry and self-report at baseline and three-month follow-up. Survival analysis was used to assess time to churn (non-use attrition). Mixed models examined associations between user characteristics and engagement. Characteristics of super-users (top quartile of users) and regular-users (lowest three quartiles) were compared using t-tests and chi-square analysis. Linear mixed models were used to assess whether being a super-user was related to change in physical activity over time.

Results:

Engagement was generally high. Churn occurred in 32% and 39% of the gamified and basic groups, respectively with no significant between group differences in time to churn (p = .42). Users with a body mass index (BMI) in the healthy range had higher engagement (M= 230.5, 95% CI 190.6-270.5, F2 = 8.67, p < 0.001), compared to users whose BMI was overweight or obese (M= 170.6, 95% CI 139.5-201.6; M= 132.9, 95% CI 104.8-161.0). Older users engaged more (M= 200.4, 95% CI 171.9-228.9, F1 = 6.385, p = .01) than younger users (M= 155.6, 95% CI 128.5-182.6). Super-users were 4.6 years older (t(297) = 3.6, p = <.001) and less likely to have a BMI in the obese range (X2(2) = 15.1, p = <.001). At the three-month follow-up, super-users were completing 28.2 (95% CI 9.4-46.9) more minutes of objectively measured PA than-regular-users (F = 4.76, p = .03).

Conclusions:

Engagement was high across the 100-day intervention period and the inclusion of gamified features enhanced engagement. Participants who engaged the most saw significantly greater increases to their objectively measured PA over time, supporting the theory that intervention exposure is linked to efficacy. Further research is needed to determine whether these findings are replicated in other app-based interventions, including those conducted in real-world settings. Clinical Trial: Australian and New Zealand Clinical Trial Registry, protocol: 12617000113358.


 Citation

Please cite as:

Edney S, Ryan JC, Olds T, Monroe C, Fraysse F, Vandelanotte C, Plotnikoff R, Curtis R, Maher C

User Engagement and Attrition in an App-Based Physical Activity Intervention: Secondary Analysis of a Randomized Controlled Trial

J Med Internet Res 2019;21(11):e14645

DOI: 10.2196/14645

PMID: 31774402

PMCID: 6906621

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.