Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Mar 6, 2024
Date Accepted: May 29, 2024

The final, peer-reviewed published version of this preprint can be found here:

Value of Engagement in Digital Health Technology Research: Evidence Across 6 Unique Cohort Studies

Goodday SM, Karlin E, Brooks A, Chapman C, Peabody S, Harry C, Lugo N, Rangwala S, Swanson E, Tempero J, Yang R, Karlin D, Rabinowicz R, Malkin D, Travis S, Walsh A, Hirten RP, Sands BE, Bettegowda C, Holdhoff M, Wollett J, Szjana K, Dirmeyer K, Dodd A, Grant R, Hutchinson S, Ramotar S, Boch A, Wildman M, Friend S

Value of Engagement in Digital Health Technology Research: Evidence Across 6 Unique Cohort Studies

J Med Internet Res 2024;26:e57827

DOI: 10.2196/57827

PMID: 39226552

PMCID: 11408887

The value of engagement in digital health technology research: Evidence across six unique studies

  • Sarah Margaret Goodday; 
  • Emma Karlin; 
  • Alexa Brooks; 
  • Carol Chapman; 
  • Shannon Peabody; 
  • Christiana Harry; 
  • Nelly Lugo; 
  • Shazia Rangwala; 
  • Ella Swanson; 
  • Jonell Tempero; 
  • Robin Yang; 
  • Dan Karlin; 
  • Ron Rabinowicz; 
  • David Malkin; 
  • Simon Travis; 
  • Alissa Walsh; 
  • Robert P Hirten; 
  • Bruce E Sands; 
  • Chetan Bettegowda; 
  • Matthias Holdhoff; 
  • Jessica Wollett; 
  • Kelly Szjana; 
  • Kallan Dirmeyer; 
  • Anna Dodd; 
  • Robert Grant; 
  • Shawn Hutchinson; 
  • Stephanie Ramotar; 
  • Adrien Boch; 
  • Mackenzie Wildman; 
  • Stephen Friend

ABSTRACT

Background:

Wearable digital health technologies and mobile apps (personal DHTs) hold great promise for transforming health research and care. However, engagement in personal DHT research is poor.

Objective:

The objective of this paper is to describe how participant engagement techniques and different study designs affect participant adherence, retention and overall engagement in research involving personal DHTs.

Methods:

Quantitative and qualitative analysis of engagement factors are reported across six unique personal DHT research studies that adopted aspects of a participant centric/end-user design. Study populations included: 1) a frontline healthcare worker population, 2) a conception, pregnant and postpartum population, 3) individuals with Crohn’s disease, 4) individuals with pancreatic cancer, 5) individuals with central nervous system tumors, and 6) families with a Li Fraumeni Syndrome affected member. All included studies involved the use of a study smartphone app that collected both daily and intermittent passive and active tasks, as well as using multiple wearable devices including smart watches, smart rings, and smart scales. All studies included a variety of participant centric engagement strategies centered on working with participants as co-designers and regular check-in phone calls to provide support over study participation. Overall retention, probability of staying in the study, and median adherence to study activities are reported.

Results:

The median proportion of participants retained in the study across the six studies was 77.3% (range: 58.3%-96.4%). The probability of staying in the study stayed above 80% for all studies during the first month of study participation and stayed above 50% for the entire active study period across all studies. Median adherence to study activities varied by study population. Severely ill cancer populations, and postpartum mothers showed the lowest adherence to personal DHT research tasks, largely the result of physical, mental and situational barriers. Except for the cancer and postpartum populations, median adherence for the Oura smart ring, Garmin and Apple smartwatches were over 80% and 90%, respectively. Median adherence to the scheduled check-in calls was high across all but one cohort (50%: low engagement cohort). Median adherence to study-related activities in this low engagement cohort were lower than all other included studies. Race/ethnicity and age were associated with significant differences in adherence.

Conclusions:

Participant-centric engagement strategies aids in participant retention, and maintaining good adherence in some populations. Primary barriers to engagement were participant burden (task fatigue and inconvenience), physical, mental and situational barriers (unable to complete tasks) and low perceived benefit (lack of understanding in the value of personal DHTs). More population specific tailoring of personal DHT designs is needed so that these new tools can be perceived as personally valuable to the end-user.


 Citation

Please cite as:

Goodday SM, Karlin E, Brooks A, Chapman C, Peabody S, Harry C, Lugo N, Rangwala S, Swanson E, Tempero J, Yang R, Karlin D, Rabinowicz R, Malkin D, Travis S, Walsh A, Hirten RP, Sands BE, Bettegowda C, Holdhoff M, Wollett J, Szjana K, Dirmeyer K, Dodd A, Grant R, Hutchinson S, Ramotar S, Boch A, Wildman M, Friend S

Value of Engagement in Digital Health Technology Research: Evidence Across 6 Unique Cohort Studies

J Med Internet Res 2024;26:e57827

DOI: 10.2196/57827

PMID: 39226552

PMCID: 11408887

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.