Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Diabetes

Date Submitted: Jul 16, 2022
Date Accepted: Sep 7, 2022
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Analyzing User Engagement Within a Patient-Reported Outcomes Texting Tool for Diabetes Management: Engagement Phenotype Study

Mandal S, Belli H, Cruz J, Mann D, Schoenthaler A

Analyzing User Engagement Within a Patient-Reported Outcomes Texting Tool for Diabetes Management: Engagement Phenotype Study

JMIR Diabetes 2022;7(4):e41140

DOI: 10.2196/41140

PMID: 36374531

PMCID: 9706388

Analyzing user engagement within a patient-reported outcomes texting tool for diabetes management

  • Soumik Mandal; 
  • Hayley Belli; 
  • Jocelyn Cruz; 
  • Devin Mann; 
  • Antoinette Schoenthaler

ABSTRACT

Background:

Patient-reported outcomes (PROs) capture patients’ views about their health condition and its management. PRO assessments are increasingly being used in clinical trials, including those targeting type 2 diabetes (T2D). Mobile Health (mHealth) tools offer novel solutions for collecting PRO data in real-time in clinical trials. While the patient is at the center of any PRO-based intervention, few studies have examined user engagement with PRO mHealth tools.

Objective:

We aim to: (1) evaluate user engagement with a PRO mHealth tool for T2D management; (2) identify patterns of user engagement, and similarities and differences between the patients; and (3) identify characteristics of patients who are likely to drop-out or be less-engaged with a PRO mHealth tool.

Methods:

We extracted user engagement data from an ongoing clinical trial that is testing the efficacy of a PRO mHealth tool designed to improve HbA1c among patients with uncontrolled T2D. To date, 61 patients have been randomized to the intervention, where they are sent six PRO text messages a day that are relevant to T2D self-management (e.g., healthy eating, medication adherence) over the 12-month study. To analyze user engagement, we first compared the response rate (RR) and response time (RT) between the patients who completed the 12-month intervention and those who dropped out early. Next, we classified patients from the completers group into three subgroups using latent class trajectory modeling. The classification was based on similarity in longitudinal engagement data. Finally, we investigated the difference between the subgroups among completers from various cross-sections (time of the day, day of the week) and PRO question types. We also explored the patients’ demographics overall, and their distribution among the subgroups.

Results:

19 patients who dropped out from the program early (i.e., non-completers) had a lower RR to PRO questions and took longer times to respond to PRO questions than the 42 completers. Among the completers, analysis of the longitudinal RRs identified differences in engagement patterns over time. The completers with the lowest engagement showed their peak engagement during month 5, almost at the mid-stage of the program. Alternatively, the remaining subgroups showed peak engagement at the beginning of the intervention, followed by either steady decline or sustained high engagement. Comparisons of the demographic characteristics showed significant differences between the high- and low-engaged subgroups. The high-engaged completers were predominantly older, of Hispanic descent, bilingual, and had a graduate degree. In comparison, the low-engaged subgroup was composed of mostly African American patients who reported the lowest annual income, with one out of every three patients earning less than $20,000 annually.

Conclusions:

There are discernible engagement phenotypes based on individual PRO responses and their patterns vary in the timing of peak engagement and also based on demographics. Future studies can use these findings to predict engagement categories and tailor interventions to promote longitudinal engagement. Clinical Trial: Clinicaltrials.gov NCT03652389


 Citation

Please cite as:

Mandal S, Belli H, Cruz J, Mann D, Schoenthaler A

Analyzing User Engagement Within a Patient-Reported Outcomes Texting Tool for Diabetes Management: Engagement Phenotype Study

JMIR Diabetes 2022;7(4):e41140

DOI: 10.2196/41140

PMID: 36374531

PMCID: 9706388

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.