Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Feb 16, 2023
Open Peer Review Period: Feb 16, 2023 - Feb 17, 2023
Date Accepted: Aug 10, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Engagement, Satisfaction, and Mental Health Outcomes Across Different Residential Subgroup Users of a Digital Mental Health Relational Agent: Exploratory Single-Arm Study

Forman-Hoffman VL, Pirner MC, Flom M, Kirvin-Quamme A, Durden E, Kissinger J, Robinson A

Engagement, Satisfaction, and Mental Health Outcomes Across Different Residential Subgroup Users of a Digital Mental Health Relational Agent: Exploratory Single-Arm Study

JMIR Form Res 2023;7:e46473

DOI: 10.2196/46473

PMID: 37756047

PMCID: 10568381

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Engagement, satisfaction, and mental health outcomes across different residential subgroup users of a digital mental health relational agent: Exploratory single-arm study

  • Valerie Lynne Forman-Hoffman; 
  • Madison C Pirner; 
  • Megan Flom; 
  • Andrew Kirvin-Quamme; 
  • Emily Durden; 
  • Jennifer Kissinger; 
  • Athena Robinson

ABSTRACT

Background:

Mental illness is a pervasive worldwide public health issue. Residentially vulnerable populations such as those living in rural, medically underserved, or mental health provider shortage areas face unique access barriers to mental health care. Despite the growth of digital mental health interventions utilizing relational agent technology, little is known about their use patterns, efficacy, and favorability in residentially vulnerable populations.

Objective:

To explore differences in application (app) utilization, therapeutic alliance, mental health outcomes, and satisfaction across residential subgroups (metropolitan/nonmetropolitan/rural, medically underserved area (MUA) (yes/no), and mental health provider shortage areas (MHPSA) (yes/no) among users of a smartphone-based, digital mental health intervention, Woebot Life (WB-LIFE). WB-LIFE was designed to help users better understand and manage their moods and features a relational agent, Woebot, that converses through text-based messages.

Methods:

This exploratory study examined data from 255 adults enrolled in an 8-week, single-arm trial of WB-LIFE. Analyses compared levels of app utilization and therapeutic alliance Total scores as well as subscales Goal, Task, and Bond, mental health outcomes (depressive and anxiety symptoms, stress, resilience, burnout), and program satisfaction across residential subgroups.

Results:

Few study participants resided in non-metropolitan (n=25, 10%) or rural (n=3, 1%) areas, precluding estimates across this variable. Despite a largely metropolitan sample, nearly 39% (n=99) resided in an MUA and 55% (n=141) in an MHPSA. There were no significant differences in app utilization or satisfaction by MUA or MHPSA status. There also were no differences in depression, anxiety, stress, resilience or burnout, with the exception of MUA participants having higher baseline depressive symptoms among those starting in the moderate range or higher (Patient Health Questionnaire-8 item ([PHQ-8]≥10) than non-MUA participants (mean=16.50 versus 14.41, respectively, p=0.01). Although working alliance scores did not differ by MHPSA status, those who resided in an MUA had higher Goal (t=2.21, p=0.03), Bond (t=1.94, p=0.05) and Total therapeutic alliance scores at Day 3 (t=2.15, p=0.03), and higher Goal scores at Week 8 (t=2.28, p=0.02) as compared to those not living in an MUA.

Conclusions:

Despite the study not recruiting many participants from rural or nonmetropolitan populations, sizable proportions resided in an MUA or an MHPSA. Analyses revealed few differences in app utilization, therapeutic alliance, mental health outcomes (including baseline levels), or satisfaction across MUA or MHPSA status over the 8-week study. Findings suggest that vulnerable residential populations may benefit from using digital agent-guided cognitive behavioral therapy.


 Citation

Please cite as:

Forman-Hoffman VL, Pirner MC, Flom M, Kirvin-Quamme A, Durden E, Kissinger J, Robinson A

Engagement, Satisfaction, and Mental Health Outcomes Across Different Residential Subgroup Users of a Digital Mental Health Relational Agent: Exploratory Single-Arm Study

JMIR Form Res 2023;7:e46473

DOI: 10.2196/46473

PMID: 37756047

PMCID: 10568381

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.