Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Dec 22, 2024
Open Peer Review Period: Dec 22, 2024 - Feb 16, 2025
Date Accepted: Mar 27, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Effectiveness of Topic-Based Chatbots on Mental Health Self-Care and Mental Well-Being: Randomized Controlled Trial

Tong AC, Wong KTY, Chung WWT, Mak WWS

Effectiveness of Topic-Based Chatbots on Mental Health Self-Care and Mental Well-Being: Randomized Controlled Trial

J Med Internet Res 2025;27:e70436

DOI: 10.2196/70436

PMID: 40306635

PMCID: 12079066

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Effectiveness of topic-based chatbots on mental health self-care and mental well-being: A Randomized Controlled Trial

  • Alan C.Y. Tong; 
  • Kent T. Y. Wong; 
  • Wing W. T. Chung; 
  • Winnie W. S. Mak

ABSTRACT

Background:

The global surge in mental health challenges has placed unprecedented strain on healthcare systems, highlighting the need for scalable interventions to promote mental health self-care. Chatbots have emerged as promising tools to address these gaps by providing accessible, evidence-based support. However, most existing studies focus on the clinical population and symptom reduction, with limited exploration of preventive strategies targeting self-care and mental health literacy among people in the community.

Objective:

This study evaluates the effectiveness of a rule-based, topic-specific chatbot intervention in improving self-care efficacy, literacy, self-care intention and self-care behaviors as well as mental well-being immediately after 10 days of usage and after 1 month.

Methods:

A two-arm, assessor-blinded randomized controlled trial was conducted. 285 participants were randomly assigned to either the chatbot intervention group (n=140) or a waitlist control group (n=145). The chatbot intervention consisted of ten topic-specific sessions targeting stress management, emotion regulation, and value clarification, delivered over 10 days with a 7-day free-access period. Primary outcomes included self-care self-efficacy, behavioral intentions, self-care behaviors, and mental health literacy. Secondary outcomes included depressive symptoms, anxiety symptoms, and mental well-being. Assessments were conducted at baseline, post-intervention at 10 days, and 1-month follow-up. Primary data analysis was performed using linear mixed models with intention-to-treat approach.

Results:

Participants in the chatbot group demonstrated greater improvements in behavioral intentions (d=0.31) and mental health literacy (d=0.45) compared to the control group as revealed by the significant interaction effects (mental health literacy: F(2, 423.57)=4.27, P=.015; behavioral intentions: F(2, 379.74)=15.02, P<.001). The chatbots were also able to bring immediate improvement on self-care behaviors (d=0.36), mindfulness (d=0.37), mental health outcomes of depressive symptoms (d=-0.26) and overall well-being (d=0.22) and positive emotions (d=0.28). Yet, these improvements did not differ significantly at 1 month when compared to the waitlist control. Adherence was higher among participants who received push notifications.

Conclusions:

This study highlights the potential of rule-based chatbots in promoting mental health literacy and fostering the intention to take care of own mental health. Despite recent advancements in generative AI, rule-based systems remain valuable due to their content control and safety assurances. However, improvements in chatbot design, including greater personalization and interactive features, may be necessary to enhance self-efficacy and long-term mental health outcomes. These findings underscore the utility of chatbots as scalable interventions to bridge gaps in mental health service delivery. Future research should explore hybrid approaches that combine rule-based and generative AI systems to optimize intervention effectiveness. Clinical Trial: ClinicalTrials.gov NCT05694507


 Citation

Please cite as:

Tong AC, Wong KTY, Chung WWT, Mak WWS

Effectiveness of Topic-Based Chatbots on Mental Health Self-Care and Mental Well-Being: Randomized Controlled Trial

J Med Internet Res 2025;27:e70436

DOI: 10.2196/70436

PMID: 40306635

PMCID: 12079066

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.