Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Aug 27, 2019
Date Accepted: Dec 15, 2019
The effectiveness and safety of using chatbots in mental health: A systematic review and meta-analysis
ABSTRACT
Background:
The global shortage of mental health workers has prompted the utilization of technological advancements, such as chatbots, to meet the needs of people with mental health conditions. Chatbots are systems that are able to converse and interact with human users using spoken, written, and visual language. While numerous studies assess the effectiveness and safety of using chatbots in mental health, no reviews have pooled results of those studies.
Objective:
This study aimed to assess the effectiveness and safety of using chatbots in mental health through summarizing and pooling the results of previous studies.
Methods:
A systematic review was carried out to achieve this objective. The search sources were 7 bibliographic databases (e.g. MEDLINE, EMBASE, PsycINFO), the search engine “Google Scholar”, and backward and forward reference list checking of the included studies and relevant reviews. Two reviewers were independently selected studies, extracted data from the included studies, and assessed the risk of bias of those studies. Data extracted from studies were synthesized in narrative and statistical methods, when appropriate.
Results:
Of 1048 citations retrieved, we identified 12 studies examining the effect of using chatbots on eight outcomes. Weak evidence demonstrated that chatbots were effective in improving depression, distress, stress, and acrophobia. In contrast, according to similar evidence, there was no statistically significant effect of using chatbots on subjective psychological well-being. Results were conflicting regarding the effect of chatbots on severity of anxiety and positive and negative affect. Only two studies assessed the safety of chatbots and concluded that they are safe in mental health as no adverse events or harms were reported.
Conclusions:
Chatbots have potential to improve mental health. However, the evidence in this review was not enough to definitely conclude this due to lack of evidence that their effect is clinically important, lack of studies assessing each outcome, high risk of bias in those studies, and conflicting results for some outcomes. Further studies are required to draw solid conclusions about the effectiveness and safety of chatbots.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.