Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 26, 2019
Date Accepted: Mar 12, 2020
Date Submitted to PubMed: May 8, 2020

The final, peer-reviewed published version of this preprint can be found here:

Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study

Bennion MR, Hardy GE, Moore RK, Kellett S, Millings A

Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study

J Med Internet Res 2020;22(5):e16794

DOI: 10.2196/16794

PMID: 32384055

PMCID: 7287711

Usability, Acceptability and Effectiveness of Web-based Conversational Agents to Facilitate Problem Solving in Older Adults: A Controlled Study

  • Matthew Russell Bennion; 
  • Gillian E Hardy; 
  • Roger K Moore; 
  • Stephen Kellett; 
  • Abigail Millings

ABSTRACT

Background:

Psychological e-therapies can be delivered using conversational agents (“chatbots”) that verbally mimic traditional therapeutic interactions.

Objective:

To compare the usability, acceptability and effectiveness in older adults of two web-based conversational agents with differing theoretical foundations.

Methods:

In a randomised study, N=112 older adults were allocated to either MYLO (i.e. a chatbot that mimics a therapist using a method of levels approach) or ELIZA (a chatbot that mimics a therapist using a humanistic counselling approach). The primary outcome measure was problem resolution/distress, with secondary outcome measures of system usability and clinical outcome.

Results:

MYLO participants spent significantly longer interacting with the conversational agent. There were no differences between MYLO and ELIZA in terms of problem distress or problem resolution. MYLO was rated as significantly more helpful, likely to be used again. Usability of both the conversational agents was associated with system helpfulness and willingness to reuse.

Conclusions:

Controlled studies of “chatbots” need now to be conducted in clinical populations across the age ranges. The potential integration of ‘chatbots’ into psychological care in routine services is discussed.


 Citation

Please cite as:

Bennion MR, Hardy GE, Moore RK, Kellett S, Millings A

Usability, Acceptability, and Effectiveness of Web-Based Conversational Agents to Facilitate Problem Solving in Older Adults: Controlled Study

J Med Internet Res 2020;22(5):e16794

DOI: 10.2196/16794

PMID: 32384055

PMCID: 7287711

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.