Accepted for/Published in: JMIR Medical Informatics
Date Submitted: Jun 30, 2020
Date Accepted: Nov 3, 2020
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
User experience scores of questionnaires are higher by using a chatbot based questionnaire: a prospective comparative pilot study
ABSTRACT
Background:
Respondent engagement of questionnaires in healthcare is fundamental to ensure adequate response rates for the evaluation of services and quality of care. Conventional survey designs are often perceived as dull and unengaging, resulting in negative respondent behavior.1 It is necessary to make completing a questionnaire attractive and motivating.
Objective:
The aim of this study is to compare the user experience of a chatbot questionnaire, which mimics intelligent conversation 2, with a regular computer questionnaire.
Methods:
The research took place at the preoperative outpatient clinic. Participants completed the regular questionnaire and the new chatbot questionnaire. Afterwards, participants criticized both questionnaires by the User Experience Questionnaire, which consists of 26 terms to score.
Results:
The mean age of the 40 included patients (25 (62.5%) women), is 49 years (18-79). 45% of all terms are scored positive for the chatbot, participants preferred the computer for 8% of the terms and for 47% of the terms there was no difference. Completion of the computer questionnaire took 9.00 minutes by men (SD 2.72) and 7.72 minutes by women (SD 2.60, p0.148). For the chatbot, completion by men took 8.33 minutes (SD 2.99) and by women 7.36 minutes (SD 2.61, p0.287).
Conclusions:
Patients preferred the chatbot questionnaire over the computer questionnaire, which is an important finding because it could lead to higher response rates and to qualitatively better response. Clinical Trial: -
Citation
