Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently accepted at: Journal of Medical Internet Research

Date Submitted: Jan 8, 2026
Date Accepted: Sep 10, 2026

This paper has been accepted and is currently in production.

It will appear shortly on 10.2196/91058

The final accepted version (not copyedited yet) is in this tab.

Evaluation of a Clinical Protocol–Guided Chatbot to Support Telecarers in Diabetes Management: An Embedded Mixed-Methods Study

  • Rebecca Hui Shan Ong; 
  • Hong Choon Oh; 
  • Bryan Peide Choo; 
  • Linette Zhi Ai Tan; 
  • Melissa Hui Wen Gunn; 
  • Jin Wee Ng; 
  • Anne Ching Ching Teng; 
  • Sharon Yu Bing Ong; 
  • Angela Hwee Koon Ng; 
  • Winnie Yi Ling Soo; 
  • Yian Chin Lee; 
  • Halimah Binte Sarim; 
  • Geok Choo Lim; 
  • Junaidah Binte Ibrahim; 
  • Kryslyn Mei Ying Kae; 
  • Jinyang Wu; 
  • Zhengyuan Liu; 
  • Mojisola Erdt; 
  • Siti Umairah Md Salleh; 
  • Siti Maryam Binte Ahmad Subaidi; 
  • Sakinah Binte Yusof; 
  • Nabilah Binte Md Johan; 
  • Kavineshaan Ramdas; 
  • Jia Shern Ang; 
  • Qi Yuan Tay; 
  • Yong Mong Bee; 
  • Nancy F. Chen; 
  • Pavitra Krishnaswamy; 
  • Joan Joo Ching Khoo

ABSTRACT

Background:

Type 2 diabetes mellitus (DM) is a chronic condition that requires ongoing self-management. While chatbots offer scalable monitoring and management, evidence on their integration within structured hospital tele-support workflows, where patient engagement, and digital readiness may differ from standalone digital interventions is limited.

Objective:

This study aimed to describe the design of a clinical protocol-guided chatbot, Sharing Information with Users on Diabetes Actions and Interventions (Siu Dai), and evaluate its feasibility, usability, and acceptability among patients and telecarers within a hospital tele-support program.

Methods:

We utilised an embedded mixed-methods design (QUAL[quan]) guided by the WHO Monitoring and Evaluating Digital Health Interventions and Theoretical Framework of Acceptability. Through a co-design process involving clinicians, researchers, telecarers, and developers, the chatbot was aligned with established clinical protocols. It featured seven pre-call sessions designed to collect patient data, generate summary reports for staff, and deliver targeted educational content. Patients (≥21 years with type 2 DM) and telecarer nurses (≥6 months’ experience) were recruited from an existing tele-support program. Data sources included interviews, online surveys (5-point Likert scales), and chatbot usage logs. Qualitative data were analyzed thematically; quantitative data were summarized descriptively and integrated narratively.

Results:

Nineteen participants enrolled (11 patients, 8 telecarers), and 14 (7 patients, 7 telecarers) completed both interviews and surveys. Patients (mean: 49.6) had median diabetes duration of 10 years (range: 1 – 30) and all were digitally literate. Telecarers had a median of 5 years’ telehealth experience. Quantitatively, patients showed high engagement, completing 83% of started sessions with a median completion time of 2:54 minutes. Patient satisfaction was high, with 81.8% (9/11) willing to recommend the tool; however, telecarer endorsement for universal rollout was more cautious (50.0%, 4/8). Qualitative findings revealed five themes: (1) perceptions of chatbot usability, (2) alignment and integration into telecarers’ processes; (3) factors influencing acceptability of the chatbot; (4) perceived efficacy of the chatbot on DM self-management and care delivery, and (5) suggested improvements and enhancement. Integrated findings revealed that the chatbot was usable and functioned as a pre-call support tool that optimized the personalization of tele-support sessions. However, its perceived efficacy on self-management behavior was limited due to the well-versed experience of this cohort with DM management. Key barriers to adoption included administrative burden for telecarers due to a lack of electronic medical record integration and content redundancy for patients. Suggested enhancements included multilingual support and adaptive content catering to different levels of disease-specific literacy.

Conclusions:

A clinical protocol-guided chatbot is feasible for hospital tele-support, complementing rather than replacing human care. It automates routine assessments and reinforces education, but future iterations must prioritize workflow integration and adaptive content to sustain engagement. Clinical Trial: NA


 Citation

Please cite as:

Ong RHS, Oh HC, Choo BP, Tan LZA, Gunn MHW, Ng JW, Teng ACC, Ong SYB, Ng AHK, Soo WYL, Lee YC, Sarim HB, Lim GC, Ibrahim JB, Kae KMY, Wu J, Liu Z, Erdt M, Md Salleh SU, Ahmad Subaidi SMB, Yusof SB, Md Johan NB, Ramdas K, Ang JS, Tay QY, Bee YM, Chen NF, Krishnaswamy P, Khoo JJC

Evaluation of a Clinical Protocol–Guided Chatbot to Support Telecarers in Diabetes Management: An Embedded Mixed-Methods Study

Journal of Medical Internet Research. 10/09/2026:91058 (forthcoming/in press)

DOI: 10.2196/91058

URL: https://preprints.jmir.org/preprint/91058

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.