JMIR Publications

ABSTRACT

Background:

There is a need to increase healthcare professional training capacity to meet global needs by 2030. Effective communication is essential for delivering safe and effective patient care. Artificial Intelligence (AI) technologies may provide a solution. However, evidence for high-fidelity virtual patient simulators using unrestricted two-way verbal conversation for communication skills training is lacking.

Objective:

The authors therefore compared the effectiveness and cost of an AI-driven voice recognition platform allowing unrestricted two-way verbal conversation with actor-based simulated training in undergraduate medical education.

Methods:

Using a randomised crossover design, the authors compared half-day AI-based communication skills training (AI-CST) with half-day actor-based consultation skills training (AB-CST) in undergraduates at two UK medical schools, in 2024. Pre-post intervention surveys using 10-point linear scales were used to derive outcomes. Primary outcome was the difference in self-reported attainment of communication skills between interventions. Secondary outcomes were differences in student satisfaction and cost-comparison of delivering both interventions.

Results:

Of 396 students, 378 (95%) completed at least one survey. Both modalities significantly increased communication skills attainment (AI-CST: mean 1.14 points (95%CI 0.53-0.175); AB-CST: mean 1.50 points (95%CI 0.9-2.10); both P<.001). Attainment increase was lower for AI-CST than AB-CST (by mean 0.36 points (95%CI -0.52 to -0.20); P=.04). Overall satisfaction was lower for AI-CST than AB-CST (8.09 versus 9.21; mean difference -1.13 (95%CI -1.53 to -0.72) for AI-CST versus AB-CST; P<.001). The cost of AI-CST and AB-CST were £33.48 and £61.75 per student, respectively.

Conclusions:

AI-CST and AB-CST were effective and similar at improving communication skills attainment, but student satisfaction was significantly greater for AB-CST. Costs of AI-CST were substantially lower than AB-CST. AI-CST may provide a cost-effective opportunity to build training capacity for healthcare professional training.