Accepted for/Published in: JMIR Medical Education
Date Submitted: Jun 16, 2025
Date Accepted: Dec 22, 2025
(closed for review but you can still tweet)
Integrating Large Language Models into Trauma Education for Medical Students: A Randomized Controlled Pilot Trial
ABSTRACT
Background:
The exponential growth of medical knowledge presents a paradox for modern medical education. While access to information is immediate, applying it in a clinically meaningful way remains a challenge. Large language models (LLMs), such as ChatGPT, are widely used for information retrieval, yet their role in dynamic, high-pressure clinical learning remains poorly understood.
Objective:
To evaluate whether access to a LLM improves decision-making, teamwork, and confidence in trauma education for medical students.
Methods:
This randomized controlled pilot study involved 40 final-year medical students participating in a trauma simulation session. Students self-selected into teams of 4–6 and were randomized to either an LLM-assisted group (ChatGPT-4o mini) or a control group without LLM access. All teams completed 18 video-based trauma scenarios requiring time-sensitive clinical decisions. Prompting was unrestricted. Confidence and trauma exposure were assessed using pre/post questionnaires. Facilitators rated teamwork (1–5), decision accuracy, and response times. Knowledge retention was measured four weeks later via an online quiz.
Results:
Confidence in trauma management improved in both groups (p < .001), with larger gains in the non-LLM group (p = .02). LLM support did not enhance decision accuracy or speed and was associated with longer response times in some complex cases. Teams without LLMs demonstrated more active discussion and scored higher in teamwork ratings (median 5.0 vs. 3.5; p = .033). Students primarily used the LLM for fact-checking but reported vague or overly general responses. Knowledge retention was high across both groups and did not differ significantly (p = .332).
Conclusions:
While students appreciated the inclusion of AI, unstructured LLM use did not improve performance and may have disrupted group reasoning. This pilot study highlights the need for structured AI integration and targeted instruction in AI literacy. Simulation-based trauma education proved effective and well received, but optimizing the educational value of LLMs will require thoughtful curricular design. Further studies with more students are needed to define best practices for LLM use in clinical education. Clinical Trial: https://doi.org/10.17605/OSF.IO/7HF3V
Citation
