Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Oct 19, 2023
Open Peer Review Period: Oct 18, 2023 - Dec 13, 2023
Date Accepted: Apr 5, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

Preiksaitis C, Ashenburg N, Bunney G, Chu AL, Kabeer R, Riley F, Ribeira R, Rose C

The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

JMIR Med Inform 2024;12:e53787

DOI: 10.2196/53787

PMID: 38728687

PMCID: 11127144

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

From Triage to Treatment: Scoping the Role of Large Language Models in Transforming Emergency Medicine

  • Carl Preiksaitis; 
  • Nicholas Ashenburg; 
  • Gabrielle Bunney; 
  • Andrew Lee Chu; 
  • Rana Kabeer; 
  • Fran Riley; 
  • Ryan Ribeira; 
  • Christian Rose

ABSTRACT

Background:

Artificial intelligence (AI), more specifically large language models (LLMs), hold significant potential to transform the landscape of emergency care delivery. Although enthusiasm for integrating LLMs into emergency medicine (EM) is growing, the existing literature is characterized by a disparate collection of individual studies, conceptual analyses, and preliminary implementations. Given these complexities and gaps in understanding, a cohesive framework is needed to make sense of the existing body of knowledge on the application of LLMs in EM.

Objective:

This scoping review sought to map the current literature on the potential uses of LLMs in EM and identify directions for future research.

Methods:

Using PRISMA-ScR criteria, we searched Ovid MEDLINE, Embase, Web of Science, and Google Scholar for articles published between January 2018 and August 2023 that discussed LLM use in EM. We excluded other forms of artificial intelligence. Titles and abstracts were screened, and each full text article was independently reviewed by two authors. Data was abstracted independently and 5 authors performed a collaborative quantitative and qualitative synthesis of the data.

Results:

Of 1992 identified citations, 42 were included. Studies were predominantly from 2022-2023 and conducted in the USA and China. Four major themes emerged: (1) Clinical decision support, including applications in public health messaging, triage, diagnosis, treatment recommendations, and outcome predictions; (2) Workflow efficiency, through information retrieval and synthesis to reduce physician cognitive load; (3) Risks and ethics, with concerns about model accuracy, transparency, and legal implications noted; and (4) Education and communication, with potential uses in medical training, patient counseling, and knowledge dissemination identified.

Conclusions:

This review establishes an initial framework of the capabilities and limitations of LLMs in EM based on reported use cases and identifies key areas for future research. These include prospective validation of proposed applications, developing standards for responsible use, exploring provider and patient perceptions, and fostering physician literacy in artificial intelligence. Thoughtful collaboration and critical evaluation will be essential to safely and effectively integrate LLMs into emergency care.


 Citation

Please cite as:

Preiksaitis C, Ashenburg N, Bunney G, Chu AL, Kabeer R, Riley F, Ribeira R, Rose C

The Role of Large Language Models in Transforming Emergency Medicine: Scoping Review

JMIR Med Inform 2024;12:e53787

DOI: 10.2196/53787

PMID: 38728687

PMCID: 11127144

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.