Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Dec 19, 2024
Date Accepted: Apr 4, 2025
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Large Language Model Architectures in Healthcare: A Scoping Review of Research Perspectives
ABSTRACT
Background and
Objective:
Large language models (LLMs) can provide benefits for most medical applications. However, while most studies investigate how LLMs are used, they neglect the importance of selecting suitable LLM architectures.
Methods:
We conduct a scoping review, to identify which LLMs are used in healthcare. Our search included manuscripts from PubMed, arXiv, and medRxiv. We used open and selective coding to assess the 114 identified manuscripts regarding 11 dimensions related to usage and technical facets.
Results:
We identify four foci that emerged previously in manuscripts with a focus on investigating LLM performance. We find that GPT-based models are used for general purposes like exam preparation or communicating symptoms and treatments, while BERT-based models are used for knowledge discovery and model improvements.
Conclusions:
Healthcare professionals should consider the intended purpose to select the best-suited LLM architecture. Our study suggests that GPT-based model can aid general-purpose tasks in healthcare like report generation or treatment recommendations. However, other LLM families like BERT seem to allow easier extensions of their models for domain-specific tasks.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.