Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Jul 28, 2023
Open Peer Review Period: Jul 27, 2023 - Sep 21, 2023
Date Accepted: Sep 3, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

Kim J, Vajravelu BN

Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

JMIR Form Res 2025;9:e51319

DOI: 10.2196/51319

PMID: 39819585

PMCID: 11756841

Assessing the Current Limitations of Large-Language Models in Advancing Healthcare Education

  • JaeYong Kim; 
  • Bathri N Vajravelu

ABSTRACT

The integration of large language models (LLMs), as seen with the Generative Pre-trained Transformers (GPT) series, into healthcare education and clinical management represents a transformative potential. While the very applications and direct employment of GPT in various domains of healthcare practices sparked great anticipation for new avenues and promising opportunities, it is of equal significance to constructively dissect its current flaws before envisaging its integration into existing systems. The current review takes a conservative epistemic stance in evaluating the utility of state-of-the-art LLMs – especially GPT3.5 and 4.0 – in healthcare education and practice, for we underscore the following limitations as areas requiring significant and urgent refinement: a) risks for plagiarism and academic dishonesty, b) dissemination of misinformation, c) limited and inconsistent delivery of knowledge, d) inequity of access, e) presence of algorithmic bias and moral instability, f) inadequacies in text-to-image capacity, and g) lack of regulatory measures to address ethical challenges. This paper then exemplifies, through the direct maneuvering of GPT-3.5, how LLMs can be utilized effectively to provide astonishing assistance and advancements to healthcare education and delivery.


 Citation

Please cite as:

Kim J, Vajravelu BN

Assessing the Current Limitations of Large Language Models in Advancing Health Care Education

JMIR Form Res 2025;9:e51319

DOI: 10.2196/51319

PMID: 39819585

PMCID: 11756841

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.