Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: JMIR Medical Informatics

Date Submitted: Apr 2, 2026
Open Peer Review Period: Apr 17, 2026 - Jun 12, 2026
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Real-World Usage and Perceptions of LLMs Among Emergency Physicians: A Cross-Sectional Survey in the Context of International Governance Trends

  • Naoki Okada; 
  • Hatsumi Nakanishi; 
  • Yuki Sakamoto; 
  • Saki Hirayama; 
  • Cheng Liu; 
  • Sho Mitarai; 
  • Sho Mitarai; 
  • Goshiro Yamamoto; 
  • Ken Okamoto

ABSTRACT

Background:

Large Language Models (LLMs) are rapidly being adopted across the medical field. Emergency medicine is characterized by the need for critical decision-making under high uncertainty, incomplete information, and severe time constraints, facing challenges in LLM implementation distinct from other departments. While surveys targeting general physicians or other specialties exist, large-scale surveys specifically targeting emergency physicians are scarce.

Objective:

This study aimed to assess the usage patterns and perceived issues of LLMs among emergency physicians through a web-based survey conducted by the Japanese Association for Acute Medicine. This study provides foundational knowledge on the current status of LLM use among emergency physicians to promote its safe and effective implementation.

Methods:

An anonymous, cross-sectional, web-based survey was conducted among participants of the Japanese Association for Acute Medicine between June and August 2025. The analysis included 362 emergency physicians. Survey items comprised respondent attributes, LLM usage experience, frequency, purposes of use, service names, and perceived issues (free text). Free-text responses (n=208) were classified using a deterministic rule-based workflow into 6 themes (multi-label). Ordered logistic regression and logistic regression were performed to evaluate the association between sex, age, and years of clinical experience and multiple LLM-related outcomes, calculating odds ratios (ORs).

Results:

The mean age of the 362 participants was 49.2 years. 290 physicians (80.1%) had experience using LLMs. Of these, 46.2% used them "daily" and 33.8% "weekly," meaning 80.0% used them at least once a week. Usage rates were higher among younger generations: 95.3% for those ≤39 years vs 69.0% for those ≥60 years. Purposes included personal use (71.7%), academic activities (65.2%), education (57.2%), operational efficiency/administrative tasks (49.3%), and clinical decision support (43.1%). The regression analyses showed that for each one-step increase in age category, the odds of use frequency significantly decreased (OR 0.97, 95% Confidence Intervals (CI) 0.95-0.98; P<0.001), as did the use for clinical decision support (OR 0.96, 95% CI 0.94-0.99; P<0.001). The rule-based thematic classification identified "Accuracy/Reliability" (60.6%) as the most frequent concern.

Conclusions:

LLM usage has already widely spread among emergency physicians, with younger physicians showing notably higher frequency especially for clinical decision support. This study helps to understand the current status of LLM usage in emergency settings and to discuss future directions for the development of LLM models and usage guidelines tailored to emergency medicine.


 Citation

Please cite as:

Okada N, Nakanishi H, Sakamoto Y, Hirayama S, Liu C, Mitarai S, Mitarai S, Yamamoto G, Okamoto K

Real-World Usage and Perceptions of LLMs Among Emergency Physicians: A Cross-Sectional Survey in the Context of International Governance Trends

JMIR Preprints. 02/04/2026:96996

DOI: 10.2196/preprints.96996

URL: https://preprints.jmir.org/preprint/96996

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.