Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Previously submitted to: JMIR Medical Informatics (no longer under consideration since Nov 04, 2026)

Date Submitted: Nov 3, 2026
Open Peer Review Period: Nov 4, 2026 - Nov 4, 2026
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Development of Large Language Model-Powered Pre-Review of Antineoplastic Drug Reimbursement Claims

  • Ting Li; 
  • Bin Wu; 
  • Yan Jin; 
  • Shi Shang; 
  • Siyu Gu; 
  • Peng Wu

ABSTRACT

Background:

Accurate submission of medication claims to insurers has become increasingly complex in routine clinical practice. Conventional rule-based review systems are difficult to update and have limited utility in complex clinical settings.

Objective:

This study aimed to develop and validate a large language model (LLM)–based auditing system designed for on-premises deployment and integrated with the electronic health record (EHR). The system provides clinicians with reimbursement recommendations and the supporting rationale, offering a scalable and efficient solution for hospitals with limited clinical pharmacist capacity.

Methods:

Using real-world EHR data from 662 inpatients treated with 10 antineoplastic drugs, we compared four state-of-the-art LLMs that differed in architecture, parameter scale, and openness (Qwen3-4B, Qwen3-235B, DeepSeek-R1, and GPT-5) on a binary classification task of medical insurance reimbursement eligibility. We then developed an iterative prompt strategy and applied supervised fine-tuning (SFT) with activation-aware weight quantization (AWQ) to 4-bit precision for the lightweight model. Performance was assessed in three dimensions: predictive validity (accuracy, precision, specificity, and F1 score), repeat-test agreement (Cohen κ), and per-case inference latency.

Results:

With structured prompts, the three large models all exceeded 80% accuracy. Under the same prompt version (Prompt 2), GPT-5 performed best (accuracy 91.4%, Cohen κ = 0.97), followed by DeepSeek-R1 (88.1%, κ = 0.82) and Qwen3-235B (85.5%, κ = 0.69). After SFT and AWQ 4-bit quantization, Qwen3-4B improved from 54.5% to 80.1% accuracy and from 35.5% to 78.5% F1 score, while mean latency per case decreased from 11.5 s to 3.8 s. Trimming input tokens reduced the average token count per case by 83.9%.

Conclusions:

LLM-based systems can achieve high accuracy in pre-auditing antineoplastic drug reimbursement, and optimized lightweight models offer a favorable trade-off between predictive performance and deployment cost. This study provides a reproducible framework for the local clinical implementation of AI-driven pharmacy administration tools. Multicenter prospective studies are warranted to validate generalizability and real-world impact. Clinical Trial: Not Applicable


 Citation

Please cite as:

Li T, Wu B, Jin Y, Shang S, Gu S, Wu P

Development of Large Language Model-Powered Pre-Review of Antineoplastic Drug Reimbursement Claims

JMIR Preprints. 03/11/2026:116033

DOI: 10.2196/preprints.116033

URL: https://preprints.jmir.org/preprint/116033

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.