Currently submitted to: JMIR Formative Research
Date Submitted: Sep 7, 2026
Open Peer Review Period: Sep 25, 2026 - Nov 20, 2026
(currently open for review)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
A 16-Item Benchmark and Cost-Aware Selection for Biomedical Foundation Models
ABSTRACT
Directly measured performance differences among four frontier models on the 16 standard items of a biomedical benchmark were at most 0.13 points (4.79–4.92 of 5; overlapping 95% CIs), while list-price API costs differed by up to approximately 107-fold, motivating a composite cost-aware index framework (RCS/VPI/PER/CSR) for budget-constrained model selection.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.