Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Human-in-the-Loop as a Safety Guardrail: Clinical Accountability in the LLM Era
Isaac Zablah;
Yolly Molina;
Antonio Garcia-Loureiro
ABSTRACT
We talk about Zhang et al.'s review of LLMs in healthcare and stress that how well they work in practice is what matters most. There are still some big problems: 2–10 second latencies, a lot of VRAM needed, and the ability to handle many users at once. We suggest standard metrics (operations per diagnosis, energy per inference, cost-effectiveness) and ways to improve performance, such as quantization/pruning, edge deployment, and hybrid architectures. In an initial benchmarking, approximately 14 billion-parameter medical models attained 85–90% of GPT-4’s accuracy utilizing roughly 15% of the resources. We think that HPC and biomedical informatics should be aligned for fair and efficient use.
Citation
Please cite as:
Zablah I, Molina Y, Garcia-Loureiro A
Human-in-the-Loop as a Safety Guardrail: Clinical Accountability in the Large Language Model Era