Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Yano Y, Kakizaki H, Nagasu H, Kishi S, Koshida T, Nihei Y, Hirano A, Nangaku M, Mori H, Naito T, Ohashi M, Maruyama S, Matsui I, Isaka Y, Okada H, Suzuki Y, Kashihara N
Clinical Evaluation of the Clinical Reasoning Process of Large Language Models in Nephrology: Comparative Evaluation Study
Clinical Evaluation of the Clinical Reasoning Process of Large Language Models in Nephrology: Comparative Evaluation Study
Yuichiro Yano;
Hiroaki Kakizaki;
Hajime Nagasu;
Seiji Kishi;
Takeo Koshida;
Yoshihito Nihei;
Akira Hirano;
Masaomi Nangaku;
Hirotake Mori;
Toshio Naito;
Mizuki Ohashi;
Shoichi Maruyama;
Isao Matsui;
Yoshitaka Isaka;
Hirokazu Okada;
Yusuke Suzuki;
Naoki Kashihara
ABSTRACT
We introduce a step-by-step framework to evaluate LLM clinical reasoning using complex nephrology cases, revealing model-specific weaknesses in advanced reasoning tasks and demonstrating that high reasoning performance does not require high computational cost.
Citation
Please cite as:
Yano Y, Kakizaki H, Nagasu H, Kishi S, Koshida T, Nihei Y, Hirano A, Nangaku M, Mori H, Naito T, Ohashi M, Maruyama S, Matsui I, Isaka Y, Okada H, Suzuki Y, Kashihara N
Clinical Evaluation of the Clinical Reasoning Process of Large Language Models in Nephrology: Comparative Evaluation Study