Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Jan 15, 2026
Date Accepted: Feb 26, 2026

The final, peer-reviewed published version of this preprint can be found here:

Authors’ Reply: Critical Limitations in Comparing ChatGPT and DeepSeek for Orthopedic Assessment

Anusitviwat C, Suwannaphisit S, Bvonpanttarananon J, Tangtrakulwanich B

Authors’ Reply: Critical Limitations in Comparing ChatGPT and DeepSeek for Orthopedic Assessment

JMIR Form Res 2026;10:e91470

DOI: 10.2196/91470

PMID: 41843771

Authors’ Reply: Critical Limitations in Comparing ChatGPT and DeepSeek for Orthopedic Assessment

  • Chirathit Anusitviwat; 
  • Sitthiphong Suwannaphisit; 
  • Jongdee Bvonpanttarananon; 
  • Boonsin Tangtrakulwanich

ABSTRACT

We respond to comments on our study comparing ChatGPT and DeepSeek for answering orthopedic multiple-choice questions. We clarify that the reported Cohen κ values reflect inter-rater reliability within each model rather than agreement between the two models. All questions were administered in English, and the findings therefore reflect performance in an English-language context. We acknowledge limitations related to reproducibility due to the use of web-based interfaces and address concerns about data contamination. We also correct a typographical error in the reported accuracy for the pelvic and spine injury category.


 Citation

Please cite as:

Anusitviwat C, Suwannaphisit S, Bvonpanttarananon J, Tangtrakulwanich B

Authors’ Reply: Critical Limitations in Comparing ChatGPT and DeepSeek for Orthopedic Assessment

JMIR Form Res 2026;10:e91470

DOI: 10.2196/91470

PMID: 41843771

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.