Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Large language models have gained popularity in healthcare in multiple fields. One of these fields is radiology. Patients may use tools like Chat-GPT4o to scan their imaging to better understand their pathology. Clinicians may also use Chat-GPT4o to increase productivity and reduce human error. However, given this is a new technology, we do not know the diagnostic efficacy of Chat-GPT4o in the field of radiology. The aim of this study was to analyze the capability of Chat-GPT4o in properly identifying knee osteoarthritis.
One thousand x-rays were given to Chat-GPT. Five hundred were normal knee x-rays, and the others were knees with osteoarthritis, vetted by radiologists. The x-rays were provided from an online publicly available database on Kaggle. Chat-GPT4o had good sensitivity but poor specificity in identifying knee osteoarthritis. It had a high level of false positives and poor precision.
Overall, patients and clinicians should practice caution when using Chat-GPT4o to analyze imaging in knee osteoarthritis.
Citation
Please cite as:
Tandon M, Chetla N, Zebari B, Samayamanthula S, Silva J, Vaja S, Chen J, Cullen M, Sukhija K
Can Artificial Intelligence Diagnose Knee Osteoarthritis?