Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Nov 16, 2023
Date Accepted: Apr 19, 2024
Date Submitted to PubMed: May 20, 2024
Multimodal ChatGPT-4V for ECG Interpretation: Promise and Limitations
ABSTRACT
Electrocardiogram (ECG) interpretation is an essential skill in cardiovascular medicine. This study evaluated the capabilities of newly released ChatGPT-4V, a large language model with visual recognition abilities, in interpreting ECG waveforms and answering related multiple-choice questions. A total of 62 ECG-related multiple-choice questions were collected from reputable medical exams. ChatGPT was prompted to answer the questions by analyzing the accompanying ECG images. Requiring at least 1 of 3 responses to be correct, ChatGPT achieved an overall accuracy of 83.87% across all question types. ChatGPT demonstrated significantly lower performance on counting-based questions like calculating QT intervals compared to diagnostic and treatment recommendation questions. The findings indicate that while ChatGPT shows promising potential in ECG interpretation and decision-making, its diagnostic reliability and quantitative analysis abilities need improvement before real clinical use. Further large-scale studies are warranted to fully evaluate ChatGPT's capabilities and track its progress as the model accumulates more medical knowledge through ongoing training. With technological advancements, multimodal AI like ChatGPT may one day play an important role in assisting clinicians with ECG interpretation and cardiovascular care.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.