Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Dermatology

Date Submitted: Oct 14, 2024
Date Accepted: Feb 17, 2025

The final, peer-reviewed published version of this preprint can be found here:

Evaluating the Diagnostic Accuracy of ChatGPT-4 Omni and ChatGPT-4 Turbo in Identifying Melanoma: Comparative Study

Chetla N, Chang J, Sattler S, Chen M, Guo WY, Shah D, Hugh J

Evaluating the Diagnostic Accuracy of ChatGPT-4 Omni and ChatGPT-4 Turbo in Identifying Melanoma: Comparative Study

JMIR Dermatol 2025;8:e67551

DOI: 10.2196/67551

PMID: 40117499

PMCID: 11952272

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

What is the Capability and Accuracy of ChatGPT’s Newest Models in Diagnosing between Melanoma and Non-Melanoma lesions?

  • Nitin Chetla; 
  • Joseph Chang; 
  • Samantha Sattler; 
  • Matthew Chen; 
  • William Young Guo; 
  • Dia Shah; 
  • Jeremy Hugh

ABSTRACT

ChatGPT is increasing in use in healthcare. Fields like dermatology and radiology could benefit from use of ChatGPT to help clinicians diagnose skin lesions. This research letter aims to find the accuracy of ChatGPT in diagnosing melanoma based on images. Our analysis indicates that ChatGPT cannot be used reliably to diagnose melanoma and improvements are needed in the program to reach this stage, but it can still help clinicians.


 Citation

Please cite as:

Chetla N, Chang J, Sattler S, Chen M, Guo WY, Shah D, Hugh J

Evaluating the Diagnostic Accuracy of ChatGPT-4 Omni and ChatGPT-4 Turbo in Identifying Melanoma: Comparative Study

JMIR Dermatol 2025;8:e67551

DOI: 10.2196/67551

PMID: 40117499

PMCID: 11952272

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.