Previously submitted to: JMIR Formative Research (no longer under consideration since Sep 02, 2025)
Date Submitted: Mar 15, 2025
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Can ChatGPT Function as a Virtual Multidisciplinary Team? A Proof-of-Concept Study in Vascular Malformation Syndromes
ABSTRACT
Background:
Sturge-Weber syndrome (SWS) and Klippel-Trenaunay syndrome (KTS) are complex vascular malformation syndromes that require multidisciplinary team (MDT) management. However, the traditional MDT approach faces challenges such as time coordination, geographical barriers, and inefficiencies in cross-disciplinary communication.
Objective:
This study aims to evaluate ChatGPT’s potential in simulating MDT decision-making for SWS and KTS by comparing its diagnostic and treatment recommendations with traditional MDT conclusions.
Methods:
A case-based proof-of-concept design was employed, retrospectively analyzing MDT records of two SWS and two KTS patients. Clinical data, imaging, and laboratory results were input into ChatGPT, and its outputs were evaluated by two dermatology experts using a 1-5 Likert scale across five dimensions: accuracy, completeness, appropriateness, insight, and safety.
Results:
ChatGPT performed well in most dimensions, particularly in appropriateness, but showed occasional uncertainty in handling complex or rare cases, such as in gene-phenotype associations. Inter-rater reliability ranged from negligible to moderate (ICC -0.00 to 0.63), with no significant differences observed between the experts’ ratings (p > 0.05).
Conclusions:
ChatGPT shows strong potential as a tool for simulating MDT decision-making, particularly in diagnostic accuracy, completeness of recommendations, and cross-disciplinary insights. However, it has limitations in managing complex cases and ensuring the feasibility of its recommendations. Future studies with larger sample sizes and multi-center validation are needed to fully assess its clinical value.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.