Accepted for/Published in: JMIR Formative Research
Date Submitted: Apr 24, 2025
Date Accepted: Jul 3, 2025
Evaluating ChatGPT's Utility in Biologic Therapy for Systemic Lupus Erythematosus: A Comparative Study of ChatGPT and Google Web Search
ABSTRACT
Background:
ChatGPT’s content generation potential is becoming increasingly prominent in the medical field.
Objective:
The main aim of this study is to assess ChatGPT’s utility as a tool for users to obtain health information about biologic therapy for SLE (Systemic Lupus Erythematosus) online.
Methods:
By attempting to replicate the user’s internet search, the search terms “biologic therapy” and “systemic lupus erythematosus” were entered into both ChatGPT and Google Web Search. The 20 most common questions, answers, and their sources from each platform were extracted for comparative analysis.
Results:
ChatGPT provided professional and cautious answers, cited reliable supporting materials with sources linked below, and demonstrated humanistic care. However, the text generated by ChatGPT-4o had low readability, making it more suitable for users with a university-level education.
Conclusions:
Compared to Google Web Search, ChatGPT demonstrates greater capability in providing information related to biologic therapy for SLE. By offering accurate and reliable answers with supporting evidence, ChatGPT helps eliminate misleading information. However, given the study’s limitations in question scope, comparison dimensions, and language types, further in-depth comparative research is recommended.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.