Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Dec 4, 2023
Date Accepted: Apr 15, 2024
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
ChatGPT, MD: Characterizing the Adoption and Experiences of Users of AI-Generated Health Information – A Cross-sectional Survey Study
ABSTRACT
Background:
OpenAI's ChatGPT is a source of advanced online health information (OHI) that may be integrated into individuals' health information-seeking routines. However, concerns have been raised about its factual accuracy and impact on health outcomes. To forecast implications for medical practice and public health, more information is needed on who uses the tool, how often, and for what.
Objective:
Characterize the reasons for and types of ChatGPT OHI use and describe the characterize types of users most likely to engage with the platform.
Methods:
In this cross-sectional survey, patients received invitations to participate via the ResearchMatch platform, a non-profit affiliate of the National Institutes of Health. An online survey measured demographic characteristics, use of ChatGPT and other sources of OHI , experience characterization, and resultant health behaviors. Descriptive statistics were used to summarize the data. T-tests and Pearson’s chi-square tests were used to compare users of ChatGPT OHI to non-users.
Results:
Of 2406 respondents, 21.5% (n=517) reported using ChatGPT for OHI. ChatGPT users were younger than non-users (32.8 vs. 39.1 years, P<.001) with lower advanced degree attainment (BA or higher) (49.9% vs. 67.0%, P<.001) and greater use of transient health care (ED, urgent care etc.) (P<.001). ChatGPT users were more avid consumers of general non-ChatGPT OHI (percentage of weekly or greater OHI seeking frequency in past 6 months, 28.2% vs 22.8%, P<.001). 39.3% endorsed using the platform for OHI 2-3 times weekly or more, and most sought the tool to determine if consultation was required (47.4%) or to explore alternative treatment (46.2%). Use characterization was favorable as many believed ChatGPT to be just as or more useful than other OHI (87.7%) and their doctor (81.0%). About one-third of respondents requested a referral (35.6%) or changed medications (31.0%) based on the information received from ChatGPT. As many users reported skepticism regarding the ChatGPT output (67.9%), most turned to their physicians (67.5%).
Conclusions:
This study underscores the significant role of AI-generated online health information in shaping health-seeking behaviors and the potential evolution of patient-provider interactions. Given the proclivity of these users to enact health behavior changes based on AI-generated content, there is an opportunity for physicians to guide ChatGPT OHI users on an informed and examined use of the technology.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.