Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Mar 26, 2024
Date Accepted: Dec 20, 2024
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
The Reliability and Quality of Videos as Guidance for Gastrointestinal Endoscopy: A Cross-sectional Study
ABSTRACT
Background:
Gastrointestinal endoscopy represents a useful tool for the diagnosis and treatment of gastrointestinal diseases. Video platforms for spreading endoscopy-related knowledge may help patient understand the pros and cons of endoscopy on the premise of ensuring accuracy. However, videos with misinformation may lead to adverse consequences. Therefore, this study aims to evaluate the quality of gastrointestinal endoscopy-related videos on YouTubeTM and to assess whether large language models (LLMs) can help patients obtain information from videos more efficiently.
Objective:
This study aims to evaluate the quality of gastrointestinal endoscopy-related videos on YouTubeTM and to assess whether large language models (LLMs) can help patients obtain information from videos more efficiently.
Methods:
Methods:
We collected information from YouTubeTM videos about three commonly used gastrointestinal endoscopes (gastroscopy, colonoscopy and capsule endoscopy) and assessed their quality (rated by the modified DISCERN Tool, mDISCERN), reliability (rated by JAMA), and recommendation (rated by Global Quality Score, GQS). We tasked LLM with summarizing the video content and assessed it from three perspectives: accuracy, completeness and readability.
Results:
A total of 167 videos were included. According to the indicated scoring, the quality, reliability and recommendation of the three gastrointestinal endoscopy-related videos on YouTubeTM were overall unsatisfactory, and the quality of the videos released by patients was particularly poor. Capsule endoscopy yielded significantly lower GQS than did gastroscopy and colonoscopy. LLM-based summaries yielded accuracy scores of 4 (4-5), completeness scores of 4 (4-5), and readability scores of 2 (1-2).
Conclusions:
The quality of gastrointestinal endoscope-related videos currently on YouTubeTM is poor. Moreover, additional regulatory and improvement strategies are needed in the future. LLM may be helpful in generalizing video-related information, but there is still room for improvement in its ability.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.