Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: May 1, 2022
Date Accepted: Jan 12, 2023
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Quality of the Information in gallstone disease Videos on TikTok: a Cross-Sectional Study
ABSTRACT
Background:
Health content has been widely studied on video sites like YouTube, but it remains under-investigated in the short-video application TikTok.
Objective:
Our study aimed to identify upload sources, contents and feature information of gallstone disease videos on TikTok and further evaluated the factors related to video quality.
Methods:
We investigated the first 100 gallstone-related videos on TikTok and analyzed these videos' upload sources, content, and characteristics. The quality of videos was evaluated using quantitative scoring tools like DISCERN instrument, the Journal of American Medical Association (JAMA) benchmark criteria, and Global Quality Scores (GQS). Moreover, the correlation between video quality and video characteristics, including duration, likes, comments and shares, was further investigated.
Results:
According to video sources, 81%(81/100) of the videos were posted by doctors. Furthermore, Disease knowledge was the most dominant video content, accounting for 56% (56/100) of all the videos. The mean DISCERN, JAMA and GQS scores of all 100 videos are 39.61(SD 11.36), 2.00(SD 0.40) and 2.76(SD 0.95), respectively. According to DISCERN and GQS, gallstone-related videos' quality score on TikTok is not high, mainly at Fair(43%, 43/100) and Moderate(46%, 46/100). The total DISCERN scores of Doctors were significantly higher than Individuals and News agencies (P =.0077 and P =.0012, respectively), Surgery techniques were significantly higher than Lifestyle and News (P =.0147 and P=.0002, respectively), and Disease knowledge was significantly higher than News (P =.0074). DISCERN scores and video duration were positively correlated (r= 0.586245, P <.0001). Negative correlations were found between DISCERN scores and likes and shares of videos (r=-0.2956, P =.002825; r=-0.2329, P =.0197, respectively). In GQS analysis, no significant differences were found between groups based on different sources or different contents. JAMA was excluded in the video quality and correlation analysis due to a lack of discrimination and inability to evaluate the video quality accurately.
Conclusions:
Although the videos of gallstones on TikTok are mainly provided by Doctors and contain Disease knowledge, they are of low quality. We found a positive correlation between video duration and video quality. High-quality videos received low attention, and popular videos were of low quality. Medical information on TikTok is currently not rigorous enough to guide patients to make accurate judgments. TikTok was not an appropriate source of knowledge to educate patients due to the low quality and reliability of the information.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.