JMIR Publications

ABSTRACT

Background:

Radiotherapy is a crucial modality in cancer treatment. In recent years, the rise of short-form video platforms has transformed how the public accesses medical information. TikTok and Bilibili, as leading short-video platforms, have emerged as significant channels for disseminating health information. However, there is an urgent need to evaluate the quality and reliability of the information related to radiotherapy available on these platforms.

Objective:

This study aims to systematically assess the information quality and reliability of radiotherapy-related short-form videos on TikTok and Bilibili platforms using the Global Quality Score (GQS) and a modified DISCERN evaluation tool, thereby elucidating the current landscape and challenges of digital health communication.

Methods:

This study systematically retrieved the top 100 radiotherapy-related videos on TikTok and Bilibili as of February 25, 2025. The quality of the videos was assessed using the Global Quality Score (GQS, 1-5 points) and a modified DISCERN scoring system (1-5 points). Statistical analyses were conducted using the Mann-Whitney U test, as well as Spearman and Pearson correlation analyses, to ensure the reliability and validity of the results.

Results:

A total of 200 short-form videos related to radiotherapy were analyzed, revealing that the overall quality of videos on TikTok and Bilibili is unsatisfactory. Specifically, the median Global Quality Score (GQS) for TikTok was 4 (interquartile range [IQR] 3-4), while for Bilibili it was 3 (IQR 3-4). The median modified DISCERN scores for both platforms were 3 (IQR 2-4 and IQR 3-4, respectively).On TikTok, 53% (53/100) of the videos were rated as "good" or higher, whereas 45% (45/100) of the videos on Bilibili were considered "relatively reliable." Videos produced by professionals, institutions, and non-professional organizations had significantly higher DISCERN scores compared to those produced by non-professional individuals, with statistical significance (P<.0001, P<.0001, and P<.01, respectively).Furthermore, the correlations between the number of bookmarks and video duration with DISCERN scores were 0.172 (p = 0.015) and 0.192 (p = 0.007), respectively. However, no video variables were found to effectively predict the overall quality and reliability of the videos.

Conclusions:

This study revealed that the overall quality of radiotherapy-related videos on TikTok and Bilibili is generally low. However, videos uploaded by professionals demonstrate higher information quality and reliability, providing valuable support for patients seeking guidance on healthcare management and treatment options for tumors. Therefore, improving the quality and reliability of video content, particularly those produced by non-professionals, is crucial for ensuring the public has access to accurate medical information.