Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Dec 12, 2023
Date Accepted: Jul 4, 2024

The final, peer-reviewed published version of this preprint can be found here:

Quality Assessment of TikTok as a Source of Information About Mitral Valve Regurgitation in China: Cross-Sectional Study

Cui N, Lu Y, Cao Y, Chen X, Fu S, Su Q

Quality Assessment of TikTok as a Source of Information About Mitral Valve Regurgitation in China: Cross-Sectional Study

J Med Internet Res 2024;26:e55403

DOI: 10.2196/55403

PMID: 39163110

PMCID: 11372326

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Quality Assessment of TikTok as a Source of Information about Mitral Valve Regurgitation in China: A Cross-Sectional Study

  • Nannan Cui; 
  • Yuting Lu; 
  • Yelin Cao; 
  • Xiaofan Chen; 
  • Shuiqiao Fu; 
  • Qun Su

ABSTRACT

Background:

In China, mitral regurgitation is the prevailing cardiovascular valve disease, however, Chinese patients are generally characterized by high incidence, low rate of health knowledge and a low surgical-treatment rate. TikTok hosts a vast amount of content related to diseases and health knowledge, enabling viewers to acquire relevant information. Nevertheless, there has no investigation or evaluation conducted on the quality of videos pertaining to mitral valve regurgitation.

Objective:

Our study aimed to assess the quality of videos about mitral valve regurgitation in China on TikTok.

Methods:

A cross-sectional study was conducted using the Chinese version of TikTok on September 9, 2023. The top 100 videos were included, the videos were evaluated using quantitative scoring tools such as the mDISCERN, JAMA, GQS, and the PEMAT-AV. Correlation and Poisson regression analyses were performed between video quality and characteristics.

Results:

We obtained 88 valid video files, most videos (92.1%) were uploaded by certified physicians, mainly cardiac surgeons and cardiologists. News agencies/organizations and physicians had higher GQSs than individuals (news agencies/organizations vs. individuals P = 0.001, physicians vs. individuals P = 0.026). News agencies/organizations had higher PEMAT understandability scores than individuals (P = 0.013). Videos regarding disease knowledge had higher GQS, PEMAT understandability scores, and PEMAT actionability scores, compared with videos covering surgical cases (P < 0.0011, P = 0.0002, and P = 0.0002, respectively). PEMAT actionability scores were higher for outpatient cases than for surgical cases (P = 0.0002); videos regarding surgical techniques had lower PEMAT actionability scores than videos regarding disease knowledge (P = 0.041). The strongest correlations included thumbs up and comments (r = 0.92, P < 0.001), thumbs up and favorites (r = 0.89, P < 0.001), thumbs up and sharing (r = 0.87, P < 0.001), comments and favorites (r = 0.81, P < 0.001), comments and sharing (r = 0.87, P < 0.001), and favorites and sharing (r = 0.83, P < 0.001).The Poisson regression analysis showed the GQSs of cardiac surgeons and cardiologists were 1.304-fold and 1.243-fold higher than those of other healthcare professionals. The GQSs for disease knowledge and surgical technique were 1.314-fold higher than those for news/advertising, respectively.

Conclusions:

Our study shows that most MR-related videos on TikTok were uploaded by certified physicians, ensuring their professional and scientific content; however, overall video-quality scores were suboptimal. Although most videos had educational significance to the audience, guidance was insufficient. TikTok should strengthen its review and recommendation mechanisms for professional medical content to improve its quality. Current evaluation tools are unable to assess the quality of short videos comprehensively; more effective tools are needed to evaluate fully the contents of short-video platforms such as TikTok. Clinical Trial: None


 Citation

Please cite as:

Cui N, Lu Y, Cao Y, Chen X, Fu S, Su Q

Quality Assessment of TikTok as a Source of Information About Mitral Valve Regurgitation in China: Cross-Sectional Study

J Med Internet Res 2024;26:e55403

DOI: 10.2196/55403

PMID: 39163110

PMCID: 11372326

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.