Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Feb 7, 2024
Date Accepted: Apr 11, 2024

The final, peer-reviewed published version of this preprint can be found here:

Natural Language Processing–Powered Real-Time Monitoring Solution for Vaccine Sentiments and Hesitancy on Social Media: System Development and Validation

Huang LC, Eiden AL, He L, Annan A, Wang S, Wang J, Manion FJ, Wang X, Du J, Yao L

Natural Language Processing–Powered Real-Time Monitoring Solution for Vaccine Sentiments and Hesitancy on Social Media: System Development and Validation

JMIR Med Inform 2024;12:e57164

DOI: 10.2196/57164

PMID: 38904984

PMCID: 11226933

Vaccine sentiments and hesitancy on social media: a natural language processing-powered real-time monitoring system

  • Liang-Chin Huang; 
  • Amanda L. Eiden; 
  • Long He; 
  • Augustine Annan; 
  • Siwei Wang; 
  • Jingqi Wang; 
  • Frank J. Manion; 
  • Xiaoyan Wang; 
  • Jingcheng Du; 
  • Lixia Yao

ABSTRACT

Background:

Vaccines serve as a crucial public health tool, though vaccine hesitancy continues to pose a significant threat to full vaccine uptake and, consequently, community health. Understanding and tracking vaccine hesitancy is essential for effective public health interventions; however, traditional survey methods present various limitations.

Objective:

To create a real-time, natural language processing (NLP)-based tool to assess vaccine sentiment and hesitancy across three prominent social media platforms.

Methods:

We mined and curated discussions from Twitter, Reddit, and YouTube social media platforms, posted between January 1, 2011, and October 31, 2021, concerning human papillomavirus (HPV), measles, mumps, and rubella (MMR), and unspecified vaccines. We tested multiple NLP algorithms to classify vaccine sentiment into positive, neutral, or negative, and to classify vaccine hesitancy using the World Health Organization’s (WHO) 3Cs hesitancy model, conceptualizing an interactive dashboard to illustrate and contextualize trends.

Results:

We compiled over 86 million discussions. Our top-performing NLP models displayed accuracies ranging from 0.51 to 0.78 for sentiment classification and 0.69 to 0.91 for hesitancy classification. Explorative analysis on our platform highlighted variations in online activity about vaccine sentiment and hesitancy, suggesting unique patterns for different vaccines.

Conclusions:

Our innovative system performs real-time analysis of sentiment and hesitancy on three vaccine topics across major social networks, providing crucial trend insights to assist campaigns aimed at enhancing vaccine uptake and public health.


 Citation

Please cite as:

Huang LC, Eiden AL, He L, Annan A, Wang S, Wang J, Manion FJ, Wang X, Du J, Yao L

Natural Language Processing–Powered Real-Time Monitoring Solution for Vaccine Sentiments and Hesitancy on Social Media: System Development and Validation

JMIR Med Inform 2024;12:e57164

DOI: 10.2196/57164

PMID: 38904984

PMCID: 11226933

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.