Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Public Health and Surveillance

Date Submitted: Jul 31, 2020
Date Accepted: May 12, 2021

The final, peer-reviewed published version of this preprint can be found here:

Using Machine Learning to Compare Provaccine and Antivaccine Discourse Among the Public on Social Media: Algorithm Development Study

Argyris Y, Monu K, Tan PN, Aarts C, Jiang F, Wiseley KA

Using Machine Learning to Compare Provaccine and Antivaccine Discourse Among the Public on Social Media: Algorithm Development Study

JMIR Public Health Surveill 2021;7(6):e23105

DOI: 10.2196/23105

PMID: 34185004

PMCID: 8277307

Framing Vaccines among the Public on Social Media: Developing Machine Learning Algorithms for Detecting and Visualizing Pro and Anti-Vaccine Discourse

  • Young Argyris; 
  • Kafui Monu; 
  • Pang-Ning Tan; 
  • Colton Aarts; 
  • Fan Jiang; 
  • Kaleigh Anne Wiseley

ABSTRACT

Background:

Exposure to anti-vaccine content on social media has been associated with delays and refusals of vaccinations, while pro-vaccine campaigns devised to disseminate the preventive benefits of vaccines have not succeeded in increasing vaccine uptake rates. Reasons remain unknown why anti-vaccine messaging hampers uptake while pro-vaccine campaigns do not improve it.

Objective:

We aim to identify reasons for the disparate effectiveness of anti- versus pro-vaccine social media content on vaccine delivery rates. In so doing, we apply the perspectives of message framing used in interpersonal health communication to explain why individuals refuse to adopt preventive behaviors. Specifically, we compare (1) the diversity, coherence, and distinctiveness of topics discussed by pro- and anti-vaccine communities and (2) message frames used to portray vaccines as a public health accomplishment or harmful agents.

Methods:

We developed a multimethod that combines the collection of a large amount of data from Twitter (~40,000 tweets), an automatic tweet classification algorithm, the K-means clustering algorithm, and a qualitative content analysis.

Results:

Our results show a larger number of topics (20 versus 17 clusters), greater coherence of topics (0.99 vs. 0.97) and distinctiveness of topics (1.22 vs. 1.31) among anti-vaccinists in comparison to pro-vaccinists. In addition, while anti-vaccinists use all four message frames known to make narratives persuasive and influential, pro-vaccinists neglect the problem statement.

Conclusions:

Based on our results, we attribute the diversity, coherence, and distinctiveness of topics discussed among anti-vaccinists to their higher engagement, and we ascribe the influence of vaccine debate on uptake rates to the comprehensiveness of the message frames. These results show the urgency of developing value propositions for vaccines to counteract the negative impact of anti-vaccine content on the uptake rates. Clinical Trial: This study was determined to be a non-human subject study by Michigan State University’s Institutional Review Board (#STUDY00004514).


 Citation

Please cite as:

Argyris Y, Monu K, Tan PN, Aarts C, Jiang F, Wiseley KA

Using Machine Learning to Compare Provaccine and Antivaccine Discourse Among the Public on Social Media: Algorithm Development Study

JMIR Public Health Surveill 2021;7(6):e23105

DOI: 10.2196/23105

PMID: 34185004

PMCID: 8277307

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.